Sep 09 15:20:15.680230 ip-10-0-140-68 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 15:20:16.133212 ip-10-0-140-68 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 15:20:16.133212 ip-10-0-140-68 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 15:20:16.133212 ip-10-0-140-68 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 15:20:16.133212 ip-10-0-140-68 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 15:20:16.133212 ip-10-0-140-68 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 15:20:16.135743 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.135648    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 15:20:16.140378 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140350    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 15:20:16.140378 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140373    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 15:20:16.140378 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140377    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 15:20:16.140378 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140381    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 15:20:16.140378 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140384    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 15:20:16.140378 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140387    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140391    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140394    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140397    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140399    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140402    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140405    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140408    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140411    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140413    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140416    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140420    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140425    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140428    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140433    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140436    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140438    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140441    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140444    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140446    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 15:20:16.140627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140449    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140451    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140454    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140456    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140459    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140462    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140464    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140467    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140469    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140472    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140474    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140477    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140480    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140482    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140486    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140489    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140491    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140494    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140497    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140500    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 15:20:16.141137 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140503    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140505    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140508    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140511    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140514    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140517    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140519    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140522    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140525    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140527    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140529    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140532    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140535    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140537    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140540    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140542    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140545    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140547    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140550    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140552    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 15:20:16.141685 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140555    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140557    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140560    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140562    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140565    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140567    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140571    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140575    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140577    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140580    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140582    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140585    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140587    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140590    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140593    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140597    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140601    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140604    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140608    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 15:20:16.142184 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140612    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140615    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140618    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140621    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140624    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140627    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140630    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140633    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140636    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140639    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140641    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140646    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140650    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140653    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.140655    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141372    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141379    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141382    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141386    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 15:20:16.142698 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141389    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141392    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141396    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141398    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141401    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141403    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141406    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141409    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141411    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141413    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141416    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141419    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141421    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141424    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141427    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141429    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141432    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141434    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141437    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141440    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 15:20:16.143198 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141442    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141445    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141447    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141449    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141452    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141454    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141457    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141459    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141462    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141465    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141468    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141471    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141475    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141479    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141482    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141484    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141487    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141490    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141492    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141494    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 15:20:16.143707 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141497    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141500    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141502    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141505    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141507    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141510    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141513    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141516    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141519    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141521    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141524    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141527    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141529    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141531    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141534    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141536    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141539    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141541    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141544    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 15:20:16.144236 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141546    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141549    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141553    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141557    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141561    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141564    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141567    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141569    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141572    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141575    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141577    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141580    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141582    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141585    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141587    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141590    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141592    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141595    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141597    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 15:20:16.144708 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141600    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141605    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141609    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141612    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141615    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141618    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141623    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141626    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141629    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141631    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141634    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141636    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141639    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141641    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141643    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141646    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.141649    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142052    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142057    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 15:20:16.145190 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142060    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142063    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142066    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142069    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142072    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142075    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142078    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142080    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142083    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142085    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142088    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142091    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142095    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142098    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142102    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142105    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142108    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142111    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142115    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 15:20:16.145680 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142122    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142125    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142128    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142130    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142133    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142136    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142138    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142141    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142144    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142146    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142149    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142151    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142154    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142157    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142160    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142162    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142165    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142167    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142170    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142172    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 15:20:16.146174 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142175    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142177    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142180    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142183    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142185    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142188    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142190    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142195    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142199    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142203    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142207    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142210    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142214    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142217    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142220    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142222    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142225    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142228    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142230    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 15:20:16.146673 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142233    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142235    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142238    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142240    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142243    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142245    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142249    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142252    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142254    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142257    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142260    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142262    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142265    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142267    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142271    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142274    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142276    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142278    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142281    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142283    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 15:20:16.147289 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142286    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142288    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142292    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142294    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142297    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142300    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142302    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142305    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142308    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142310    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142313    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142316    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142318    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142320    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142323    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142325    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142328    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142330    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.142333    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142412    2574 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 15:20:16.147815 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142453    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142463    2574 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142468    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142472    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142475    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142480    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142485    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142489    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142492    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142495    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142498    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142502    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142505    2574 flags.go:64] FLAG: --cgroup-root=""
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142508    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142511    2574 flags.go:64] FLAG: --client-ca-file=""
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142514    2574 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142517    2574 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142521    2574 flags.go:64] FLAG: --cluster-domain=""
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142524    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142527    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142530    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142534    2574 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142538    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 15:20:16.148328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142541    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142544    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142547    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142550    2574 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142553    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142566    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142570    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142573    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142577    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142581    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142584    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142586    2574 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142589    2574 flags.go:64] FLAG: --enable-server="true"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142592    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142597    2574 flags.go:64] FLAG: --event-burst="100"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142602    2574 flags.go:64] FLAG: --event-qps="50"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142605    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142608    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142611    2574 flags.go:64] FLAG: --eviction-hard=""
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142615    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142618    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142621    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142624    2574 flags.go:64] FLAG: --eviction-soft=""
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142627    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142630    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 15:20:16.148943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142634    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142637    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142639    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142642    2574 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142645    2574 flags.go:64] FLAG: --feature-gates=""
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142649    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142652    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142655    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142657    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142660    2574 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142663    2574 flags.go:64] FLAG: --help="false"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142666    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142669    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142672    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142675    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142678    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142681    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142684    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142687    2574 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142689    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142692    2574 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142695    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142700    2574 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142703    2574 flags.go:64] FLAG: --kube-reserved=""
Sep 09 15:20:16.149577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142706    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142709    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142712    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142715    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142718    2574 flags.go:64] FLAG: --lock-file=""
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142722    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142725    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142728    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142733    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142736    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142739    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142742    2574 flags.go:64] FLAG: --logging-format="text"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142745    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142748    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142751    2574 flags.go:64] FLAG: --manifest-url=""
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142754    2574 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142759    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142761    2574 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142766    2574 flags.go:64] FLAG: --max-pods="110"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142769    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142772    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142774    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142777    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142781    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142784    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 15:20:16.150188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142786    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142795    2574 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142798    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142801    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142804    2574 flags.go:64] FLAG: --pod-cidr=""
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142808    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142813    2574 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142816    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142819    2574 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142822    2574 flags.go:64] FLAG: --port="10250"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142825    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142828    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07c9afbaaf15e5c3a"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142832    2574 flags.go:64] FLAG: --qos-reserved=""
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142836    2574 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142854    2574 flags.go:64] FLAG: --register-node="true"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142857    2574 flags.go:64] FLAG: --register-with-taints=""
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142861    2574 flags.go:64] FLAG: --registry-burst="10"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142865    2574 flags.go:64] FLAG: --registry-qps="5"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142868    2574 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142871    2574 flags.go:64] FLAG: --reserved-memory=""
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142875    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142877    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142880    2574 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142884    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142887    2574 flags.go:64] FLAG: --runonce="false"
Sep 09 15:20:16.150964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142889    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142892    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142895    2574 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142898    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142901    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142904    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142907    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142910    2574 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142912    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142915    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142918    2574 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142921    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142928    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142931    2574 flags.go:64] FLAG: --system-cgroups=""
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142934    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142940    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142942    2574 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142945    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142949    2574 flags.go:64] FLAG: --tls-min-version=""
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142952    2574 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142956    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142959    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142962    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142965    2574 flags.go:64] FLAG: --v="2"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142969    2574 flags.go:64] FLAG: --version="false"
Sep 09 15:20:16.151593 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142974    2574 flags.go:64] FLAG: --vmodule=""
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142978    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.142981    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143101    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143106    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143110    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143113    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143115    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143120    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143123    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143126    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143129    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143132    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143135    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143138    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143140    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143143    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143145    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143148    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 15:20:16.152288 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143152    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143155    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143157    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143160    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143162    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143165    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143167    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143170    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143173    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143176    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143179    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143181    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143184    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143186    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143190    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143192    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143194    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143197    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143199    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143202    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143205    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 15:20:16.152778 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143208    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143211    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143214    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143216    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143219    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143222    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143226    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143229    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143232    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143235    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143237    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143240    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143243    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143246    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143248    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143251    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143253    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143256    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143258    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 15:20:16.153336 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143262    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143264    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143267    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143269    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143272    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143275    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143277    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143281    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143283    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143286    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143289    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143292    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143296    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143299    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143301    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143304    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143306    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143309    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143311    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143314    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 15:20:16.153811 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143317    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143319    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143322    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143324    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143328    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143331    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143333    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143335    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143338    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143341    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143343    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143346    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143349    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143352    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143355    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143359    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143362    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143365    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143367    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143369    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 15:20:16.154335 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143373    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 15:20:16.154874 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143375    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 15:20:16.154874 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.143378    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 15:20:16.154874 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.144093    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 15:20:16.154874 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.152365    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 15:20:16.154874 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.152384    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 15:20:16.154874 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.152405    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 15:20:16.154874 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.152411    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 15:20:16.154874 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152488    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 15:20:16.154874 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152493    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 15:20:16.154874 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152496    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 15:20:16.154874 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152499    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 15:20:16.154874 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152503    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 15:20:16.154874 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152506    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 15:20:16.154874 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152508    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152511    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152514    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152517    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152519    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152522    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152525    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152527    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152530    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152533    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152535    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152538    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152540    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152543    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152546    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152548    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152551    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152554    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152563    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152566    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 15:20:16.155250 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152569    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152572    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152574    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152578    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152580    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152583    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152585    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152588    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152591    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152593    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152596    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152598    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152601    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152604    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152606    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152609    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152611    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152614    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152617    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152619    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 15:20:16.155772 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152622    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152625    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152627    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152630    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152633    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152635    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152638    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152640    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152643    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152646    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152648    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152656    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152659    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152662    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152665    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152668    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152672    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152674    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152678    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 15:20:16.156344 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152682    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152685    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152688    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152691    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152694    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152697    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152699    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152702    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152705    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152707    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152710    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152712    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152715    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152718    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152721    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152723    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152726    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152728    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152732    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 15:20:16.156824 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152735    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 15:20:16.157331 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152739    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 15:20:16.157331 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152742    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 15:20:16.157331 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152744    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 15:20:16.157331 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152747    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 15:20:16.157331 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152749    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 15:20:16.157331 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152758    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 15:20:16.157331 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152762    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 15:20:16.157331 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152769    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 15:20:16.157331 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152772    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 15:20:16.157331 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152775    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 15:20:16.157331 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152777    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 15:20:16.157331 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152780    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 15:20:16.157331 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152783    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 15:20:16.157331 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152786    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 15:20:16.157331 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.152791    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152952    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152956    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152959    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152962    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152964    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152967    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152970    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152972    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152974    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152977    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152979    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152982    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152985    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152987    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152990    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152992    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152995    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.152997    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153000    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 15:20:16.157706 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153003    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153005    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153008    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153010    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153018    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153021    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153024    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153027    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153030    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153032    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153036    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153040    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153043    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153046    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153048    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153051    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153054    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153056    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153059    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153061    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 15:20:16.158223 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153064    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153066    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153069    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153071    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153074    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153077    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153079    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153082    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153084    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153088    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153091    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153095    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153098    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153101    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153103    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153106    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153108    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153117    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153120    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153122    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 15:20:16.158725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153125    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153127    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153130    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153132    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153135    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153137    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153139    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153142    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153144    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153147    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153149    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153151    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153154    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153156    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153159    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153161    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153164    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153166    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153169    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 15:20:16.159248 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153173    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153175    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153178    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153181    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153183    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153186    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153188    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153196    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153199    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153202    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153204    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153212    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153214    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153217    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153219    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153222    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153224    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153227    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153229    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153231    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 15:20:16.159725 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:16.153234    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 15:20:16.160303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.153239    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 15:20:16.160303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.153359    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 15:20:16.160303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.155960    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 15:20:16.160303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.157115    2574 server.go:1019] "Starting client certificate rotation"
Sep 09 15:20:16.160303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.157224    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 15:20:16.160303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.157262    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 15:20:16.160303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.160124    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 15:20:16.168794 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.168768    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 15:20:16.179790 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.179769    2574 log.go:25] "Validated CRI v1 runtime API"
Sep 09 15:20:16.183352 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.183335    2574 log.go:25] "Validated CRI v1 image API"
Sep 09 15:20:16.184218 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.184185    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 15:20:16.184318 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.184289    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 15:20:16.189920 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.189899    2574 fs.go:135] Filesystem UUIDs: map[6d75a4f0-df2b-477f-a11b-9d8229ba77f3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e7223396-ae94-46dc-be9b-79a7a59a58d4:/dev/nvme0n1p3]
Sep 09 15:20:16.189979 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.189921    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 15:20:16.195303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.195178    2574 manager.go:216] Machine: {Timestamp:2026-09-09 15:20:16.193771646 +0000 UTC m=+0.383974406 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3051057 MemoryCapacity:32812146688 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fba5f2c92f98c5f067cf7d58da5f7 SystemUUID:ec2fba5f-2c92-f98c-5f06-7cf7d58da5f7 BootID:3014e036-7630-45ff-b10f-f91d519a744a Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406073344 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:53:66:52:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:53:66:52:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:1d:6e:a2:56:6f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812146688 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 15:20:16.195303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.195300    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 15:20:16.195412 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.195391    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 15:20:16.198459 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.198428    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 15:20:16.198657 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.198462    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-68.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 15:20:16.199392 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.199379    2574 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 15:20:16.199458 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.199399    2574 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 15:20:16.199458 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.199416    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 15:20:16.199458 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.199436    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 15:20:16.201511 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.201498    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 15:20:16.206327 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.206312    2574 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 15:20:16.206475 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.206464    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 15:20:16.206533 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.206504    2574 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 15:20:16.206533 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.206531    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 15:20:16.206637 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.206548    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 15:20:16.206637 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.206571    2574 kubelet.go:398] "Adding apiserver pod source"
Sep 09 15:20:16.206637 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.206584    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 15:20:16.207026 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.207012    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 15:20:16.207026 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.207035    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 15:20:16.209059 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.209037    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nmprc"
Sep 09 15:20:16.211064 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.211050    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 15:20:16.213989 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.213975    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 15:20:16.214047 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.214006    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 15:20:16.214178 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.214166    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 15:20:16.214224 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.214187    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 15:20:16.214224 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.214195    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 15:20:16.214224 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.214201    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 15:20:16.214224 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.214209    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 15:20:16.214224 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.214214    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 15:20:16.214913 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.214902    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 15:20:16.214913 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.214913    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 15:20:16.214981 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.214920    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 15:20:16.214981 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.214927    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 15:20:16.214981 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.214936    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 15:20:16.214981 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.214943    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 15:20:16.214981 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.214967    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 15:20:16.214981 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.214973    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 15:20:16.215660 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.215633    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 15:20:16.215660 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.215633    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 15:20:16.216896 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.216833    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nmprc"
Sep 09 15:20:16.218999 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.218980    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 15:20:16.219763 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.219750    2574 server.go:1268] "Started kubelet"
Sep 09 15:20:16.219864 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.219811    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 15:20:16.219927 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.219836    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 15:20:16.219976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.219932    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 15:20:16.220496 ip-10-0-140-68 systemd[1]: Started Kubernetes Kubelet.
Sep 09 15:20:16.221718 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.221631    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 15:20:16.222039 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.222024    2574 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 15:20:16.225625 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.224432    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-68.ec2.internal.18d3b0346d988af5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-68.ec2.internal,UID:ip-10-0-140-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-68.ec2.internal,},FirstTimestamp:2026-09-09 15:20:16.219720437 +0000 UTC m=+0.409923176,LastTimestamp:2026-09-09 15:20:16.219720437 +0000 UTC m=+0.409923176,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-68.ec2.internal,}"
Sep 09 15:20:16.225789 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.225768    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 15:20:16.226653 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.226638    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 15:20:16.226717 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.226653    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 15:20:16.226764 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.226743    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-68.ec2.internal\" not found"
Sep 09 15:20:16.227410 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.227391    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 15:20:16.227410 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.227400    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 15:20:16.227722 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.227419    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 15:20:16.227722 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.227529    2574 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 15:20:16.227722 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.227537    2574 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 15:20:16.227722 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.227666    2574 factory.go:55] Registering systemd factory
Sep 09 15:20:16.227722 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.227680    2574 factory.go:223] Registration of the systemd container factory successfully
Sep 09 15:20:16.228008 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.227992    2574 factory.go:153] Registering CRI-O factory
Sep 09 15:20:16.228008 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.228008    2574 factory.go:223] Registration of the crio container factory successfully
Sep 09 15:20:16.228119 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.228056    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 15:20:16.228119 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.228075    2574 factory.go:103] Registering Raw factory
Sep 09 15:20:16.228119 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.228088    2574 manager.go:1196] Started watching for new ooms in manager
Sep 09 15:20:16.228438 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.228426    2574 manager.go:349] Starting recovery of all containers
Sep 09 15:20:16.237510 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.237486    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 15:20:16.237594 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.237545    2574 manager.go:354] Recovery completed
Sep 09 15:20:16.241257 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.239736    2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-68.ec2.internal\" not found" node="ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.244148 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.244136    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 15:20:16.246355 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.246339    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 15:20:16.246424 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.246368    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 15:20:16.246424 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.246378    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasSufficientPID"
Sep 09 15:20:16.246932 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.246918    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 15:20:16.246991 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.246933    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 15:20:16.246991 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.246952    2574 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 15:20:16.247053 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.246925    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 15:20:16.247700 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.247685    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 15:20:16.247751 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.247711    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 15:20:16.247751 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.247722    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasSufficientPID"
Sep 09 15:20:16.249118 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.249107    2574 policy_none.go:49] "None policy: Start"
Sep 09 15:20:16.249156 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.249122    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 15:20:16.249156 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.249132    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 15:20:16.251118 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.251108    2574 policy_none.go:47] "Start"
Sep 09 15:20:16.295442 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.295426    2574 manager.go:337] "Starting Device Plugin manager"
Sep 09 15:20:16.318398 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.295463    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 15:20:16.318398 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.295476    2574 server.go:87] "Starting device plugin registration server"
Sep 09 15:20:16.318398 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.295730    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 15:20:16.318398 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.295745    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 15:20:16.318398 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.295867    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 15:20:16.318398 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.295962    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 15:20:16.318398 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.295971    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 15:20:16.318398 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.296446    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 15:20:16.318398 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.296496    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-68.ec2.internal\" not found"
Sep 09 15:20:16.318398 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.312016    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 15:20:16.318398 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.313383    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 15:20:16.318398 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.313424    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 15:20:16.318398 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.313444    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 15:20:16.318398 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.313489    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 15:20:16.318398 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.315370    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 15:20:16.395989 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.395854    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 15:20:16.397703 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.397682    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 15:20:16.397836 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.397724    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 15:20:16.397836 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.397738    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasSufficientPID"
Sep 09 15:20:16.397836 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.397768    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.405282 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.405266    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.405363 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.405290    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-68.ec2.internal\": node \"ip-10-0-140-68.ec2.internal\" not found"
Sep 09 15:20:16.413816 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.413790    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-68.ec2.internal"]
Sep 09 15:20:16.413942 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.413880    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 15:20:16.415525 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.415507    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 15:20:16.415616 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.415537    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 15:20:16.415616 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.415555    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasSufficientPID"
Sep 09 15:20:16.417965 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.417954    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 15:20:16.418083 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.418069    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.418124 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.418100    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 15:20:16.418642 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.418628    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 15:20:16.418745 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.418651    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 15:20:16.418745 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.418676    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 15:20:16.418745 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.418690    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasSufficientPID"
Sep 09 15:20:16.418745 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.418655    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 15:20:16.418745 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.418741    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasSufficientPID"
Sep 09 15:20:16.421201 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.421185    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.421247 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.421233    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 15:20:16.421591 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.421573    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-68.ec2.internal\" not found"
Sep 09 15:20:16.421944 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.421921    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 15:20:16.421944 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.421940    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 15:20:16.422039 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.421954    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeHasSufficientPID"
Sep 09 15:20:16.452575 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.452548    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-68.ec2.internal\" not found" node="ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.456953 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.456938    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-68.ec2.internal\" not found" node="ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.521978 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.521943    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-68.ec2.internal\" not found"
Sep 09 15:20:16.528297 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.528279    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5bf1afb938f794d571614842ff701595-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal\" (UID: \"5bf1afb938f794d571614842ff701595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.528421 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.528358    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bf1afb938f794d571614842ff701595-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal\" (UID: \"5bf1afb938f794d571614842ff701595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.528421 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.528382    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63872a04a76bb538711c93178fe3d471-config\") pod \"kube-apiserver-proxy-ip-10-0-140-68.ec2.internal\" (UID: \"63872a04a76bb538711c93178fe3d471\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.622593 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.622537    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-68.ec2.internal\" not found"
Sep 09 15:20:16.628825 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.628799    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5bf1afb938f794d571614842ff701595-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal\" (UID: \"5bf1afb938f794d571614842ff701595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.628958 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.628860    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bf1afb938f794d571614842ff701595-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal\" (UID: \"5bf1afb938f794d571614842ff701595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.628958 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.628892    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63872a04a76bb538711c93178fe3d471-config\") pod \"kube-apiserver-proxy-ip-10-0-140-68.ec2.internal\" (UID: \"63872a04a76bb538711c93178fe3d471\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.628958 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.628899    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5bf1afb938f794d571614842ff701595-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal\" (UID: \"5bf1afb938f794d571614842ff701595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.628958 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.628935    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63872a04a76bb538711c93178fe3d471-config\") pod \"kube-apiserver-proxy-ip-10-0-140-68.ec2.internal\" (UID: \"63872a04a76bb538711c93178fe3d471\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.629104 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.628974    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bf1afb938f794d571614842ff701595-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal\" (UID: \"5bf1afb938f794d571614842ff701595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.723298 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.723267    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-68.ec2.internal\" not found"
Sep 09 15:20:16.756734 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.756707    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.761123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:16.761103    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-68.ec2.internal"
Sep 09 15:20:16.823675 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.823486    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-68.ec2.internal\" not found"
Sep 09 15:20:16.924002 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:16.923971    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-68.ec2.internal\" not found"
Sep 09 15:20:17.024583 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.024514    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-68.ec2.internal\" not found"
Sep 09 15:20:17.037831 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.037808    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 15:20:17.126980 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.126953    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal"
Sep 09 15:20:17.137476 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.137462    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 15:20:17.139498 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.139485    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-68.ec2.internal"
Sep 09 15:20:17.146888 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.146873    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 15:20:17.156998 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.156976    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 15:20:17.157137 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.157118    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 15:20:17.157199 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.157150    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 15:20:17.157199 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.157150    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 15:20:17.207325 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.207294    2574 apiserver.go:52] "Watching apiserver"
Sep 09 15:20:17.224101 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.224056    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 15:15:17 +0000 UTC" deadline="2028-06-20 20:25:25.623792724 +0000 UTC"
Sep 09 15:20:17.224101 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.224098    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15605h5m8.399698773s"
Sep 09 15:20:17.226204 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.226184    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 15:20:17.226744 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.226728    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 15:20:17.227377 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.227355    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-qzwm8","openshift-multus/multus-vbx2d","openshift-network-diagnostics/network-check-target-wc7w6","openshift-network-operator/iptables-alerter-b6nk6","kube-system/global-pull-secret-syncer-nbw2j","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal","openshift-multus/multus-additional-cni-plugins-vbvc2","openshift-multus/network-metrics-daemon-zwx9l","openshift-ovn-kubernetes/ovnkube-node-9kzdx","kube-system/konnectivity-agent-t4dt5","kube-system/kube-apiserver-proxy-ip-10-0-140-68.ec2.internal","openshift-cluster-node-tuning-operator/tuned-bqr46","openshift-dns/node-resolver-hvcjr"]
Sep 09 15:20:17.230412 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.230390    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231050 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231029    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec98a80c-6690-4981-b7c9-292ea9d9a639-ovnkube-script-lib\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231135 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231061    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-var-lib-openvswitch\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231135 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231080    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-log-socket\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231135 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x26pb\" (UniqueName: \"kubernetes.io/projected/ec98a80c-6690-4981-b7c9-292ea9d9a639-kube-api-access-x26pb\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231283 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231161    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-run-netns\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231283 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231197    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-etc-openvswitch\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231283 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231213    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-node-log\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231283 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231227    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-cni-netd\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231283 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231240    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-kubelet\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231283 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231272    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-systemd-units\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231295    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231310    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec98a80c-6690-4981-b7c9-292ea9d9a639-ovnkube-config\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231323    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec98a80c-6690-4981-b7c9-292ea9d9a639-env-overrides\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231351    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec98a80c-6690-4981-b7c9-292ea9d9a639-ovn-node-metrics-cert\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231369    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-slash\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231382    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-run-systemd\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231395    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-run-openvswitch\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231417    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-run-ovn\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231514    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-run-ovn-kubernetes\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.231552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.231550    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-cni-bin\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.232726 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.232707    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.233064 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.233045    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tvrrz\""
Sep 09 15:20:17.233144 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.233078    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 15:20:17.233282 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.233266    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 15:20:17.233346 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.233331    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 15:20:17.233346 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.233341    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 15:20:17.233425 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.233330    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 15:20:17.234278 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.234264    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 15:20:17.235088 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.235074    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:17.235159 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.235141    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:17.235430 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.235412    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 15:20:17.235430 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.235427    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 15:20:17.235562 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.235542    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ltvqf\""
Sep 09 15:20:17.236378 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.236363    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 15:20:17.237395 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.237382    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b6nk6"
Sep 09 15:20:17.239613 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.239593    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 15:20:17.239613 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.239609    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:17.239748 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.239595    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 15:20:17.239748 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.239633    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 15:20:17.239748 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.239637    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t2bzg\""
Sep 09 15:20:17.239748 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.239676    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:17.241968 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.241951    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.244090 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.244072    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 15:20:17.244090 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.244080    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 15:20:17.244225 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.244142    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 15:20:17.244277 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.244265    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sh9tj\""
Sep 09 15:20:17.244390 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.244377    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:17.244454 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.244437    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:17.246714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.246697    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hvcjr"
Sep 09 15:20:17.248912 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.248895    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 15:20:17.248999 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.248931    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nvh5t\""
Sep 09 15:20:17.248999 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.248949    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 15:20:17.249135 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.249122    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.251448 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.251428    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 15:20:17.251545 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.251459    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qzwm8"
Sep 09 15:20:17.251545 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.251506    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 15:20:17.251655 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.251550    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 15:20:17.251655 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.251565    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 15:20:17.251731 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.251709    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-czbt4\""
Sep 09 15:20:17.253810 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.253794    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t4dt5"
Sep 09 15:20:17.254806 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.254789    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 15:20:17.254897 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.254824    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 15:20:17.254897 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.254827    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hzmfh\""
Sep 09 15:20:17.255014 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.254858    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 15:20:17.256136 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.256120    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.256224 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.256145    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8n4kk\""
Sep 09 15:20:17.256281 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.256268    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 15:20:17.256668 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.256651    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 15:20:17.257568 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.257554    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-spwnk"
Sep 09 15:20:17.258429 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.258417    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 15:20:17.258784 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.258769    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 15:20:17.260146 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.259114    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6lh59\""
Sep 09 15:20:17.264544 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.264528    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-spwnk"
Sep 09 15:20:17.328708 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.328678    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 15:20:17.332517 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332477    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptbbt\" (UniqueName: \"kubernetes.io/projected/8ded534f-da3e-47a3-b873-45b434a8d27f-kube-api-access-ptbbt\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.332638 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332527    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-run-systemd\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.332638 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332567    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec98a80c-6690-4981-b7c9-292ea9d9a639-ovnkube-script-lib\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.332638 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332615    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-etc-selinux\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.332807 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332639    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjdqs\" (UniqueName: \"kubernetes.io/projected/f944d3c3-de09-4122-9d8e-06c805dc429d-kube-api-access-pjdqs\") pod \"node-resolver-hvcjr\" (UID: \"f944d3c3-de09-4122-9d8e-06c805dc429d\") " pod="openshift-dns/node-resolver-hvcjr"
Sep 09 15:20:17.332807 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332648    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-run-systemd\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.332807 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332662    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6acefbe5-6ce3-4172-b5ba-d0e9c0937c54-konnectivity-ca\") pod \"konnectivity-agent-t4dt5\" (UID: \"6acefbe5-6ce3-4172-b5ba-d0e9c0937c54\") " pod="kube-system/konnectivity-agent-t4dt5"
Sep 09 15:20:17.332807 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332686    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-modprobe-d\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.332807 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332710    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-lib-modules\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.332807 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332731    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-hostroot\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.332807 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332757    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-var-lib-openvswitch\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.332807 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332781    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-var-lib-kubelet\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.332807 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332801    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-var-lib-kubelet\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332817    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-kubelet\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332824    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-var-lib-openvswitch\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332833    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332903    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332931    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-kubelet\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332942    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6acefbe5-6ce3-4172-b5ba-d0e9c0937c54-agent-certs\") pod \"konnectivity-agent-t4dt5\" (UID: \"6acefbe5-6ce3-4172-b5ba-d0e9c0937c54\") " pod="kube-system/konnectivity-agent-t4dt5"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332918    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332968    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-sysconfig\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.332991    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-system-cni-dir\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333011    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ded534f-da3e-47a3-b873-45b434a8d27f-cni-binary-copy\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333053    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfc18078-e42b-4475-ae5a-719783979eed-system-cni-dir\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333096    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-slash\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333124    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-etc-kubernetes\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333148    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfc18078-e42b-4475-ae5a-719783979eed-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333173    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-slash\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333173    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74xjs\" (UniqueName: \"kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs\") pod \"network-check-target-wc7w6\" (UID: \"d92db78d-9aa7-41a9-b1da-49176cb811c7\") " pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:17.333265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333217    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-log-socket\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333241    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-registration-dir\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333248    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-log-socket\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333265    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-sysctl-d\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333283    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4jxz\" (UniqueName: \"kubernetes.io/projected/bb11cdb7-08b9-46e4-9d53-eb8092841c48-kube-api-access-j4jxz\") pod \"network-metrics-daemon-zwx9l\" (UID: \"bb11cdb7-08b9-46e4-9d53-eb8092841c48\") " pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333300    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-cnibin\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333326    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfc18078-e42b-4475-ae5a-719783979eed-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333367    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg6dc\" (UniqueName: \"kubernetes.io/projected/dfc18078-e42b-4475-ae5a-719783979eed-kube-api-access-jg6dc\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333406    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec98a80c-6690-4981-b7c9-292ea9d9a639-ovnkube-config\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333428    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec98a80c-6690-4981-b7c9-292ea9d9a639-ovn-node-metrics-cert\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333444    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75b69fbd-fc53-47f8-a9d6-d7627959fe2d-host\") pod \"node-ca-qzwm8\" (UID: \"75b69fbd-fc53-47f8-a9d6-d7627959fe2d\") " pod="openshift-image-registry/node-ca-qzwm8"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333458    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8ded534f-da3e-47a3-b873-45b434a8d27f-multus-daemon-config\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333474    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-run-openvswitch\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333522    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-run-openvswitch\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333554    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-run-ovn\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333582    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-run-ovn-kubernetes\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333611    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzdx8\" (UniqueName: \"kubernetes.io/projected/75b69fbd-fc53-47f8-a9d6-d7627959fe2d-kube-api-access-rzdx8\") pod \"node-ca-qzwm8\" (UID: \"75b69fbd-fc53-47f8-a9d6-d7627959fe2d\") " pod="openshift-image-registry/node-ca-qzwm8"
Sep 09 15:20:17.334081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333633    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-sysctl-conf\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333656    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret\") pod \"global-pull-secret-syncer-nbw2j\" (UID: \"0bf8b935-52c1-4166-996a-1e656c394bd9\") " pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333681    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-multus-cni-dir\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333691    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-run-ovn-kubernetes\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333705    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-run-netns\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333742    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-run-ovn\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333766    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-var-lib-cni-multus\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333794    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-etc-openvswitch\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333837    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-etc-openvswitch\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333912    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec98a80c-6690-4981-b7c9-292ea9d9a639-ovnkube-script-lib\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333908    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-node-log\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333959    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-cni-netd\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333978    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-node-log\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333975    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.333995    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-kubernetes\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334020    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-var-lib-cni-bin\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334026    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-cni-netd\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334037    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec98a80c-6690-4981-b7c9-292ea9d9a639-ovnkube-config\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.334960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334043    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-multus-conf-dir\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334085    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7d5053f1-a046-435a-8cd3-2919151e99c1-iptables-alerter-script\") pod \"iptables-alerter-b6nk6\" (UID: \"7d5053f1-a046-435a-8cd3-2919151e99c1\") " pod="openshift-network-operator/iptables-alerter-b6nk6"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334117    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d5053f1-a046-435a-8cd3-2919151e99c1-host-slash\") pod \"iptables-alerter-b6nk6\" (UID: \"7d5053f1-a046-435a-8cd3-2919151e99c1\") " pod="openshift-network-operator/iptables-alerter-b6nk6"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334137    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0bf8b935-52c1-4166-996a-1e656c394bd9-kubelet-config\") pod \"global-pull-secret-syncer-nbw2j\" (UID: \"0bf8b935-52c1-4166-996a-1e656c394bd9\") " pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334153    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-systemd-units\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334167    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kldq7\" (UniqueName: \"kubernetes.io/projected/02affaec-4686-4840-bb51-1b27e7a2e52a-kube-api-access-kldq7\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334189    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-tuned\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334212    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs\") pod \"network-metrics-daemon-zwx9l\" (UID: \"bb11cdb7-08b9-46e4-9d53-eb8092841c48\") " pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334214    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-systemd-units\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334234    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-multus-socket-dir-parent\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334267    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-cni-bin\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334295    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75b69fbd-fc53-47f8-a9d6-d7627959fe2d-serviceca\") pod \"node-ca-qzwm8\" (UID: \"75b69fbd-fc53-47f8-a9d6-d7627959fe2d\") " pod="openshift-image-registry/node-ca-qzwm8"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334316    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-sys\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334324    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-cni-bin\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334341    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-run-multus-certs\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334373    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfc18078-e42b-4475-ae5a-719783979eed-cnibin\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334397    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfc18078-e42b-4475-ae5a-719783979eed-cni-binary-copy\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.335630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334422    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x26pb\" (UniqueName: \"kubernetes.io/projected/ec98a80c-6690-4981-b7c9-292ea9d9a639-kube-api-access-x26pb\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334454    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-device-dir\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334479    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-host\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334504    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-run-netns\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334530    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-sys-fs\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334567    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec98a80c-6690-4981-b7c9-292ea9d9a639-host-run-netns\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334569    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-systemd\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334609    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-run\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334632    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g554w\" (UniqueName: \"kubernetes.io/projected/7d5053f1-a046-435a-8cd3-2919151e99c1-kube-api-access-g554w\") pod \"iptables-alerter-b6nk6\" (UID: \"7d5053f1-a046-435a-8cd3-2919151e99c1\") " pod="openshift-network-operator/iptables-alerter-b6nk6"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334667    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-run-k8s-cni-cncf-io\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334700    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfc18078-e42b-4475-ae5a-719783979eed-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334736    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec98a80c-6690-4981-b7c9-292ea9d9a639-env-overrides\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334756    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-socket-dir\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334776    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f944d3c3-de09-4122-9d8e-06c805dc429d-hosts-file\") pod \"node-resolver-hvcjr\" (UID: \"f944d3c3-de09-4122-9d8e-06c805dc429d\") " pod="openshift-dns/node-resolver-hvcjr"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334795    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f944d3c3-de09-4122-9d8e-06c805dc429d-tmp-dir\") pod \"node-resolver-hvcjr\" (UID: \"f944d3c3-de09-4122-9d8e-06c805dc429d\") " pod="openshift-dns/node-resolver-hvcjr"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334812    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f0a93d4-2dc8-49a8-9831-f21410c52c38-tmp\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334831    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdbcr\" (UniqueName: \"kubernetes.io/projected/8f0a93d4-2dc8-49a8-9831-f21410c52c38-kube-api-access-pdbcr\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.336123 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.334882    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0bf8b935-52c1-4166-996a-1e656c394bd9-dbus\") pod \"global-pull-secret-syncer-nbw2j\" (UID: \"0bf8b935-52c1-4166-996a-1e656c394bd9\") " pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:17.336611 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.335123    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec98a80c-6690-4981-b7c9-292ea9d9a639-env-overrides\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.337541 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.337523    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec98a80c-6690-4981-b7c9-292ea9d9a639-ovn-node-metrics-cert\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.342430 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.342411    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x26pb\" (UniqueName: \"kubernetes.io/projected/ec98a80c-6690-4981-b7c9-292ea9d9a639-kube-api-access-x26pb\") pod \"ovnkube-node-9kzdx\" (UID: \"ec98a80c-6690-4981-b7c9-292ea9d9a639\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.435127 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.435096    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-var-lib-kubelet\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.435127 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.435129    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.435439 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.435148    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6acefbe5-6ce3-4172-b5ba-d0e9c0937c54-agent-certs\") pod \"konnectivity-agent-t4dt5\" (UID: \"6acefbe5-6ce3-4172-b5ba-d0e9c0937c54\") " pod="kube-system/konnectivity-agent-t4dt5"
Sep 09 15:20:17.435439 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.435163    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-sysconfig\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.435439 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.435187    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-system-cni-dir\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.435439 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.435209    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ded534f-da3e-47a3-b873-45b434a8d27f-cni-binary-copy\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.435439 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.435231    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfc18078-e42b-4475-ae5a-719783979eed-system-cni-dir\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.435439 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.435240    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-var-lib-kubelet\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.435439 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.435253    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-etc-kubernetes\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.435439 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.435253    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-sysconfig\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.435439 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.435275    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.435439 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.435289    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-system-cni-dir\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.435439 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.435297    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-etc-kubernetes\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.435955 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.435295    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfc18078-e42b-4475-ae5a-719783979eed-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.435955 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.435684    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfc18078-e42b-4475-ae5a-719783979eed-system-cni-dir\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.435955 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.435787    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74xjs\" (UniqueName: \"kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs\") pod \"network-check-target-wc7w6\" (UID: \"d92db78d-9aa7-41a9-b1da-49176cb811c7\") " pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:17.436308 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.436280    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ded534f-da3e-47a3-b873-45b434a8d27f-cni-binary-copy\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.436371 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.436338    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfc18078-e42b-4475-ae5a-719783979eed-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.436518 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.436499    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-registration-dir\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.436650 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.436632    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-registration-dir\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.436717 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.436676    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-sysctl-d\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.436773 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.436734    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4jxz\" (UniqueName: \"kubernetes.io/projected/bb11cdb7-08b9-46e4-9d53-eb8092841c48-kube-api-access-j4jxz\") pod \"network-metrics-daemon-zwx9l\" (UID: \"bb11cdb7-08b9-46e4-9d53-eb8092841c48\") " pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:17.436829 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.436779    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-cnibin\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.436829 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.436797    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-sysctl-d\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.436829 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.436814    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfc18078-e42b-4475-ae5a-719783979eed-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.437004 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.436870    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg6dc\" (UniqueName: \"kubernetes.io/projected/dfc18078-e42b-4475-ae5a-719783979eed-kube-api-access-jg6dc\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.437004 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.436907    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75b69fbd-fc53-47f8-a9d6-d7627959fe2d-host\") pod \"node-ca-qzwm8\" (UID: \"75b69fbd-fc53-47f8-a9d6-d7627959fe2d\") " pod="openshift-image-registry/node-ca-qzwm8"
Sep 09 15:20:17.437004 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.436934    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8ded534f-da3e-47a3-b873-45b434a8d27f-multus-daemon-config\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.437004 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.436971    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzdx8\" (UniqueName: \"kubernetes.io/projected/75b69fbd-fc53-47f8-a9d6-d7627959fe2d-kube-api-access-rzdx8\") pod \"node-ca-qzwm8\" (UID: \"75b69fbd-fc53-47f8-a9d6-d7627959fe2d\") " pod="openshift-image-registry/node-ca-qzwm8"
Sep 09 15:20:17.437193 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437003    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-sysctl-conf\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.437193 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437035    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret\") pod \"global-pull-secret-syncer-nbw2j\" (UID: \"0bf8b935-52c1-4166-996a-1e656c394bd9\") " pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:17.437193 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437062    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-multus-cni-dir\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.437193 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437101    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-run-netns\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.437193 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437144    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-var-lib-cni-multus\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.437193 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437182    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-kubernetes\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.437519 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437213    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-var-lib-cni-bin\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.437519 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437240    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-multus-conf-dir\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.437519 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437277    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7d5053f1-a046-435a-8cd3-2919151e99c1-iptables-alerter-script\") pod \"iptables-alerter-b6nk6\" (UID: \"7d5053f1-a046-435a-8cd3-2919151e99c1\") " pod="openshift-network-operator/iptables-alerter-b6nk6"
Sep 09 15:20:17.437519 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437344    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d5053f1-a046-435a-8cd3-2919151e99c1-host-slash\") pod \"iptables-alerter-b6nk6\" (UID: \"7d5053f1-a046-435a-8cd3-2919151e99c1\") " pod="openshift-network-operator/iptables-alerter-b6nk6"
Sep 09 15:20:17.437519 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437381    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0bf8b935-52c1-4166-996a-1e656c394bd9-kubelet-config\") pod \"global-pull-secret-syncer-nbw2j\" (UID: \"0bf8b935-52c1-4166-996a-1e656c394bd9\") " pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:17.437519 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437416    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kldq7\" (UniqueName: \"kubernetes.io/projected/02affaec-4686-4840-bb51-1b27e7a2e52a-kube-api-access-kldq7\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.437519 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-tuned\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.437519 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437473    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs\") pod \"network-metrics-daemon-zwx9l\" (UID: \"bb11cdb7-08b9-46e4-9d53-eb8092841c48\") " pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:17.437519 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437503    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-multus-socket-dir-parent\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.437976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437536    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75b69fbd-fc53-47f8-a9d6-d7627959fe2d-serviceca\") pod \"node-ca-qzwm8\" (UID: \"75b69fbd-fc53-47f8-a9d6-d7627959fe2d\") " pod="openshift-image-registry/node-ca-qzwm8"
Sep 09 15:20:17.437976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-sys\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.437976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437596    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-run-multus-certs\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.437976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437628    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfc18078-e42b-4475-ae5a-719783979eed-cnibin\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.437976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437663    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfc18078-e42b-4475-ae5a-719783979eed-cni-binary-copy\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.437976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437697    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-device-dir\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.437976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437733    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-host\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.437976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437762    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-sys-fs\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.437976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437793    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-systemd\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.437976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437823    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-run\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.437976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437878    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g554w\" (UniqueName: \"kubernetes.io/projected/7d5053f1-a046-435a-8cd3-2919151e99c1-kube-api-access-g554w\") pod \"iptables-alerter-b6nk6\" (UID: \"7d5053f1-a046-435a-8cd3-2919151e99c1\") " pod="openshift-network-operator/iptables-alerter-b6nk6"
Sep 09 15:20:17.437976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437910    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-run-k8s-cni-cncf-io\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.437976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437943    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfc18078-e42b-4475-ae5a-719783979eed-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.437976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.437978    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-socket-dir\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438005    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f944d3c3-de09-4122-9d8e-06c805dc429d-hosts-file\") pod \"node-resolver-hvcjr\" (UID: \"f944d3c3-de09-4122-9d8e-06c805dc429d\") " pod="openshift-dns/node-resolver-hvcjr"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438038    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f944d3c3-de09-4122-9d8e-06c805dc429d-tmp-dir\") pod \"node-resolver-hvcjr\" (UID: \"f944d3c3-de09-4122-9d8e-06c805dc429d\") " pod="openshift-dns/node-resolver-hvcjr"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438069    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f0a93d4-2dc8-49a8-9831-f21410c52c38-tmp\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438101    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbcr\" (UniqueName: \"kubernetes.io/projected/8f0a93d4-2dc8-49a8-9831-f21410c52c38-kube-api-access-pdbcr\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438127    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0bf8b935-52c1-4166-996a-1e656c394bd9-dbus\") pod \"global-pull-secret-syncer-nbw2j\" (UID: \"0bf8b935-52c1-4166-996a-1e656c394bd9\") " pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438159    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptbbt\" (UniqueName: \"kubernetes.io/projected/8ded534f-da3e-47a3-b873-45b434a8d27f-kube-api-access-ptbbt\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438194    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-etc-selinux\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438225    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjdqs\" (UniqueName: \"kubernetes.io/projected/f944d3c3-de09-4122-9d8e-06c805dc429d-kube-api-access-pjdqs\") pod \"node-resolver-hvcjr\" (UID: \"f944d3c3-de09-4122-9d8e-06c805dc429d\") " pod="openshift-dns/node-resolver-hvcjr"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438234    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8ded534f-da3e-47a3-b873-45b434a8d27f-multus-daemon-config\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438260    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6acefbe5-6ce3-4172-b5ba-d0e9c0937c54-konnectivity-ca\") pod \"konnectivity-agent-t4dt5\" (UID: \"6acefbe5-6ce3-4172-b5ba-d0e9c0937c54\") " pod="kube-system/konnectivity-agent-t4dt5"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438292    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-modprobe-d\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438320    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-cnibin\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438324    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-lib-modules\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438442    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-lib-modules\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438483    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-hostroot\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438521    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-var-lib-kubelet\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.438635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438640    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-var-lib-kubelet\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.439417 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438780    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfc18078-e42b-4475-ae5a-719783979eed-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.439417 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438793    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-device-dir\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.439417 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438798    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-sysctl-conf\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.439417 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438807    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75b69fbd-fc53-47f8-a9d6-d7627959fe2d-host\") pod \"node-ca-qzwm8\" (UID: \"75b69fbd-fc53-47f8-a9d6-d7627959fe2d\") " pod="openshift-image-registry/node-ca-qzwm8"
Sep 09 15:20:17.439417 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438888    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-host\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.439417 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438894    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-run-netns\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.439417 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438954    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-sys-fs\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.439417 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.438964    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-var-lib-cni-multus\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.439417 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.439024    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 15:20:17.439417 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.439032    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-kubernetes\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.439417 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.439093    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-var-lib-cni-bin\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.439417 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.439128    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret podName:0bf8b935-52c1-4166-996a-1e656c394bd9 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:17.939079962 +0000 UTC m=+2.129282709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret") pod "global-pull-secret-syncer-nbw2j" (UID: "0bf8b935-52c1-4166-996a-1e656c394bd9") : object "kube-system"/"original-pull-secret" not registered
Sep 09 15:20:17.439417 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.439254    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:20:17.439417 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.439325    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs podName:bb11cdb7-08b9-46e4-9d53-eb8092841c48 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:17.939301926 +0000 UTC m=+2.129504655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs") pod "network-metrics-daemon-zwx9l" (UID: "bb11cdb7-08b9-46e4-9d53-eb8092841c48") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:20:17.439417 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.439368    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0bf8b935-52c1-4166-996a-1e656c394bd9-kubelet-config\") pod \"global-pull-secret-syncer-nbw2j\" (UID: \"0bf8b935-52c1-4166-996a-1e656c394bd9\") " pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:17.440192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.439613    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-run-multus-certs\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.440192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.439618    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0bf8b935-52c1-4166-996a-1e656c394bd9-dbus\") pod \"global-pull-secret-syncer-nbw2j\" (UID: \"0bf8b935-52c1-4166-996a-1e656c394bd9\") " pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:17.440192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.439686    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-sys\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.440192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.439742    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-systemd\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.440192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.439824    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfc18078-e42b-4475-ae5a-719783979eed-cnibin\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.440192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.439865    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-etc-selinux\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.440192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.439923    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-run\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.440192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.439964    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7d5053f1-a046-435a-8cd3-2919151e99c1-iptables-alerter-script\") pod \"iptables-alerter-b6nk6\" (UID: \"7d5053f1-a046-435a-8cd3-2919151e99c1\") " pod="openshift-network-operator/iptables-alerter-b6nk6"
Sep 09 15:20:17.440192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.439996    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75b69fbd-fc53-47f8-a9d6-d7627959fe2d-serviceca\") pod \"node-ca-qzwm8\" (UID: \"75b69fbd-fc53-47f8-a9d6-d7627959fe2d\") " pod="openshift-image-registry/node-ca-qzwm8"
Sep 09 15:20:17.440192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.440063    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-multus-cni-dir\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.440716 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.440314    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-modprobe-d\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.440716 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.440376    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-host-run-k8s-cni-cncf-io\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.440716 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.440425    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-hostroot\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.440716 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.440443    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfc18078-e42b-4475-ae5a-719783979eed-cni-binary-copy\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.440716 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.440580    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02affaec-4686-4840-bb51-1b27e7a2e52a-socket-dir\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.440716 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.440617    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfc18078-e42b-4475-ae5a-719783979eed-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.440716 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.440628    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f944d3c3-de09-4122-9d8e-06c805dc429d-hosts-file\") pod \"node-resolver-hvcjr\" (UID: \"f944d3c3-de09-4122-9d8e-06c805dc429d\") " pod="openshift-dns/node-resolver-hvcjr"
Sep 09 15:20:17.440716 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.440676    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d5053f1-a046-435a-8cd3-2919151e99c1-host-slash\") pod \"iptables-alerter-b6nk6\" (UID: \"7d5053f1-a046-435a-8cd3-2919151e99c1\") " pod="openshift-network-operator/iptables-alerter-b6nk6"
Sep 09 15:20:17.441119 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.440888    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6acefbe5-6ce3-4172-b5ba-d0e9c0937c54-konnectivity-ca\") pod \"konnectivity-agent-t4dt5\" (UID: \"6acefbe5-6ce3-4172-b5ba-d0e9c0937c54\") " pod="kube-system/konnectivity-agent-t4dt5"
Sep 09 15:20:17.441119 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.440962    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6acefbe5-6ce3-4172-b5ba-d0e9c0937c54-agent-certs\") pod \"konnectivity-agent-t4dt5\" (UID: \"6acefbe5-6ce3-4172-b5ba-d0e9c0937c54\") " pod="kube-system/konnectivity-agent-t4dt5"
Sep 09 15:20:17.441119 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.440981    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-multus-socket-dir-parent\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.441119 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.441014    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f944d3c3-de09-4122-9d8e-06c805dc429d-tmp-dir\") pod \"node-resolver-hvcjr\" (UID: \"f944d3c3-de09-4122-9d8e-06c805dc429d\") " pod="openshift-dns/node-resolver-hvcjr"
Sep 09 15:20:17.441307 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.441165    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ded534f-da3e-47a3-b873-45b434a8d27f-multus-conf-dir\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.442192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.442166    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f0a93d4-2dc8-49a8-9831-f21410c52c38-tmp\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.442306 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.442268    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f0a93d4-2dc8-49a8-9831-f21410c52c38-etc-tuned\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.442362 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.442328    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 15:20:17.442362 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.442345    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 15:20:17.442362 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.442355    2574 projected.go:196] Error preparing data for projected volume kube-api-access-74xjs for pod openshift-network-diagnostics/network-check-target-wc7w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:20:17.442577 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.442398    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs podName:d92db78d-9aa7-41a9-b1da-49176cb811c7 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:17.942386243 +0000 UTC m=+2.132588969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-74xjs" (UniqueName: "kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs") pod "network-check-target-wc7w6" (UID: "d92db78d-9aa7-41a9-b1da-49176cb811c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:20:17.444465 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.444440    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4jxz\" (UniqueName: \"kubernetes.io/projected/bb11cdb7-08b9-46e4-9d53-eb8092841c48-kube-api-access-j4jxz\") pod \"network-metrics-daemon-zwx9l\" (UID: \"bb11cdb7-08b9-46e4-9d53-eb8092841c48\") " pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:17.446125 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.446105    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg6dc\" (UniqueName: \"kubernetes.io/projected/dfc18078-e42b-4475-ae5a-719783979eed-kube-api-access-jg6dc\") pod \"multus-additional-cni-plugins-vbvc2\" (UID: \"dfc18078-e42b-4475-ae5a-719783979eed\") " pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.449680 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.449655    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdbcr\" (UniqueName: \"kubernetes.io/projected/8f0a93d4-2dc8-49a8-9831-f21410c52c38-kube-api-access-pdbcr\") pod \"tuned-bqr46\" (UID: \"8f0a93d4-2dc8-49a8-9831-f21410c52c38\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.449763 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.449658    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzdx8\" (UniqueName: \"kubernetes.io/projected/75b69fbd-fc53-47f8-a9d6-d7627959fe2d-kube-api-access-rzdx8\") pod \"node-ca-qzwm8\" (UID: \"75b69fbd-fc53-47f8-a9d6-d7627959fe2d\") " pod="openshift-image-registry/node-ca-qzwm8"
Sep 09 15:20:17.450525 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.450507    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptbbt\" (UniqueName: \"kubernetes.io/projected/8ded534f-da3e-47a3-b873-45b434a8d27f-kube-api-access-ptbbt\") pod \"multus-vbx2d\" (UID: \"8ded534f-da3e-47a3-b873-45b434a8d27f\") " pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.450621 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.450588    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kldq7\" (UniqueName: \"kubernetes.io/projected/02affaec-4686-4840-bb51-1b27e7a2e52a-kube-api-access-kldq7\") pod \"aws-ebs-csi-driver-node-d9ngl\" (UID: \"02affaec-4686-4840-bb51-1b27e7a2e52a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.450919 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.450903    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjdqs\" (UniqueName: \"kubernetes.io/projected/f944d3c3-de09-4122-9d8e-06c805dc429d-kube-api-access-pjdqs\") pod \"node-resolver-hvcjr\" (UID: \"f944d3c3-de09-4122-9d8e-06c805dc429d\") " pod="openshift-dns/node-resolver-hvcjr"
Sep 09 15:20:17.451560 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.451541    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g554w\" (UniqueName: \"kubernetes.io/projected/7d5053f1-a046-435a-8cd3-2919151e99c1-kube-api-access-g554w\") pod \"iptables-alerter-b6nk6\" (UID: \"7d5053f1-a046-435a-8cd3-2919151e99c1\") " pod="openshift-network-operator/iptables-alerter-b6nk6"
Sep 09 15:20:17.479999 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:17.479973    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63872a04a76bb538711c93178fe3d471.slice/crio-bfdacf7a6c122bae15afc8f9695779b2ed9db971e4c71c2627e32d65f08565f0 WatchSource:0}: Error finding container bfdacf7a6c122bae15afc8f9695779b2ed9db971e4c71c2627e32d65f08565f0: Status 404 returned error can't find the container with id bfdacf7a6c122bae15afc8f9695779b2ed9db971e4c71c2627e32d65f08565f0
Sep 09 15:20:17.485236 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.485219    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 15:20:17.551885 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.551783    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:17.561474 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:17.561449    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec98a80c_6690_4981_b7c9_292ea9d9a639.slice/crio-b5b99ca0b189761209695f855fbc5c98e75302bb1cd1adff9d190bc5c6a081f1 WatchSource:0}: Error finding container b5b99ca0b189761209695f855fbc5c98e75302bb1cd1adff9d190bc5c6a081f1: Status 404 returned error can't find the container with id b5b99ca0b189761209695f855fbc5c98e75302bb1cd1adff9d190bc5c6a081f1
Sep 09 15:20:17.580317 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.579793    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bqr46"
Sep 09 15:20:17.587827 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:17.587801    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f0a93d4_2dc8_49a8_9831_f21410c52c38.slice/crio-ba604d61bac9d9dc3edebedbfb2db746e4cf4c1b5c31c0306a42e4bbe3a66d91 WatchSource:0}: Error finding container ba604d61bac9d9dc3edebedbfb2db746e4cf4c1b5c31c0306a42e4bbe3a66d91: Status 404 returned error can't find the container with id ba604d61bac9d9dc3edebedbfb2db746e4cf4c1b5c31c0306a42e4bbe3a66d91
Sep 09 15:20:17.591444 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.591424    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b6nk6"
Sep 09 15:20:17.599104 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:17.599074    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5053f1_a046_435a_8cd3_2919151e99c1.slice/crio-d661d6fa85c73f8a34d99a5b56cd5e3162d223a917298816f26f5860ccf21b15 WatchSource:0}: Error finding container d661d6fa85c73f8a34d99a5b56cd5e3162d223a917298816f26f5860ccf21b15: Status 404 returned error can't find the container with id d661d6fa85c73f8a34d99a5b56cd5e3162d223a917298816f26f5860ccf21b15
Sep 09 15:20:17.607223 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.607204    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl"
Sep 09 15:20:17.615530 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:17.615506    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02affaec_4686_4840_bb51_1b27e7a2e52a.slice/crio-e7a46cebc3e28281998bc82e73ee4f5bd30090ae144a6ad8f81eff8f3a7e8dac WatchSource:0}: Error finding container e7a46cebc3e28281998bc82e73ee4f5bd30090ae144a6ad8f81eff8f3a7e8dac: Status 404 returned error can't find the container with id e7a46cebc3e28281998bc82e73ee4f5bd30090ae144a6ad8f81eff8f3a7e8dac
Sep 09 15:20:17.618701 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.618616    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hvcjr"
Sep 09 15:20:17.626835 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:17.626813    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf944d3c3_de09_4122_9d8e_06c805dc429d.slice/crio-cf988662973d114faa72c46313625d0c5fd6c2aff1cf3d9006afabc30f52568f WatchSource:0}: Error finding container cf988662973d114faa72c46313625d0c5fd6c2aff1cf3d9006afabc30f52568f: Status 404 returned error can't find the container with id cf988662973d114faa72c46313625d0c5fd6c2aff1cf3d9006afabc30f52568f
Sep 09 15:20:17.636241 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.636222    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vbx2d"
Sep 09 15:20:17.644703 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:17.644676    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ded534f_da3e_47a3_b873_45b434a8d27f.slice/crio-e52b9dfad37f6c8ae99850acc6b1d6475ea83d6049de9023e866d4e2d71f66ed WatchSource:0}: Error finding container e52b9dfad37f6c8ae99850acc6b1d6475ea83d6049de9023e866d4e2d71f66ed: Status 404 returned error can't find the container with id e52b9dfad37f6c8ae99850acc6b1d6475ea83d6049de9023e866d4e2d71f66ed
Sep 09 15:20:17.655029 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.654989    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qzwm8"
Sep 09 15:20:17.660262 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.660233    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t4dt5"
Sep 09 15:20:17.664255 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.664229    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vbvc2"
Sep 09 15:20:17.664757 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:17.664736    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75b69fbd_fc53_47f8_a9d6_d7627959fe2d.slice/crio-2ed1e68edaba739a508839b3fecbe2f9a774d6597458ab9cc3217ea086aaaa77 WatchSource:0}: Error finding container 2ed1e68edaba739a508839b3fecbe2f9a774d6597458ab9cc3217ea086aaaa77: Status 404 returned error can't find the container with id 2ed1e68edaba739a508839b3fecbe2f9a774d6597458ab9cc3217ea086aaaa77
Sep 09 15:20:17.668440 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.668418    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 15:20:17.670745 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:17.670722    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6acefbe5_6ce3_4172_b5ba_d0e9c0937c54.slice/crio-bc06274b65e285912c30103137ecc8a5f2ad9ef064eb8c30c49abbb3cd40f376 WatchSource:0}: Error finding container bc06274b65e285912c30103137ecc8a5f2ad9ef064eb8c30c49abbb3cd40f376: Status 404 returned error can't find the container with id bc06274b65e285912c30103137ecc8a5f2ad9ef064eb8c30c49abbb3cd40f376
Sep 09 15:20:17.675457 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:17.675431    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc18078_e42b_4475_ae5a_719783979eed.slice/crio-c59737d2f8511f3221e77369efefddaa75326c8e4533905056e5cf0a9616deac WatchSource:0}: Error finding container c59737d2f8511f3221e77369efefddaa75326c8e4533905056e5cf0a9616deac: Status 404 returned error can't find the container with id c59737d2f8511f3221e77369efefddaa75326c8e4533905056e5cf0a9616deac
Sep 09 15:20:17.923825 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:17.923792    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf1afb938f794d571614842ff701595.slice/crio-18a588982e733ecf4fe28722d9afdaa4a79a20b40ed1c2db893ff8960bcc14cb WatchSource:0}: Error finding container 18a588982e733ecf4fe28722d9afdaa4a79a20b40ed1c2db893ff8960bcc14cb: Status 404 returned error can't find the container with id 18a588982e733ecf4fe28722d9afdaa4a79a20b40ed1c2db893ff8960bcc14cb
Sep 09 15:20:17.942401 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.942368    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret\") pod \"global-pull-secret-syncer-nbw2j\" (UID: \"0bf8b935-52c1-4166-996a-1e656c394bd9\") " pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:17.942532 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.942428    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs\") pod \"network-metrics-daemon-zwx9l\" (UID: \"bb11cdb7-08b9-46e4-9d53-eb8092841c48\") " pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:17.942532 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:17.942493    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74xjs\" (UniqueName: \"kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs\") pod \"network-check-target-wc7w6\" (UID: \"d92db78d-9aa7-41a9-b1da-49176cb811c7\") " pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:17.942648 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.942552    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 15:20:17.942648 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.942572    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:20:17.942648 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.942622    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs podName:bb11cdb7-08b9-46e4-9d53-eb8092841c48 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:18.942602706 +0000 UTC m=+3.132805438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs") pod "network-metrics-daemon-zwx9l" (UID: "bb11cdb7-08b9-46e4-9d53-eb8092841c48") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:20:17.942648 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.942642    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret podName:0bf8b935-52c1-4166-996a-1e656c394bd9 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:18.942632963 +0000 UTC m=+3.132835706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret") pod "global-pull-secret-syncer-nbw2j" (UID: "0bf8b935-52c1-4166-996a-1e656c394bd9") : object "kube-system"/"original-pull-secret" not registered
Sep 09 15:20:17.942986 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.942672    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 15:20:17.942986 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.942695    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 15:20:17.942986 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.942707    2574 projected.go:196] Error preparing data for projected volume kube-api-access-74xjs for pod openshift-network-diagnostics/network-check-target-wc7w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:20:17.942986 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:17.942759    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs podName:d92db78d-9aa7-41a9-b1da-49176cb811c7 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:18.942744677 +0000 UTC m=+3.132947405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-74xjs" (UniqueName: "kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs") pod "network-check-target-wc7w6" (UID: "d92db78d-9aa7-41a9-b1da-49176cb811c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:20:18.164085 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.164048    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 15:20:18.267549 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.267500    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 15:15:18 +0000 UTC" deadline="2028-02-11 08:09:26.774603728 +0000 UTC"
Sep 09 15:20:18.267549 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.267546    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12472h49m8.507062352s"
Sep 09 15:20:18.320075 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.319994    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx" event={"ID":"ec98a80c-6690-4981-b7c9-292ea9d9a639","Type":"ContainerStarted","Data":"b5b99ca0b189761209695f855fbc5c98e75302bb1cd1adff9d190bc5c6a081f1"}
Sep 09 15:20:18.321439 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.321404    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-68.ec2.internal" event={"ID":"63872a04a76bb538711c93178fe3d471","Type":"ContainerStarted","Data":"bfdacf7a6c122bae15afc8f9695779b2ed9db971e4c71c2627e32d65f08565f0"}
Sep 09 15:20:18.322838 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.322804    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal" event={"ID":"5bf1afb938f794d571614842ff701595","Type":"ContainerStarted","Data":"18a588982e733ecf4fe28722d9afdaa4a79a20b40ed1c2db893ff8960bcc14cb"}
Sep 09 15:20:18.324583 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.324549    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbvc2" event={"ID":"dfc18078-e42b-4475-ae5a-719783979eed","Type":"ContainerStarted","Data":"c59737d2f8511f3221e77369efefddaa75326c8e4533905056e5cf0a9616deac"}
Sep 09 15:20:18.326286 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.326258    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vbx2d" event={"ID":"8ded534f-da3e-47a3-b873-45b434a8d27f","Type":"ContainerStarted","Data":"e52b9dfad37f6c8ae99850acc6b1d6475ea83d6049de9023e866d4e2d71f66ed"}
Sep 09 15:20:18.328332 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.328303    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t4dt5" event={"ID":"6acefbe5-6ce3-4172-b5ba-d0e9c0937c54","Type":"ContainerStarted","Data":"bc06274b65e285912c30103137ecc8a5f2ad9ef064eb8c30c49abbb3cd40f376"}
Sep 09 15:20:18.330075 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.330047    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qzwm8" event={"ID":"75b69fbd-fc53-47f8-a9d6-d7627959fe2d","Type":"ContainerStarted","Data":"2ed1e68edaba739a508839b3fecbe2f9a774d6597458ab9cc3217ea086aaaa77"}
Sep 09 15:20:18.331779 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.331718    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hvcjr" event={"ID":"f944d3c3-de09-4122-9d8e-06c805dc429d","Type":"ContainerStarted","Data":"cf988662973d114faa72c46313625d0c5fd6c2aff1cf3d9006afabc30f52568f"}
Sep 09 15:20:18.333674 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.333647    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl" event={"ID":"02affaec-4686-4840-bb51-1b27e7a2e52a","Type":"ContainerStarted","Data":"e7a46cebc3e28281998bc82e73ee4f5bd30090ae144a6ad8f81eff8f3a7e8dac"}
Sep 09 15:20:18.335783 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.335756    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b6nk6" event={"ID":"7d5053f1-a046-435a-8cd3-2919151e99c1","Type":"ContainerStarted","Data":"d661d6fa85c73f8a34d99a5b56cd5e3162d223a917298816f26f5860ccf21b15"}
Sep 09 15:20:18.337961 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.337930    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bqr46" event={"ID":"8f0a93d4-2dc8-49a8-9831-f21410c52c38","Type":"ContainerStarted","Data":"ba604d61bac9d9dc3edebedbfb2db746e4cf4c1b5c31c0306a42e4bbe3a66d91"}
Sep 09 15:20:18.450877 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.450845    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 15:20:18.951777 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.951736    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret\") pod \"global-pull-secret-syncer-nbw2j\" (UID: \"0bf8b935-52c1-4166-996a-1e656c394bd9\") " pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:18.951986 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.951799    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs\") pod \"network-metrics-daemon-zwx9l\" (UID: \"bb11cdb7-08b9-46e4-9d53-eb8092841c48\") " pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:18.951986 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:18.951856    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74xjs\" (UniqueName: \"kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs\") pod \"network-check-target-wc7w6\" (UID: \"d92db78d-9aa7-41a9-b1da-49176cb811c7\") " pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:18.952140 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:18.952013    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 15:20:18.952140 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:18.952032    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 15:20:18.952140 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:18.952048    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 15:20:18.952140 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:18.952061    2574 projected.go:196] Error preparing data for projected volume kube-api-access-74xjs for pod openshift-network-diagnostics/network-check-target-wc7w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:20:18.952140 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:18.952078    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:20:18.952140 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:18.952086    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret podName:0bf8b935-52c1-4166-996a-1e656c394bd9 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:20.952067285 +0000 UTC m=+5.142270037 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret") pod "global-pull-secret-syncer-nbw2j" (UID: "0bf8b935-52c1-4166-996a-1e656c394bd9") : object "kube-system"/"original-pull-secret" not registered
Sep 09 15:20:18.952459 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:18.952163    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs podName:d92db78d-9aa7-41a9-b1da-49176cb811c7 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:20.952142543 +0000 UTC m=+5.142345274 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-74xjs" (UniqueName: "kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs") pod "network-check-target-wc7w6" (UID: "d92db78d-9aa7-41a9-b1da-49176cb811c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:20:18.952459 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:18.952184    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs podName:bb11cdb7-08b9-46e4-9d53-eb8092841c48 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:20.952173001 +0000 UTC m=+5.142375730 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs") pod "network-metrics-daemon-zwx9l" (UID: "bb11cdb7-08b9-46e4-9d53-eb8092841c48") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:20:19.268887 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:19.268746    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 15:15:18 +0000 UTC" deadline="2028-03-21 08:35:48.610779218 +0000 UTC"
Sep 09 15:20:19.268887 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:19.268786    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13409h15m29.341997774s"
Sep 09 15:20:19.314486 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:19.314446    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:19.314675 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:19.314608    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:19.315101 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:19.315076    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:19.315220 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:19.315194    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:19.315283 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:19.315273    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:19.315383 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:19.315364    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:20.224938 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:20.220175    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 15:20:20.972817 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:20.972778    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74xjs\" (UniqueName: \"kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs\") pod \"network-check-target-wc7w6\" (UID: \"d92db78d-9aa7-41a9-b1da-49176cb811c7\") " pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:20.973483 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:20.972842    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret\") pod \"global-pull-secret-syncer-nbw2j\" (UID: \"0bf8b935-52c1-4166-996a-1e656c394bd9\") " pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:20.973483 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:20.972912    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs\") pod \"network-metrics-daemon-zwx9l\" (UID: \"bb11cdb7-08b9-46e4-9d53-eb8092841c48\") " pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:20.973483 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:20.973050    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:20:20.973483 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:20.973119    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs podName:bb11cdb7-08b9-46e4-9d53-eb8092841c48 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:24.973098641 +0000 UTC m=+9.163301392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs") pod "network-metrics-daemon-zwx9l" (UID: "bb11cdb7-08b9-46e4-9d53-eb8092841c48") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:20:20.973746 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:20.973593    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 15:20:20.973746 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:20.973617    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 15:20:20.973746 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:20.973631    2574 projected.go:196] Error preparing data for projected volume kube-api-access-74xjs for pod openshift-network-diagnostics/network-check-target-wc7w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:20:20.973746 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:20.973681    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs podName:d92db78d-9aa7-41a9-b1da-49176cb811c7 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:24.973664697 +0000 UTC m=+9.163867483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-74xjs" (UniqueName: "kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs") pod "network-check-target-wc7w6" (UID: "d92db78d-9aa7-41a9-b1da-49176cb811c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:20:20.973746 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:20.973746    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 15:20:20.974055 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:20.973781    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret podName:0bf8b935-52c1-4166-996a-1e656c394bd9 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:24.97376904 +0000 UTC m=+9.163971770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret") pod "global-pull-secret-syncer-nbw2j" (UID: "0bf8b935-52c1-4166-996a-1e656c394bd9") : object "kube-system"/"original-pull-secret" not registered
Sep 09 15:20:21.314660 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:21.314576    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:21.314828 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:21.314692    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:21.314828 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:21.314753    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:21.314828 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:21.314798    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:21.315065 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:21.314835    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:21.315065 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:21.314896    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:23.314254 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:23.314217    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:23.314764 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:23.314380    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:23.314810 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:23.314788    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:23.314905 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:23.314876    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:23.315057 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:23.314947    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:23.315057 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:23.315007    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:23.352734 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:23.352687    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-68.ec2.internal" event={"ID":"63872a04a76bb538711c93178fe3d471","Type":"ContainerStarted","Data":"0923f325aa17e3014090d0cbbcab1988d9c3d9da197ea16cb286706d4b2b81ac"}
Sep 09 15:20:23.369254 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:23.369177    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-68.ec2.internal" podStartSLOduration=5.369150417 podStartE2EDuration="5.369150417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:20:23.367871488 +0000 UTC m=+7.558074244" watchObservedRunningTime="2026-09-09 15:20:23.369150417 +0000 UTC m=+7.559353199"
Sep 09 15:20:25.010731 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:25.010685    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret\") pod \"global-pull-secret-syncer-nbw2j\" (UID: \"0bf8b935-52c1-4166-996a-1e656c394bd9\") " pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:25.011197 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:25.010748    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs\") pod \"network-metrics-daemon-zwx9l\" (UID: \"bb11cdb7-08b9-46e4-9d53-eb8092841c48\") " pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:25.011197 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:25.010801    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74xjs\" (UniqueName: \"kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs\") pod \"network-check-target-wc7w6\" (UID: \"d92db78d-9aa7-41a9-b1da-49176cb811c7\") " pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:25.011197 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:25.010964    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 15:20:25.011197 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:25.010984    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 15:20:25.011197 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:25.010997    2574 projected.go:196] Error preparing data for projected volume kube-api-access-74xjs for pod openshift-network-diagnostics/network-check-target-wc7w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:20:25.011197 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:25.011058    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs podName:d92db78d-9aa7-41a9-b1da-49176cb811c7 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:33.011037419 +0000 UTC m=+17.201240152 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-74xjs" (UniqueName: "kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs") pod "network-check-target-wc7w6" (UID: "d92db78d-9aa7-41a9-b1da-49176cb811c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:20:25.011522 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:25.011506    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 15:20:25.011587 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:25.011560    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret podName:0bf8b935-52c1-4166-996a-1e656c394bd9 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:33.011543886 +0000 UTC m=+17.201746621 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret") pod "global-pull-secret-syncer-nbw2j" (UID: "0bf8b935-52c1-4166-996a-1e656c394bd9") : object "kube-system"/"original-pull-secret" not registered
Sep 09 15:20:25.011631 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:25.011620    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:20:25.011673 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:25.011654    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs podName:bb11cdb7-08b9-46e4-9d53-eb8092841c48 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:33.011641246 +0000 UTC m=+17.201843978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs") pod "network-metrics-daemon-zwx9l" (UID: "bb11cdb7-08b9-46e4-9d53-eb8092841c48") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:20:25.314609 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:25.314568    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:25.314790 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:25.314695    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:25.315137 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:25.315113    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:25.315244 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:25.315219    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:25.315315 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:25.315294    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:25.315408 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:25.315386    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:27.314381 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:27.314061    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:27.314381 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:27.314342    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:27.314988 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:27.314300    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:27.314988 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:27.314445    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:27.314988 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:27.314581    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:27.314988 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:27.314685    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:29.314526 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:29.314481    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:29.314526 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:29.314514    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:29.315079 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:29.314520    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:29.315079 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:29.314625    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:29.315079 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:29.314702    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:29.315079 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:29.314774    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:31.314643 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:31.314606    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:31.315139 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:31.314625    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:31.315139 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:31.314738    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:31.315139 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:31.314753    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:31.315139 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:31.314869    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:31.315139 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:31.314992    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:33.075474 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:33.075436    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74xjs\" (UniqueName: \"kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs\") pod \"network-check-target-wc7w6\" (UID: \"d92db78d-9aa7-41a9-b1da-49176cb811c7\") " pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:33.075958 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:33.075494    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret\") pod \"global-pull-secret-syncer-nbw2j\" (UID: \"0bf8b935-52c1-4166-996a-1e656c394bd9\") " pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:33.075958 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:33.075529    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs\") pod \"network-metrics-daemon-zwx9l\" (UID: \"bb11cdb7-08b9-46e4-9d53-eb8092841c48\") " pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:33.075958 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:33.075632    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 15:20:33.075958 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:33.075646    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:20:33.075958 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:33.075646    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 15:20:33.075958 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:33.075659    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 15:20:33.075958 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:33.075674    2574 projected.go:196] Error preparing data for projected volume kube-api-access-74xjs for pod openshift-network-diagnostics/network-check-target-wc7w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:20:33.075958 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:33.075713    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret podName:0bf8b935-52c1-4166-996a-1e656c394bd9 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:49.075692733 +0000 UTC m=+33.265895468 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret") pod "global-pull-secret-syncer-nbw2j" (UID: "0bf8b935-52c1-4166-996a-1e656c394bd9") : object "kube-system"/"original-pull-secret" not registered
Sep 09 15:20:33.075958 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:33.075739    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs podName:bb11cdb7-08b9-46e4-9d53-eb8092841c48 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:49.075721703 +0000 UTC m=+33.265924434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs") pod "network-metrics-daemon-zwx9l" (UID: "bb11cdb7-08b9-46e4-9d53-eb8092841c48") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:20:33.075958 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:33.075759    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs podName:d92db78d-9aa7-41a9-b1da-49176cb811c7 nodeName:}" failed. No retries permitted until 2026-09-09 15:20:49.075749266 +0000 UTC m=+33.265951995 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-74xjs" (UniqueName: "kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs") pod "network-check-target-wc7w6" (UID: "d92db78d-9aa7-41a9-b1da-49176cb811c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:20:33.314304 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:33.314263    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:33.314493 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:33.314265    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:33.314493 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:33.314418    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:33.314493 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:33.314276    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:33.314493 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:33.314484    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:33.314645 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:33.314563    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:35.314527 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:35.314491    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:35.315058 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:35.314586    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:35.315058 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:35.314687    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:35.315058 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:35.314705    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:35.315058 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:35.314818    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:35.315058 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:35.314938    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:37.313916 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.313726    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:37.314455 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.313775    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:37.314455 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:37.314000    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:37.314455 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:37.314055    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:37.314455 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.313806    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:37.314455 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:37.314118    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:37.387159 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.387120    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t4dt5" event={"ID":"6acefbe5-6ce3-4172-b5ba-d0e9c0937c54","Type":"ContainerStarted","Data":"5e6569d742046b859872cce1679067df63870e0d9e39a524eef775177779eaff"}
Sep 09 15:20:37.388764 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.388732    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qzwm8" event={"ID":"75b69fbd-fc53-47f8-a9d6-d7627959fe2d","Type":"ContainerStarted","Data":"a8d11ff1fba1e918c2883eefc9647322067e0c6bb8678238276077f810d8ede5"}
Sep 09 15:20:37.390385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.390354    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hvcjr" event={"ID":"f944d3c3-de09-4122-9d8e-06c805dc429d","Type":"ContainerStarted","Data":"ac0f28412620d65b3549fc5667f95555d6f4bef8ddb192808cbe1b590b6e52fe"}
Sep 09 15:20:37.392327 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.392302    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl" event={"ID":"02affaec-4686-4840-bb51-1b27e7a2e52a","Type":"ContainerStarted","Data":"4c1812aa52f661fc5b18b8ebfcdb294ce423f3097e723316de86afc155917354"}
Sep 09 15:20:37.394409 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.394387    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bqr46" event={"ID":"8f0a93d4-2dc8-49a8-9831-f21410c52c38","Type":"ContainerStarted","Data":"42034f5aefdb95eb868474e0185bdfea137cccd5dfb4d06849f83965724c2df4"}
Sep 09 15:20:37.397181 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.397156    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx" event={"ID":"ec98a80c-6690-4981-b7c9-292ea9d9a639","Type":"ContainerStarted","Data":"ff86256905fe5a648de97eb1f6313327db8bad0a3b77cdff0d1303863512c0fb"}
Sep 09 15:20:37.397305 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.397234    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx" event={"ID":"ec98a80c-6690-4981-b7c9-292ea9d9a639","Type":"ContainerStarted","Data":"514f75f704695d93140cdecbdf63a6da2b39fa5345f412c4d37eb38dbaa4c3d4"}
Sep 09 15:20:37.397305 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.397291    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx" event={"ID":"ec98a80c-6690-4981-b7c9-292ea9d9a639","Type":"ContainerStarted","Data":"cfc92275f857fca928cb891dbeae679b6022ec672438627705818c828bea73d9"}
Sep 09 15:20:37.399518 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.399469    2574 generic.go:356] "Generic (PLEG): container finished" podID="5bf1afb938f794d571614842ff701595" containerID="1635b5ec2a77b0256367861392267cee3d45cbfd9616bbe76e4403c650511ee7" exitCode=0
Sep 09 15:20:37.399675 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.399653    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal" event={"ID":"5bf1afb938f794d571614842ff701595","Type":"ContainerDied","Data":"1635b5ec2a77b0256367861392267cee3d45cbfd9616bbe76e4403c650511ee7"}
Sep 09 15:20:37.401623 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.401300    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbvc2" event={"ID":"dfc18078-e42b-4475-ae5a-719783979eed","Type":"ContainerStarted","Data":"3552e3b92609cf5bfd116958b667674177855c5e969db403f3c696b354ebf12b"}
Sep 09 15:20:37.403836 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.403814    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vbx2d" event={"ID":"8ded534f-da3e-47a3-b873-45b434a8d27f","Type":"ContainerStarted","Data":"1d42517ed97abad0a2ad71ba300925b9beb6d90b1d7c2c3dcc67b27654842f50"}
Sep 09 15:20:37.424678 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.422743    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t4dt5" podStartSLOduration=1.180635818 podStartE2EDuration="20.422724472s" totalImagesPullingTime="19.242088654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:20:37.401960329 +0000 UTC m=+21.592163077" watchObservedRunningTime="2026-09-09 15:20:37.422724472 +0000 UTC m=+21.612927223"
Sep 09 15:20:37.424678 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.422976    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bqr46" podStartSLOduration=1.056825805 podStartE2EDuration="20.42296288s" totalImagesPullingTime="19.366137075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:20:37.422468759 +0000 UTC m=+21.612671532" watchObservedRunningTime="2026-09-09 15:20:37.42296288 +0000 UTC m=+21.613165629"
Sep 09 15:20:37.436989 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.436946    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hvcjr" podStartSLOduration=1.102929125 podStartE2EDuration="20.436932234s" totalImagesPullingTime="19.334003109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:20:37.436723658 +0000 UTC m=+21.626926407" watchObservedRunningTime="2026-09-09 15:20:37.436932234 +0000 UTC m=+21.627134982"
Sep 09 15:20:37.472731 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.472681    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qzwm8" podStartSLOduration=1.225357563 podStartE2EDuration="20.472661185s" totalImagesPullingTime="19.247303622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:20:37.449969695 +0000 UTC m=+21.640172456" watchObservedRunningTime="2026-09-09 15:20:37.472661185 +0000 UTC m=+21.662863935"
Sep 09 15:20:37.502683 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:37.502638    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vbx2d" podStartSLOduration=1.122791681 podStartE2EDuration="20.502622871s" totalImagesPullingTime="19.37983119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:20:37.502098847 +0000 UTC m=+21.692301595" watchObservedRunningTime="2026-09-09 15:20:37.502622871 +0000 UTC m=+21.692825619"
Sep 09 15:20:38.407507 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:38.407236    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b6nk6" event={"ID":"7d5053f1-a046-435a-8cd3-2919151e99c1","Type":"ContainerStarted","Data":"565cd7fc61ae0d0cb2e0cfde685b7810b3f38a586b1b05e2a4a1e9c13dfdbfb4"}
Sep 09 15:20:38.410341 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:38.410313    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx" event={"ID":"ec98a80c-6690-4981-b7c9-292ea9d9a639","Type":"ContainerStarted","Data":"1b4c4f1989351d92abf1a4d3ebe74c7e1852a1b68ce4e1b91f40ce5c765ef528"}
Sep 09 15:20:38.410472 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:38.410377    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx" event={"ID":"ec98a80c-6690-4981-b7c9-292ea9d9a639","Type":"ContainerStarted","Data":"5bc97384ed77a09b7ac529faeaaeed63850ac14cd3fe9ef498da2bb7a4d5fb8c"}
Sep 09 15:20:38.410472 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:38.410424    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx" event={"ID":"ec98a80c-6690-4981-b7c9-292ea9d9a639","Type":"ContainerStarted","Data":"daf5d2885b0932530cbdf73f238559fb8da990494889c4f01cbb174dca245a3b"}
Sep 09 15:20:38.412039 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:38.412012    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal" event={"ID":"5bf1afb938f794d571614842ff701595","Type":"ContainerStarted","Data":"1531f45046cc098954c11b228c925a8ddc59d86651dbe20f07aa68a345ac7ed5"}
Sep 09 15:20:38.413530 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:38.413509    2574 generic.go:356] "Generic (PLEG): container finished" podID="dfc18078-e42b-4475-ae5a-719783979eed" containerID="3552e3b92609cf5bfd116958b667674177855c5e969db403f3c696b354ebf12b" exitCode=0
Sep 09 15:20:38.413647 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:38.413581    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbvc2" event={"ID":"dfc18078-e42b-4475-ae5a-719783979eed","Type":"ContainerDied","Data":"3552e3b92609cf5bfd116958b667674177855c5e969db403f3c696b354ebf12b"}
Sep 09 15:20:38.444939 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:38.444884    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b6nk6" podStartSLOduration=2.1311253470000002 podStartE2EDuration="21.444869588s" totalImagesPullingTime="19.313744241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:20:38.424071562 +0000 UTC m=+22.614274310" watchObservedRunningTime="2026-09-09 15:20:38.444869588 +0000 UTC m=+22.635072334"
Sep 09 15:20:38.457516 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:38.457466    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-68.ec2.internal" podStartSLOduration=20.457452078 podStartE2EDuration="20.457452078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:20:38.457246001 +0000 UTC m=+22.647448732" watchObservedRunningTime="2026-09-09 15:20:38.457452078 +0000 UTC m=+22.647654827"
Sep 09 15:20:39.314523 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:39.314492    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:39.314724 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:39.314492    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:39.314724 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:39.314708    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:39.314905 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:39.314598    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:39.314905 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:39.314492    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:39.314905 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:39.314836    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:39.446679 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:39.446644    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t4dt5"
Sep 09 15:20:40.422648 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:40.422604    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx" event={"ID":"ec98a80c-6690-4981-b7c9-292ea9d9a639","Type":"ContainerStarted","Data":"514b6a517326351ed079cf6037d1973cbb96dfab5bf8abcee5dd6870791a11b0"}
Sep 09 15:20:40.822490 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:40.822462    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t4dt5"
Sep 09 15:20:40.823091 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:40.823067    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t4dt5"
Sep 09 15:20:40.908263 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:40.908235    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 15:20:41.311607 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:41.311514    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T15:20:40.908258231Z","UUID":"537f6fcd-7029-41d6-89bf-e5f83aef4841","Handler":null,"Name":"","Endpoint":""}
Sep 09 15:20:41.313629 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:41.313604    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:41.313629 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:41.313622    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:41.313825 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:41.313617    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 15:20:41.313825 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:41.313676    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 15:20:41.313825 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:41.313604    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:41.313825 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:41.313743    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:41.313995 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:41.313882    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:41.313995 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:41.313964    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:41.426752 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:41.426722    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl" event={"ID":"02affaec-4686-4840-bb51-1b27e7a2e52a","Type":"ContainerStarted","Data":"84219604f560d4d0f4a30525e496170075351d1906998c782b057bf780aea564"}
Sep 09 15:20:41.427412 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:41.427388    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t4dt5"
Sep 09 15:20:42.437186 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:42.436995    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl" event={"ID":"02affaec-4686-4840-bb51-1b27e7a2e52a","Type":"ContainerStarted","Data":"deaa49b8738c7c1895d5eaaa61b7e43f78bb682d0993c967f5d9f8fd9a4878a7"}
Sep 09 15:20:42.441028 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:42.440999    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx" event={"ID":"ec98a80c-6690-4981-b7c9-292ea9d9a639","Type":"ContainerStarted","Data":"abddf49fc64cc450f25a1920c9133051e4a4dbb7099f893696c219860fa64bd5"}
Sep 09 15:20:42.453471 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:42.453424    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9ngl" podStartSLOduration=16.021089063 podStartE2EDuration="25.453411151s" totalImagesPullingTime="9.432322088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:20:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:20:42.453137434 +0000 UTC m=+26.643340182" watchObservedRunningTime="2026-09-09 15:20:42.453411151 +0000 UTC m=+26.643613900"
Sep 09 15:20:42.475550 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:42.475501    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx" podStartSLOduration=6.022195824 podStartE2EDuration="25.475486454s" totalImagesPullingTime="19.45329063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:20:42.474274602 +0000 UTC m=+26.664477351" watchObservedRunningTime="2026-09-09 15:20:42.475486454 +0000 UTC m=+26.665689186"
Sep 09 15:20:43.313987 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:43.313957    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:43.314193 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:43.314043    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:43.314193 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:43.314051    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:43.314193 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:43.314078    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:43.314193 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:43.314179    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:43.314376 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:43.314285    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:43.444063 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:43.444028    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:43.444617 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:43.444111    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:43.444617 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:43.444159    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:43.463730 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:43.463704    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:43.464278 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:43.464247    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:20:43.794535 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:43.794489    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wc7w6"]
Sep 09 15:20:43.794764 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:43.794745    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:43.794895 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:43.794868    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:43.795454 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:43.795383    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nbw2j"]
Sep 09 15:20:43.795574 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:43.795486    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:43.795574 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:43.795557    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:43.796495 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:43.796469    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zwx9l"]
Sep 09 15:20:43.796774 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:43.796602    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:43.796774 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:43.796738    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:45.313673 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:45.313623    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:45.314494 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:45.313673    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:45.314494 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:45.313786    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:45.314494 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:45.313794    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:45.314494 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:45.313879    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:45.314494 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:45.313947    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:46.452548 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:46.452365    2574 generic.go:356] "Generic (PLEG): container finished" podID="dfc18078-e42b-4475-ae5a-719783979eed" containerID="2fd628dea73b6a991bbd913e0ee71ae5c6608383aaf0d2f039777ddab6aa5565" exitCode=0
Sep 09 15:20:46.452932 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:46.452442    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbvc2" event={"ID":"dfc18078-e42b-4475-ae5a-719783979eed","Type":"ContainerDied","Data":"2fd628dea73b6a991bbd913e0ee71ae5c6608383aaf0d2f039777ddab6aa5565"}
Sep 09 15:20:47.314347 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:47.314305    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:47.314537 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:47.314312    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:47.314537 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:47.314443    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:47.314537 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:47.314320    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:47.314537 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:47.314518    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:47.314687 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:47.314573    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:48.460773 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:48.460738    2574 generic.go:356] "Generic (PLEG): container finished" podID="dfc18078-e42b-4475-ae5a-719783979eed" containerID="afe930ddef95d16c52d60b94ea862ebf55b1820b2ef98c22b9b51ab9d15b2cbe" exitCode=0
Sep 09 15:20:48.461190 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:48.460785    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbvc2" event={"ID":"dfc18078-e42b-4475-ae5a-719783979eed","Type":"ContainerDied","Data":"afe930ddef95d16c52d60b94ea862ebf55b1820b2ef98c22b9b51ab9d15b2cbe"}
Sep 09 15:20:49.088154 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.088120    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74xjs\" (UniqueName: \"kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs\") pod \"network-check-target-wc7w6\" (UID: \"d92db78d-9aa7-41a9-b1da-49176cb811c7\") " pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:49.088154 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.088164    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret\") pod \"global-pull-secret-syncer-nbw2j\" (UID: \"0bf8b935-52c1-4166-996a-1e656c394bd9\") " pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:49.088377 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.088195    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs\") pod \"network-metrics-daemon-zwx9l\" (UID: \"bb11cdb7-08b9-46e4-9d53-eb8092841c48\") " pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:49.088377 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:49.088282    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:20:49.088377 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:49.088284    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 15:20:49.088377 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:49.088296    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 15:20:49.088377 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:49.088318    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 15:20:49.088377 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:49.088329    2574 projected.go:196] Error preparing data for projected volume kube-api-access-74xjs for pod openshift-network-diagnostics/network-check-target-wc7w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:20:49.088377 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:49.088333    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs podName:bb11cdb7-08b9-46e4-9d53-eb8092841c48 nodeName:}" failed. No retries permitted until 2026-09-09 15:21:21.08831968 +0000 UTC m=+65.278522407 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs") pod "network-metrics-daemon-zwx9l" (UID: "bb11cdb7-08b9-46e4-9d53-eb8092841c48") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:20:49.088377 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:49.088351    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret podName:0bf8b935-52c1-4166-996a-1e656c394bd9 nodeName:}" failed. No retries permitted until 2026-09-09 15:21:21.088341134 +0000 UTC m=+65.278543863 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret") pod "global-pull-secret-syncer-nbw2j" (UID: "0bf8b935-52c1-4166-996a-1e656c394bd9") : object "kube-system"/"original-pull-secret" not registered
Sep 09 15:20:49.088377 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:49.088365    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs podName:d92db78d-9aa7-41a9-b1da-49176cb811c7 nodeName:}" failed. No retries permitted until 2026-09-09 15:21:21.088359534 +0000 UTC m=+65.278562262 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-74xjs" (UniqueName: "kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs") pod "network-check-target-wc7w6" (UID: "d92db78d-9aa7-41a9-b1da-49176cb811c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:20:49.314545 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.314512    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:49.314545 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.314541    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:49.314746 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.314548    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:49.314746 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:49.314650    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wc7w6" podUID="d92db78d-9aa7-41a9-b1da-49176cb811c7"
Sep 09 15:20:49.314746 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:49.314655    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:20:49.314746 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:49.314695    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nbw2j" podUID="0bf8b935-52c1-4166-996a-1e656c394bd9"
Sep 09 15:20:49.665921 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.665838    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-68.ec2.internal" event="NodeReady"
Sep 09 15:20:49.666390 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.666084    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 15:20:49.708254 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.708219    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vktxv"]
Sep 09 15:20:49.724091 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.724059    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5qktk"]
Sep 09 15:20:49.724479 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.724462    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vktxv"
Sep 09 15:20:49.727107 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.727085    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 15:20:49.727236 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.727108    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 15:20:49.727236 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.727109    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jnqpd\""
Sep 09 15:20:49.741972 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.741949    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vktxv"]
Sep 09 15:20:49.742092 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.741984    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5qktk"]
Sep 09 15:20:49.742092 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.742071    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5qktk"
Sep 09 15:20:49.745474 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.745454    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 15:20:49.745607 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.745593    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 15:20:49.745661 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.745625    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mczr8\""
Sep 09 15:20:49.745714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.745702    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 15:20:49.792979 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.792900    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:20:49.792979 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.792958    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-tmp-dir\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:20:49.793188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.793039    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-config-volume\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:20:49.793188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.793061    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8b8q\" (UniqueName: \"kubernetes.io/projected/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-kube-api-access-r8b8q\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:20:49.894192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.894153    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aef7e653-f35f-4cef-8e0a-42c2fd191106-cert\") pod \"ingress-canary-5qktk\" (UID: \"aef7e653-f35f-4cef-8e0a-42c2fd191106\") " pod="openshift-ingress-canary/ingress-canary-5qktk"
Sep 09 15:20:49.894344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.894202    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-config-volume\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:20:49.894344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.894222    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8b8q\" (UniqueName: \"kubernetes.io/projected/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-kube-api-access-r8b8q\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:20:49.894344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.894279    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:20:49.894344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.894326    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-tmp-dir\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:20:49.894495 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.894355    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9bs7\" (UniqueName: \"kubernetes.io/projected/aef7e653-f35f-4cef-8e0a-42c2fd191106-kube-api-access-v9bs7\") pod \"ingress-canary-5qktk\" (UID: \"aef7e653-f35f-4cef-8e0a-42c2fd191106\") " pod="openshift-ingress-canary/ingress-canary-5qktk"
Sep 09 15:20:49.894495 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:49.894402    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:20:49.894495 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:49.894459    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls podName:a49acd86-0f4f-4da1-a9bc-c4cde626c7cd nodeName:}" failed. No retries permitted until 2026-09-09 15:20:50.394440968 +0000 UTC m=+34.584643709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls") pod "dns-default-vktxv" (UID: "a49acd86-0f4f-4da1-a9bc-c4cde626c7cd") : secret "dns-default-metrics-tls" not found
Sep 09 15:20:49.894639 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.894604    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-tmp-dir\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:20:49.894730 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.894710    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-config-volume\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:20:49.904245 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.904212    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8b8q\" (UniqueName: \"kubernetes.io/projected/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-kube-api-access-r8b8q\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:20:49.995385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.995343    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9bs7\" (UniqueName: \"kubernetes.io/projected/aef7e653-f35f-4cef-8e0a-42c2fd191106-kube-api-access-v9bs7\") pod \"ingress-canary-5qktk\" (UID: \"aef7e653-f35f-4cef-8e0a-42c2fd191106\") " pod="openshift-ingress-canary/ingress-canary-5qktk"
Sep 09 15:20:49.995560 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.995402    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aef7e653-f35f-4cef-8e0a-42c2fd191106-cert\") pod \"ingress-canary-5qktk\" (UID: \"aef7e653-f35f-4cef-8e0a-42c2fd191106\") " pod="openshift-ingress-canary/ingress-canary-5qktk"
Sep 09 15:20:49.998046 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:49.998021    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aef7e653-f35f-4cef-8e0a-42c2fd191106-cert\") pod \"ingress-canary-5qktk\" (UID: \"aef7e653-f35f-4cef-8e0a-42c2fd191106\") " pod="openshift-ingress-canary/ingress-canary-5qktk"
Sep 09 15:20:50.003000 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:50.002977    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9bs7\" (UniqueName: \"kubernetes.io/projected/aef7e653-f35f-4cef-8e0a-42c2fd191106-kube-api-access-v9bs7\") pod \"ingress-canary-5qktk\" (UID: \"aef7e653-f35f-4cef-8e0a-42c2fd191106\") " pod="openshift-ingress-canary/ingress-canary-5qktk"
Sep 09 15:20:50.050984 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:50.050910    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5qktk"
Sep 09 15:20:50.350656 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:50.350484    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5qktk"]
Sep 09 15:20:50.354162 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:20:50.354128    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaef7e653_f35f_4cef_8e0a_42c2fd191106.slice/crio-87e90015bd4911d7e9bff659e70c50cf0bf969b704587a9bec80a9ef20b4f42a WatchSource:0}: Error finding container 87e90015bd4911d7e9bff659e70c50cf0bf969b704587a9bec80a9ef20b4f42a: Status 404 returned error can't find the container with id 87e90015bd4911d7e9bff659e70c50cf0bf969b704587a9bec80a9ef20b4f42a
Sep 09 15:20:50.398798 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:50.398768    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:20:50.398979 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:50.398908    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:20:50.398979 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:50.398973    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls podName:a49acd86-0f4f-4da1-a9bc-c4cde626c7cd nodeName:}" failed. No retries permitted until 2026-09-09 15:20:51.398956822 +0000 UTC m=+35.589159562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls") pod "dns-default-vktxv" (UID: "a49acd86-0f4f-4da1-a9bc-c4cde626c7cd") : secret "dns-default-metrics-tls" not found
Sep 09 15:20:50.468305 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:50.468276    2574 generic.go:356] "Generic (PLEG): container finished" podID="dfc18078-e42b-4475-ae5a-719783979eed" containerID="60d82673d9e40b53390ece119b6cfb1805e35914e1ecfdac005fce9d3a871bd9" exitCode=0
Sep 09 15:20:50.468485 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:50.468351    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbvc2" event={"ID":"dfc18078-e42b-4475-ae5a-719783979eed","Type":"ContainerDied","Data":"60d82673d9e40b53390ece119b6cfb1805e35914e1ecfdac005fce9d3a871bd9"}
Sep 09 15:20:50.469621 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:50.469586    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5qktk" event={"ID":"aef7e653-f35f-4cef-8e0a-42c2fd191106","Type":"ContainerStarted","Data":"87e90015bd4911d7e9bff659e70c50cf0bf969b704587a9bec80a9ef20b4f42a"}
Sep 09 15:20:51.314036 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:51.313926    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:20:51.314036 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:51.313960    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:20:51.315065 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:51.314807    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:20:51.316977 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:51.316956    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 15:20:51.318212 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:51.318029    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 15:20:51.318212 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:51.318043    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xdr6q\""
Sep 09 15:20:51.318212 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:51.318181    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 15:20:51.318428 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:51.318279    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7889l\""
Sep 09 15:20:51.318428 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:51.318390    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 15:20:51.407548 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:51.407510    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:20:51.407907 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:51.407873    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:20:51.408053 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:51.407957    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls podName:a49acd86-0f4f-4da1-a9bc-c4cde626c7cd nodeName:}" failed. No retries permitted until 2026-09-09 15:20:53.407935438 +0000 UTC m=+37.598138210 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls") pod "dns-default-vktxv" (UID: "a49acd86-0f4f-4da1-a9bc-c4cde626c7cd") : secret "dns-default-metrics-tls" not found
Sep 09 15:20:53.423682 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:53.423635    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:20:53.424242 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:53.423805    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:20:53.424242 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:53.423890    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls podName:a49acd86-0f4f-4da1-a9bc-c4cde626c7cd nodeName:}" failed. No retries permitted until 2026-09-09 15:20:57.423870429 +0000 UTC m=+41.614073163 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls") pod "dns-default-vktxv" (UID: "a49acd86-0f4f-4da1-a9bc-c4cde626c7cd") : secret "dns-default-metrics-tls" not found
Sep 09 15:20:55.483084 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:55.483045    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5qktk" event={"ID":"aef7e653-f35f-4cef-8e0a-42c2fd191106","Type":"ContainerStarted","Data":"92a7c2dfca70593a9d3d3c65f5d362b7b25c68580006dfed2237a8645bab2c60"}
Sep 09 15:20:55.498767 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:55.498720    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5qktk" podStartSLOduration=1.6671890230000002 podStartE2EDuration="6.498704386s" totalImagesPullingTime="4.831515363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:20:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:20:55.497637556 +0000 UTC m=+39.687840318" watchObservedRunningTime="2026-09-09 15:20:55.498704386 +0000 UTC m=+39.688907134"
Sep 09 15:20:56.488600 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:56.488568    2574 generic.go:356] "Generic (PLEG): container finished" podID="dfc18078-e42b-4475-ae5a-719783979eed" containerID="321d7a04e1df314a282906ff60fd625bbb4c914d3cc2c4fc6c22ee389f49d926" exitCode=0
Sep 09 15:20:56.489042 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:56.488644    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbvc2" event={"ID":"dfc18078-e42b-4475-ae5a-719783979eed","Type":"ContainerDied","Data":"321d7a04e1df314a282906ff60fd625bbb4c914d3cc2c4fc6c22ee389f49d926"}
Sep 09 15:20:57.453187 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:57.453145    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:20:57.453413 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:57.453324    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:20:57.453413 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:20:57.453404    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls podName:a49acd86-0f4f-4da1-a9bc-c4cde626c7cd nodeName:}" failed. No retries permitted until 2026-09-09 15:21:05.453383317 +0000 UTC m=+49.643586057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls") pod "dns-default-vktxv" (UID: "a49acd86-0f4f-4da1-a9bc-c4cde626c7cd") : secret "dns-default-metrics-tls" not found
Sep 09 15:20:57.494377 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:57.494341    2574 generic.go:356] "Generic (PLEG): container finished" podID="dfc18078-e42b-4475-ae5a-719783979eed" containerID="4a1f71e653608adfe51313a2d7aeedb598f368dffb11ff24e14082348a80de19" exitCode=0
Sep 09 15:20:57.494822 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:57.494391    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbvc2" event={"ID":"dfc18078-e42b-4475-ae5a-719783979eed","Type":"ContainerDied","Data":"4a1f71e653608adfe51313a2d7aeedb598f368dffb11ff24e14082348a80de19"}
Sep 09 15:20:58.499902 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:58.499863    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbvc2" event={"ID":"dfc18078-e42b-4475-ae5a-719783979eed","Type":"ContainerStarted","Data":"70d4a707c8b0b283d381282c6554455ac5b64690d358534f18ffbe7ec181ae93"}
Sep 09 15:20:58.522810 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:20:58.522754    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vbvc2" podStartSLOduration=6.372751205 podStartE2EDuration="41.522736326s" totalImagesPullingTime="35.149985121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:20:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:20:58.521101503 +0000 UTC m=+42.711304271" watchObservedRunningTime="2026-09-09 15:20:58.522736326 +0000 UTC m=+42.712939074"
Sep 09 15:21:05.506798 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:05.506744    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:21:05.507225 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:21:05.506894    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:21:05.507225 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:21:05.506947    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls podName:a49acd86-0f4f-4da1-a9bc-c4cde626c7cd nodeName:}" failed. No retries permitted until 2026-09-09 15:21:21.506932842 +0000 UTC m=+65.697135569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls") pod "dns-default-vktxv" (UID: "a49acd86-0f4f-4da1-a9bc-c4cde626c7cd") : secret "dns-default-metrics-tls" not found
Sep 09 15:21:15.459582 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:15.459548    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kzdx"
Sep 09 15:21:21.121184 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:21.121141    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs\") pod \"network-metrics-daemon-zwx9l\" (UID: \"bb11cdb7-08b9-46e4-9d53-eb8092841c48\") " pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:21:21.121676 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:21.121209    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74xjs\" (UniqueName: \"kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs\") pod \"network-check-target-wc7w6\" (UID: \"d92db78d-9aa7-41a9-b1da-49176cb811c7\") " pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:21:21.121676 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:21.121244    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret\") pod \"global-pull-secret-syncer-nbw2j\" (UID: \"0bf8b935-52c1-4166-996a-1e656c394bd9\") " pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:21:21.123988 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:21.123967    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 15:21:21.124110 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:21.124087    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 15:21:21.124165 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:21.124099    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 15:21:21.132114 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:21:21.132092    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 15:21:21.132185 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:21:21.132178    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs podName:bb11cdb7-08b9-46e4-9d53-eb8092841c48 nodeName:}" failed. No retries permitted until 2026-09-09 15:22:25.13215628 +0000 UTC m=+129.322359023 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs") pod "network-metrics-daemon-zwx9l" (UID: "bb11cdb7-08b9-46e4-9d53-eb8092841c48") : secret "metrics-daemon-secret" not found
Sep 09 15:21:21.134090 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:21.134075    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 15:21:21.134706 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:21.134678    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bf8b935-52c1-4166-996a-1e656c394bd9-original-pull-secret\") pod \"global-pull-secret-syncer-nbw2j\" (UID: \"0bf8b935-52c1-4166-996a-1e656c394bd9\") " pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:21:21.145211 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:21.145184    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74xjs\" (UniqueName: \"kubernetes.io/projected/d92db78d-9aa7-41a9-b1da-49176cb811c7-kube-api-access-74xjs\") pod \"network-check-target-wc7w6\" (UID: \"d92db78d-9aa7-41a9-b1da-49176cb811c7\") " pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:21:21.331300 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:21.331263    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7889l\""
Sep 09 15:21:21.336261 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:21.336242    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nbw2j"
Sep 09 15:21:21.339402 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:21.339382    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:21:21.523933 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:21.523892    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:21:21.524107 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:21:21.524031    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:21:21.524107 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:21:21.524094    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls podName:a49acd86-0f4f-4da1-a9bc-c4cde626c7cd nodeName:}" failed. No retries permitted until 2026-09-09 15:21:53.524077945 +0000 UTC m=+97.714280672 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls") pod "dns-default-vktxv" (UID: "a49acd86-0f4f-4da1-a9bc-c4cde626c7cd") : secret "dns-default-metrics-tls" not found
Sep 09 15:21:21.612899 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:21.612867    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nbw2j"]
Sep 09 15:21:21.615683 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:21.615658    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wc7w6"]
Sep 09 15:21:21.616807 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:21:21.616716    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bf8b935_52c1_4166_996a_1e656c394bd9.slice/crio-c409fc173ba3e59e4a88e2528c40e27c178b6bcf08779ed665c84a0a42e29154 WatchSource:0}: Error finding container c409fc173ba3e59e4a88e2528c40e27c178b6bcf08779ed665c84a0a42e29154: Status 404 returned error can't find the container with id c409fc173ba3e59e4a88e2528c40e27c178b6bcf08779ed665c84a0a42e29154
Sep 09 15:21:21.619286 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:21:21.619268    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92db78d_9aa7_41a9_b1da_49176cb811c7.slice/crio-8f0a4dd44de02fcd33d1511b22692ee47d30369bf92c48ed8008474198ef2d83 WatchSource:0}: Error finding container 8f0a4dd44de02fcd33d1511b22692ee47d30369bf92c48ed8008474198ef2d83: Status 404 returned error can't find the container with id 8f0a4dd44de02fcd33d1511b22692ee47d30369bf92c48ed8008474198ef2d83
Sep 09 15:21:22.559015 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:22.558974    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wc7w6" event={"ID":"d92db78d-9aa7-41a9-b1da-49176cb811c7","Type":"ContainerStarted","Data":"8f0a4dd44de02fcd33d1511b22692ee47d30369bf92c48ed8008474198ef2d83"}
Sep 09 15:21:22.560467 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:22.560433    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nbw2j" event={"ID":"0bf8b935-52c1-4166-996a-1e656c394bd9","Type":"ContainerStarted","Data":"c409fc173ba3e59e4a88e2528c40e27c178b6bcf08779ed665c84a0a42e29154"}
Sep 09 15:21:25.571788 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:25.571725    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nbw2j" event={"ID":"0bf8b935-52c1-4166-996a-1e656c394bd9","Type":"ContainerStarted","Data":"479a4dcc25cd0b8955e6f492a79c32db4e179ba8b3b4b0d9c0f774630b0012c1"}
Sep 09 15:21:25.586334 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:25.585612    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nbw2j" podStartSLOduration=65.032378666 podStartE2EDuration="1m8.585592217s" totalImagesPullingTime="3.553213551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:21:25.585292835 +0000 UTC m=+69.775495585" watchObservedRunningTime="2026-09-09 15:21:25.585592217 +0000 UTC m=+69.775794968"
Sep 09 15:21:28.580464 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:28.580375    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wc7w6" event={"ID":"d92db78d-9aa7-41a9-b1da-49176cb811c7","Type":"ContainerStarted","Data":"2b676c67dd23622cc8857abae7d5c724c7da91b93e390868100ec7e361b31d8d"}
Sep 09 15:21:28.580464 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:28.580454    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:21:28.594452 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:28.594408    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wc7w6" podStartSLOduration=64.91407724 podStartE2EDuration="1m11.594393946s" totalImagesPullingTime="6.680316706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:21:28.594045376 +0000 UTC m=+72.784248138" watchObservedRunningTime="2026-09-09 15:21:28.594393946 +0000 UTC m=+72.784596694"
Sep 09 15:21:30.891967 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:30.891937    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"]
Sep 09 15:21:30.894745 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:30.894729    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"
Sep 09 15:21:30.897360 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:30.897334    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 09 15:21:30.897360 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:30.897334    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 09 15:21:30.897550 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:30.897381    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 09 15:21:30.898463 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:30.898443    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 09 15:21:30.905125 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:30.905095    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"]
Sep 09 15:21:30.983126 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:30.983075    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a5cc473-95f9-49d2-a0a1-becb24f4d24a-tmp\") pod \"klusterlet-addon-workmgr-5cf9bcc554-sgnt5\" (UID: \"3a5cc473-95f9-49d2-a0a1-becb24f4d24a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"
Sep 09 15:21:30.983126 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:30.983123    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrcxc\" (UniqueName: \"kubernetes.io/projected/3a5cc473-95f9-49d2-a0a1-becb24f4d24a-kube-api-access-nrcxc\") pod \"klusterlet-addon-workmgr-5cf9bcc554-sgnt5\" (UID: \"3a5cc473-95f9-49d2-a0a1-becb24f4d24a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"
Sep 09 15:21:30.983362 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:30.983154    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3a5cc473-95f9-49d2-a0a1-becb24f4d24a-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cf9bcc554-sgnt5\" (UID: \"3a5cc473-95f9-49d2-a0a1-becb24f4d24a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"
Sep 09 15:21:31.087678 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:31.087644    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a5cc473-95f9-49d2-a0a1-becb24f4d24a-tmp\") pod \"klusterlet-addon-workmgr-5cf9bcc554-sgnt5\" (UID: \"3a5cc473-95f9-49d2-a0a1-becb24f4d24a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"
Sep 09 15:21:31.087804 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:31.087696    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrcxc\" (UniqueName: \"kubernetes.io/projected/3a5cc473-95f9-49d2-a0a1-becb24f4d24a-kube-api-access-nrcxc\") pod \"klusterlet-addon-workmgr-5cf9bcc554-sgnt5\" (UID: \"3a5cc473-95f9-49d2-a0a1-becb24f4d24a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"
Sep 09 15:21:31.087804 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:31.087734    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3a5cc473-95f9-49d2-a0a1-becb24f4d24a-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cf9bcc554-sgnt5\" (UID: \"3a5cc473-95f9-49d2-a0a1-becb24f4d24a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"
Sep 09 15:21:31.088033 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:31.088009    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a5cc473-95f9-49d2-a0a1-becb24f4d24a-tmp\") pod \"klusterlet-addon-workmgr-5cf9bcc554-sgnt5\" (UID: \"3a5cc473-95f9-49d2-a0a1-becb24f4d24a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"
Sep 09 15:21:31.090307 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:31.090286    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3a5cc473-95f9-49d2-a0a1-becb24f4d24a-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cf9bcc554-sgnt5\" (UID: \"3a5cc473-95f9-49d2-a0a1-becb24f4d24a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"
Sep 09 15:21:31.095977 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:31.095954    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrcxc\" (UniqueName: \"kubernetes.io/projected/3a5cc473-95f9-49d2-a0a1-becb24f4d24a-kube-api-access-nrcxc\") pod \"klusterlet-addon-workmgr-5cf9bcc554-sgnt5\" (UID: \"3a5cc473-95f9-49d2-a0a1-becb24f4d24a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"
Sep 09 15:21:31.203574 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:31.203540    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"
Sep 09 15:21:31.473200 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:31.473130    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"]
Sep 09 15:21:31.476545 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:21:31.476514    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a5cc473_95f9_49d2_a0a1_becb24f4d24a.slice/crio-2a4c6b5478fa2085b5f767f37aabc301154b73fe7ac51aa243bda6afac4214ff WatchSource:0}: Error finding container 2a4c6b5478fa2085b5f767f37aabc301154b73fe7ac51aa243bda6afac4214ff: Status 404 returned error can't find the container with id 2a4c6b5478fa2085b5f767f37aabc301154b73fe7ac51aa243bda6afac4214ff
Sep 09 15:21:31.588777 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:31.588737    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5" event={"ID":"3a5cc473-95f9-49d2-a0a1-becb24f4d24a","Type":"ContainerStarted","Data":"2a4c6b5478fa2085b5f767f37aabc301154b73fe7ac51aa243bda6afac4214ff"}
Sep 09 15:21:36.603983 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:36.603938    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5" event={"ID":"3a5cc473-95f9-49d2-a0a1-becb24f4d24a","Type":"ContainerStarted","Data":"9659a299919a775cdda4b1dff01e724bcaebc952fa02f65bc3a3bcdea5273054"}
Sep 09 15:21:36.604355 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:36.604157    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"
Sep 09 15:21:36.605853 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:36.605816    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"
Sep 09 15:21:36.621656 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:36.621612    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5" podStartSLOduration=2.452521003 podStartE2EDuration="6.621599476s" totalImagesPullingTime="4.169078473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:21:36.621228269 +0000 UTC m=+80.811431043" watchObservedRunningTime="2026-09-09 15:21:36.621599476 +0000 UTC m=+80.811802225"
Sep 09 15:21:53.544324 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:53.544285    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:21:53.544733 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:21:53.544434    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:21:53.544733 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:21:53.544501    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls podName:a49acd86-0f4f-4da1-a9bc-c4cde626c7cd nodeName:}" failed. No retries permitted until 2026-09-09 15:22:57.544484452 +0000 UTC m=+161.734687180 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls") pod "dns-default-vktxv" (UID: "a49acd86-0f4f-4da1-a9bc-c4cde626c7cd") : secret "dns-default-metrics-tls" not found
Sep 09 15:21:59.585261 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:21:59.585230    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wc7w6"
Sep 09 15:22:25.160152 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:22:25.160094    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs\") pod \"network-metrics-daemon-zwx9l\" (UID: \"bb11cdb7-08b9-46e4-9d53-eb8092841c48\") " pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:22:25.160569 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:22:25.160198    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 15:22:25.160569 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:22:25.160267    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs podName:bb11cdb7-08b9-46e4-9d53-eb8092841c48 nodeName:}" failed. No retries permitted until 2026-09-09 15:24:27.16025148 +0000 UTC m=+251.350454220 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs") pod "network-metrics-daemon-zwx9l" (UID: "bb11cdb7-08b9-46e4-9d53-eb8092841c48") : secret "metrics-daemon-secret" not found
Sep 09 15:22:52.734746 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:22:52.734686    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vktxv" podUID="a49acd86-0f4f-4da1-a9bc-c4cde626c7cd"
Sep 09 15:22:52.788884 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:22:52.788835    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vktxv"
Sep 09 15:22:54.343358 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:22:54.343318    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:22:57.587279 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:22:57.587239    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:22:57.587670 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:22:57.587366    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:22:57.587670 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:22:57.587434    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls podName:a49acd86-0f4f-4da1-a9bc-c4cde626c7cd nodeName:}" failed. No retries permitted until 2026-09-09 15:24:59.587418008 +0000 UTC m=+283.777620736 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls") pod "dns-default-vktxv" (UID: "a49acd86-0f4f-4da1-a9bc-c4cde626c7cd") : secret "dns-default-metrics-tls" not found
Sep 09 15:23:09.314546 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:23:09.314506    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:23:35.894306 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:23:35.894272    2574 generic.go:356] "Generic (PLEG): container finished" podID="3a5cc473-95f9-49d2-a0a1-becb24f4d24a" containerID="9659a299919a775cdda4b1dff01e724bcaebc952fa02f65bc3a3bcdea5273054" exitCode=1
Sep 09 15:23:35.894730 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:23:35.894347    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5" event={"ID":"3a5cc473-95f9-49d2-a0a1-becb24f4d24a","Type":"ContainerDied","Data":"9659a299919a775cdda4b1dff01e724bcaebc952fa02f65bc3a3bcdea5273054"}
Sep 09 15:23:35.894730 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:23:35.894677    2574 scope.go:117] "RemoveContainer" containerID="9659a299919a775cdda4b1dff01e724bcaebc952fa02f65bc3a3bcdea5273054"
Sep 09 15:23:36.605148 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:23:36.605099    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"
Sep 09 15:23:36.902194 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:23:36.902106    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5" event={"ID":"3a5cc473-95f9-49d2-a0a1-becb24f4d24a","Type":"ContainerStarted","Data":"94457cd2ea94051ccf9f2c1b40681b503fc205cba3552a0a9759461469c4a35c"}
Sep 09 15:23:36.902609 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:23:36.902339    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"
Sep 09 15:23:36.902915 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:23:36.902897    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cf9bcc554-sgnt5"
Sep 09 15:24:10.418866 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.418818    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5cbf75df6d-qr6fh"]
Sep 09 15:24:10.422107 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.422082    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5855854ddc-mg7md"]
Sep 09 15:24:10.422241 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.422191    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:10.424565 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.424540    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 09 15:24:10.424811 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.424791    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hcsp8\""
Sep 09 15:24:10.424895 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.424791    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 09 15:24:10.424895 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.424791    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 09 15:24:10.425075 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.425060    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.425172 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.425155    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 15:24:10.425320 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.425300    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 09 15:24:10.425424 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.425409    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 15:24:10.428108 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.428088    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 15:24:10.428241 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.428129    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pzhsz\""
Sep 09 15:24:10.428241 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.428201    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 15:24:10.428352 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.428285    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 15:24:10.435904 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.435881    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 15:24:10.438693 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.438667    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5cbf75df6d-qr6fh"]
Sep 09 15:24:10.442106 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.442083    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5855854ddc-mg7md"]
Sep 09 15:24:10.489939 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.489903    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:10.489939 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.489939    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-certificates\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.490206 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.489992    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-default-certificate\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:10.490206 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.490047    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjctq\" (UniqueName: \"kubernetes.io/projected/c070c187-ebec-4aed-a8dd-333df054bea6-kube-api-access-sjctq\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:10.490206 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.490067    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/470088f9-5cb7-4c95-8c03-aff7448bf15c-installation-pull-secrets\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.490206 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.490088    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-bound-sa-token\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.490206 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.490121    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-stats-auth\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:10.490206 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.490136    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/470088f9-5cb7-4c95-8c03-aff7448bf15c-image-registry-private-configuration\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.490206 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.490152    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/470088f9-5cb7-4c95-8c03-aff7448bf15c-ca-trust-extracted\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.490206 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.490166    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/470088f9-5cb7-4c95-8c03-aff7448bf15c-trusted-ca\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.490206 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.490184    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.490206 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.490203    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:10.490628 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.490245    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92jbv\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-kube-api-access-92jbv\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.507993 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.507961    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-84lnc"]
Sep 09 15:24:10.510896 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.510871    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-84lnc"
Sep 09 15:24:10.514002 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.513950    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 09 15:24:10.514156 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.514134    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 09 15:24:10.514156 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.514150    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-jbpss\""
Sep 09 15:24:10.515173 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.515149    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk"]
Sep 09 15:24:10.518186 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.518161    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk"
Sep 09 15:24:10.518303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.518189    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95"]
Sep 09 15:24:10.521011 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.520979    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 09 15:24:10.521168 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.521092    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 09 15:24:10.521168 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.521124    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qpgcr\""
Sep 09 15:24:10.521354 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.521337    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 09 15:24:10.521416 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.521389    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 09 15:24:10.521624 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.521611    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-ztdgm"]
Sep 09 15:24:10.521744 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.521730    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95"
Sep 09 15:24:10.524269 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.524247    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 09 15:24:10.524532 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.524249    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 09 15:24:10.524532 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.524358    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 09 15:24:10.524532 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.524305    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4vmhj\""
Sep 09 15:24:10.524710 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.524563    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 09 15:24:10.524710 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.524576    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-84lnc"]
Sep 09 15:24:10.524710 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.524664    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.528302 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.528286    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 09 15:24:10.528405 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.528353    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 15:24:10.528467 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.528452    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fp5pz\""
Sep 09 15:24:10.529081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.529062    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 15:24:10.529178 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.529136    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 09 15:24:10.529603 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.529585    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95"]
Sep 09 15:24:10.534037 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.533981    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk"]
Sep 09 15:24:10.539685 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.539633    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 09 15:24:10.546190 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.546162    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-ztdgm"]
Sep 09 15:24:10.590797 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.590765    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92jbv\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-kube-api-access-92jbv\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.590797 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.590800    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:10.591097 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.590821    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-certificates\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.591097 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.590865    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-stats-auth\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:10.591097 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.590884    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/470088f9-5cb7-4c95-8c03-aff7448bf15c-trusted-ca\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.591097 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.590914    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftckz\" (UniqueName: \"kubernetes.io/projected/66a08337-e7c8-49a2-a47e-f4f78164e781-kube-api-access-ftckz\") pod \"volume-data-source-validator-695c895bd6-84lnc\" (UID: \"66a08337-e7c8-49a2-a47e-f4f78164e781\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-84lnc"
Sep 09 15:24:10.591097 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.590942    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjctq\" (UniqueName: \"kubernetes.io/projected/c070c187-ebec-4aed-a8dd-333df054bea6-kube-api-access-sjctq\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:10.591097 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.590968    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-674vx\" (UniqueName: \"kubernetes.io/projected/a4a00a5e-1b35-450a-bc80-ec5836f1fdc2-kube-api-access-674vx\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kwpmk\" (UID: \"a4a00a5e-1b35-450a-bc80-ec5836f1fdc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk"
Sep 09 15:24:10.591097 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:10.590986    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle podName:c070c187-ebec-4aed-a8dd-333df054bea6 nodeName:}" failed. No retries permitted until 2026-09-09 15:24:11.090967686 +0000 UTC m=+235.281170413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle") pod "router-default-5cbf75df6d-qr6fh" (UID: "c070c187-ebec-4aed-a8dd-333df054bea6") : configmap references non-existent config key: service-ca.crt
Sep 09 15:24:10.591097 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591040    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/470088f9-5cb7-4c95-8c03-aff7448bf15c-image-registry-private-configuration\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.591097 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591072    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4a00a5e-1b35-450a-bc80-ec5836f1fdc2-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kwpmk\" (UID: \"a4a00a5e-1b35-450a-bc80-ec5836f1fdc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk"
Sep 09 15:24:10.591097 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591101    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ca22521-7db4-4b88-86b0-c2f39cc29d06-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.591569 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591128    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.591569 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591159    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:10.591569 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591191    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0546f45-e4aa-4d46-8b43-1b74ba1cc97c-serving-cert\") pod \"service-ca-operator-859f94c4b-qkx95\" (UID: \"a0546f45-e4aa-4d46-8b43-1b74ba1cc97c\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95"
Sep 09 15:24:10.591569 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591227    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4a00a5e-1b35-450a-bc80-ec5836f1fdc2-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kwpmk\" (UID: \"a4a00a5e-1b35-450a-bc80-ec5836f1fdc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk"
Sep 09 15:24:10.591569 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:10.591238    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 15:24:10.591569 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:10.591252    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5855854ddc-mg7md: secret "image-registry-tls" not found
Sep 09 15:24:10.591569 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:10.591317    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 15:24:10.591569 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:10.591363    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls podName:470088f9-5cb7-4c95-8c03-aff7448bf15c nodeName:}" failed. No retries permitted until 2026-09-09 15:24:11.091348869 +0000 UTC m=+235.281551609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls") pod "image-registry-5855854ddc-mg7md" (UID: "470088f9-5cb7-4c95-8c03-aff7448bf15c") : secret "image-registry-tls" not found
Sep 09 15:24:10.591569 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:10.591402    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs podName:c070c187-ebec-4aed-a8dd-333df054bea6 nodeName:}" failed. No retries permitted until 2026-09-09 15:24:11.091381582 +0000 UTC m=+235.281584326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs") pod "router-default-5cbf75df6d-qr6fh" (UID: "c070c187-ebec-4aed-a8dd-333df054bea6") : secret "router-metrics-certs-default" not found
Sep 09 15:24:10.591569 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591464    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ca22521-7db4-4b88-86b0-c2f39cc29d06-tmp\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.591569 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591498    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-default-certificate\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:10.591569 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591502    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-certificates\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.591569 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591532    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5jkw\" (UniqueName: \"kubernetes.io/projected/a0546f45-e4aa-4d46-8b43-1b74ba1cc97c-kube-api-access-f5jkw\") pod \"service-ca-operator-859f94c4b-qkx95\" (UID: \"a0546f45-e4aa-4d46-8b43-1b74ba1cc97c\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95"
Sep 09 15:24:10.591569 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591564    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/470088f9-5cb7-4c95-8c03-aff7448bf15c-ca-trust-extracted\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.592235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591603    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/470088f9-5cb7-4c95-8c03-aff7448bf15c-installation-pull-secrets\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.592235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591630    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ca22521-7db4-4b88-86b0-c2f39cc29d06-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.592235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591658    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-bound-sa-token\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.592235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591682    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0546f45-e4aa-4d46-8b43-1b74ba1cc97c-config\") pod \"service-ca-operator-859f94c4b-qkx95\" (UID: \"a0546f45-e4aa-4d46-8b43-1b74ba1cc97c\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95"
Sep 09 15:24:10.592235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591714    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1ca22521-7db4-4b88-86b0-c2f39cc29d06-serving-cert\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.592235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591739    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7k7b\" (UniqueName: \"kubernetes.io/projected/1ca22521-7db4-4b88-86b0-c2f39cc29d06-kube-api-access-t7k7b\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.592235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591767    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1ca22521-7db4-4b88-86b0-c2f39cc29d06-snapshots\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.592235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.591911    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/470088f9-5cb7-4c95-8c03-aff7448bf15c-ca-trust-extracted\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.592235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.592134    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/470088f9-5cb7-4c95-8c03-aff7448bf15c-trusted-ca\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.593859 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.593819    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-stats-auth\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:10.594308 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.594277    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/470088f9-5cb7-4c95-8c03-aff7448bf15c-installation-pull-secrets\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.594400 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.594316    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/470088f9-5cb7-4c95-8c03-aff7448bf15c-image-registry-private-configuration\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.594446 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.594396    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-default-certificate\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:10.600101 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.600077    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92jbv\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-kube-api-access-92jbv\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.600264 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.600238    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-bound-sa-token\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:10.600547 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.600530    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjctq\" (UniqueName: \"kubernetes.io/projected/c070c187-ebec-4aed-a8dd-333df054bea6-kube-api-access-sjctq\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:10.692413 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.692384    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftckz\" (UniqueName: \"kubernetes.io/projected/66a08337-e7c8-49a2-a47e-f4f78164e781-kube-api-access-ftckz\") pod \"volume-data-source-validator-695c895bd6-84lnc\" (UID: \"66a08337-e7c8-49a2-a47e-f4f78164e781\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-84lnc"
Sep 09 15:24:10.692578 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.692418    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-674vx\" (UniqueName: \"kubernetes.io/projected/a4a00a5e-1b35-450a-bc80-ec5836f1fdc2-kube-api-access-674vx\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kwpmk\" (UID: \"a4a00a5e-1b35-450a-bc80-ec5836f1fdc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk"
Sep 09 15:24:10.692578 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.692439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4a00a5e-1b35-450a-bc80-ec5836f1fdc2-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kwpmk\" (UID: \"a4a00a5e-1b35-450a-bc80-ec5836f1fdc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk"
Sep 09 15:24:10.692698 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.692574    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ca22521-7db4-4b88-86b0-c2f39cc29d06-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.692698 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.692661    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0546f45-e4aa-4d46-8b43-1b74ba1cc97c-serving-cert\") pod \"service-ca-operator-859f94c4b-qkx95\" (UID: \"a0546f45-e4aa-4d46-8b43-1b74ba1cc97c\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95"
Sep 09 15:24:10.692794 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.692696    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4a00a5e-1b35-450a-bc80-ec5836f1fdc2-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kwpmk\" (UID: \"a4a00a5e-1b35-450a-bc80-ec5836f1fdc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk"
Sep 09 15:24:10.692794 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.692747    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ca22521-7db4-4b88-86b0-c2f39cc29d06-tmp\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.692927 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.692795    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5jkw\" (UniqueName: \"kubernetes.io/projected/a0546f45-e4aa-4d46-8b43-1b74ba1cc97c-kube-api-access-f5jkw\") pod \"service-ca-operator-859f94c4b-qkx95\" (UID: \"a0546f45-e4aa-4d46-8b43-1b74ba1cc97c\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95"
Sep 09 15:24:10.692927 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.692869    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ca22521-7db4-4b88-86b0-c2f39cc29d06-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.692927 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.692901    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0546f45-e4aa-4d46-8b43-1b74ba1cc97c-config\") pod \"service-ca-operator-859f94c4b-qkx95\" (UID: \"a0546f45-e4aa-4d46-8b43-1b74ba1cc97c\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95"
Sep 09 15:24:10.693073 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.692932    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1ca22521-7db4-4b88-86b0-c2f39cc29d06-serving-cert\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.693073 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.692958    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7k7b\" (UniqueName: \"kubernetes.io/projected/1ca22521-7db4-4b88-86b0-c2f39cc29d06-kube-api-access-t7k7b\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.693073 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.692985    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1ca22521-7db4-4b88-86b0-c2f39cc29d06-snapshots\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.693272 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.693250    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ca22521-7db4-4b88-86b0-c2f39cc29d06-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.693355 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.693272    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ca22521-7db4-4b88-86b0-c2f39cc29d06-tmp\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.693355 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.693298    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4a00a5e-1b35-450a-bc80-ec5836f1fdc2-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kwpmk\" (UID: \"a4a00a5e-1b35-450a-bc80-ec5836f1fdc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk"
Sep 09 15:24:10.693723 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.693700    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1ca22521-7db4-4b88-86b0-c2f39cc29d06-snapshots\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.693862 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.693818    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0546f45-e4aa-4d46-8b43-1b74ba1cc97c-config\") pod \"service-ca-operator-859f94c4b-qkx95\" (UID: \"a0546f45-e4aa-4d46-8b43-1b74ba1cc97c\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95"
Sep 09 15:24:10.694162 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.693949    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ca22521-7db4-4b88-86b0-c2f39cc29d06-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.695090 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.695064    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4a00a5e-1b35-450a-bc80-ec5836f1fdc2-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kwpmk\" (UID: \"a4a00a5e-1b35-450a-bc80-ec5836f1fdc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk"
Sep 09 15:24:10.695199 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.695072    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0546f45-e4aa-4d46-8b43-1b74ba1cc97c-serving-cert\") pod \"service-ca-operator-859f94c4b-qkx95\" (UID: \"a0546f45-e4aa-4d46-8b43-1b74ba1cc97c\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95"
Sep 09 15:24:10.695590 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.695575    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1ca22521-7db4-4b88-86b0-c2f39cc29d06-serving-cert\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.701466 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.701430    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-674vx\" (UniqueName: \"kubernetes.io/projected/a4a00a5e-1b35-450a-bc80-ec5836f1fdc2-kube-api-access-674vx\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kwpmk\" (UID: \"a4a00a5e-1b35-450a-bc80-ec5836f1fdc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk"
Sep 09 15:24:10.701579 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.701453    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5jkw\" (UniqueName: \"kubernetes.io/projected/a0546f45-e4aa-4d46-8b43-1b74ba1cc97c-kube-api-access-f5jkw\") pod \"service-ca-operator-859f94c4b-qkx95\" (UID: \"a0546f45-e4aa-4d46-8b43-1b74ba1cc97c\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95"
Sep 09 15:24:10.701579 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.701535    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftckz\" (UniqueName: \"kubernetes.io/projected/66a08337-e7c8-49a2-a47e-f4f78164e781-kube-api-access-ftckz\") pod \"volume-data-source-validator-695c895bd6-84lnc\" (UID: \"66a08337-e7c8-49a2-a47e-f4f78164e781\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-84lnc"
Sep 09 15:24:10.702117 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.702100    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7k7b\" (UniqueName: \"kubernetes.io/projected/1ca22521-7db4-4b88-86b0-c2f39cc29d06-kube-api-access-t7k7b\") pod \"insights-operator-76bcd6ccf5-ztdgm\" (UID: \"1ca22521-7db4-4b88-86b0-c2f39cc29d06\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:10.821440 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.821384    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-84lnc"
Sep 09 15:24:10.829684 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.829661    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk"
Sep 09 15:24:10.841619 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.841593    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95"
Sep 09 15:24:10.847686 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:10.847653    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm"
Sep 09 15:24:11.094654 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:11.094579    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-84lnc"]
Sep 09 15:24:11.097451 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:11.097426    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:11.097569 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:11.097459    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:11.097569 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:24:11.097511    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a08337_e7c8_49a2_a47e_f4f78164e781.slice/crio-f814d00316a3c42dba1886706f616fa728c21db449efb71f204914d2515f158e WatchSource:0}: Error finding container f814d00316a3c42dba1886706f616fa728c21db449efb71f204914d2515f158e: Status 404 returned error can't find the container with id f814d00316a3c42dba1886706f616fa728c21db449efb71f204914d2515f158e
Sep 09 15:24:11.097689 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:11.097575    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 15:24:11.097689 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:11.097582    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 15:24:11.097689 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:11.097597    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5855854ddc-mg7md: secret "image-registry-tls" not found
Sep 09 15:24:11.097689 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:11.097650    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs podName:c070c187-ebec-4aed-a8dd-333df054bea6 nodeName:}" failed. No retries permitted until 2026-09-09 15:24:12.097628926 +0000 UTC m=+236.287831661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs") pod "router-default-5cbf75df6d-qr6fh" (UID: "c070c187-ebec-4aed-a8dd-333df054bea6") : secret "router-metrics-certs-default" not found
Sep 09 15:24:11.097689 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:11.097682    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls podName:470088f9-5cb7-4c95-8c03-aff7448bf15c nodeName:}" failed. No retries permitted until 2026-09-09 15:24:12.097672049 +0000 UTC m=+236.287874778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls") pod "image-registry-5855854ddc-mg7md" (UID: "470088f9-5cb7-4c95-8c03-aff7448bf15c") : secret "image-registry-tls" not found
Sep 09 15:24:11.097916 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:11.097729    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:11.097916 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:11.097792    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle podName:c070c187-ebec-4aed-a8dd-333df054bea6 nodeName:}" failed. No retries permitted until 2026-09-09 15:24:12.097777376 +0000 UTC m=+236.287980116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle") pod "router-default-5cbf75df6d-qr6fh" (UID: "c070c187-ebec-4aed-a8dd-333df054bea6") : configmap references non-existent config key: service-ca.crt
Sep 09 15:24:11.121238 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:11.121207    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95"]
Sep 09 15:24:11.124152 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:24:11.124112    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0546f45_e4aa_4d46_8b43_1b74ba1cc97c.slice/crio-51b57d089c555b437a5c5a0dfe87fb72b4be0b11f35bf72dd00b96a8c50da38e WatchSource:0}: Error finding container 51b57d089c555b437a5c5a0dfe87fb72b4be0b11f35bf72dd00b96a8c50da38e: Status 404 returned error can't find the container with id 51b57d089c555b437a5c5a0dfe87fb72b4be0b11f35bf72dd00b96a8c50da38e
Sep 09 15:24:11.124963 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:11.124942    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk"]
Sep 09 15:24:11.128064 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:24:11.128040    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4a00a5e_1b35_450a_bc80_ec5836f1fdc2.slice/crio-e3a61fbe001f6e1ab4825111b1f42f6bad2f1a020b5e3c6be159f08cb7ae7c4f WatchSource:0}: Error finding container e3a61fbe001f6e1ab4825111b1f42f6bad2f1a020b5e3c6be159f08cb7ae7c4f: Status 404 returned error can't find the container with id e3a61fbe001f6e1ab4825111b1f42f6bad2f1a020b5e3c6be159f08cb7ae7c4f
Sep 09 15:24:11.145038 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:11.145008    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-ztdgm"]
Sep 09 15:24:11.147661 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:24:11.147632    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca22521_7db4_4b88_86b0_c2f39cc29d06.slice/crio-a407ceee4a04cba257e91558529019e2aefcd7d2cc65294a6adfa58ed017ca0b WatchSource:0}: Error finding container a407ceee4a04cba257e91558529019e2aefcd7d2cc65294a6adfa58ed017ca0b: Status 404 returned error can't find the container with id a407ceee4a04cba257e91558529019e2aefcd7d2cc65294a6adfa58ed017ca0b
Sep 09 15:24:11.991303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:11.991264    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm" event={"ID":"1ca22521-7db4-4b88-86b0-c2f39cc29d06","Type":"ContainerStarted","Data":"a407ceee4a04cba257e91558529019e2aefcd7d2cc65294a6adfa58ed017ca0b"}
Sep 09 15:24:11.993021 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:11.992988    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95" event={"ID":"a0546f45-e4aa-4d46-8b43-1b74ba1cc97c","Type":"ContainerStarted","Data":"51b57d089c555b437a5c5a0dfe87fb72b4be0b11f35bf72dd00b96a8c50da38e"}
Sep 09 15:24:11.995538 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:11.995473    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-84lnc" event={"ID":"66a08337-e7c8-49a2-a47e-f4f78164e781","Type":"ContainerStarted","Data":"f814d00316a3c42dba1886706f616fa728c21db449efb71f204914d2515f158e"}
Sep 09 15:24:11.996874 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:11.996827    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk" event={"ID":"a4a00a5e-1b35-450a-bc80-ec5836f1fdc2","Type":"ContainerStarted","Data":"e3a61fbe001f6e1ab4825111b1f42f6bad2f1a020b5e3c6be159f08cb7ae7c4f"}
Sep 09 15:24:12.107997 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:12.107939    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:12.108186 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:12.108020    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:12.108186 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:12.108137    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 15:24:12.108186 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:12.108155    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5855854ddc-mg7md: secret "image-registry-tls" not found
Sep 09 15:24:12.108186 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:12.108166    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:12.108375 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:12.108209    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls podName:470088f9-5cb7-4c95-8c03-aff7448bf15c nodeName:}" failed. No retries permitted until 2026-09-09 15:24:14.108189242 +0000 UTC m=+238.298391980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls") pod "image-registry-5855854ddc-mg7md" (UID: "470088f9-5cb7-4c95-8c03-aff7448bf15c") : secret "image-registry-tls" not found
Sep 09 15:24:12.108375 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:12.108237    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle podName:c070c187-ebec-4aed-a8dd-333df054bea6 nodeName:}" failed. No retries permitted until 2026-09-09 15:24:14.108225219 +0000 UTC m=+238.298427950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle") pod "router-default-5cbf75df6d-qr6fh" (UID: "c070c187-ebec-4aed-a8dd-333df054bea6") : configmap references non-existent config key: service-ca.crt
Sep 09 15:24:12.108375 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:12.108269    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 15:24:12.108375 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:12.108326    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs podName:c070c187-ebec-4aed-a8dd-333df054bea6 nodeName:}" failed. No retries permitted until 2026-09-09 15:24:14.108309784 +0000 UTC m=+238.298512524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs") pod "router-default-5cbf75df6d-qr6fh" (UID: "c070c187-ebec-4aed-a8dd-333df054bea6") : secret "router-metrics-certs-default" not found
Sep 09 15:24:13.002871 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:13.002814    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-84lnc" event={"ID":"66a08337-e7c8-49a2-a47e-f4f78164e781","Type":"ContainerStarted","Data":"9d0ed700725830237ed2c75039a8631f987a4636d86642d2490d1f64c0c330f7"}
Sep 09 15:24:13.018328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:13.018262    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-84lnc" podStartSLOduration=1.900328636 podStartE2EDuration="3.018240736s" totalImagesPullingTime="1.1179121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:24:13.017145664 +0000 UTC m=+237.207348438" watchObservedRunningTime="2026-09-09 15:24:13.018240736 +0000 UTC m=+237.208443489"
Sep 09 15:24:14.125898 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:14.125860    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:14.126388 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:14.125934    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:14.126388 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:14.125954    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:14.126388 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:14.126043    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 15:24:14.126388 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:14.126052    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle podName:c070c187-ebec-4aed-a8dd-333df054bea6 nodeName:}" failed. No retries permitted until 2026-09-09 15:24:18.126035023 +0000 UTC m=+242.316237754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle") pod "router-default-5cbf75df6d-qr6fh" (UID: "c070c187-ebec-4aed-a8dd-333df054bea6") : configmap references non-existent config key: service-ca.crt
Sep 09 15:24:14.126388 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:14.126052    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 15:24:14.126388 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:14.126089    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5855854ddc-mg7md: secret "image-registry-tls" not found
Sep 09 15:24:14.126388 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:14.126091    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs podName:c070c187-ebec-4aed-a8dd-333df054bea6 nodeName:}" failed. No retries permitted until 2026-09-09 15:24:18.126078569 +0000 UTC m=+242.316281297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs") pod "router-default-5cbf75df6d-qr6fh" (UID: "c070c187-ebec-4aed-a8dd-333df054bea6") : secret "router-metrics-certs-default" not found
Sep 09 15:24:14.126388 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:14.126118    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls podName:470088f9-5cb7-4c95-8c03-aff7448bf15c nodeName:}" failed. No retries permitted until 2026-09-09 15:24:18.126107659 +0000 UTC m=+242.316310387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls") pod "image-registry-5855854ddc-mg7md" (UID: "470088f9-5cb7-4c95-8c03-aff7448bf15c") : secret "image-registry-tls" not found
Sep 09 15:24:15.011610 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.011563    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm" event={"ID":"1ca22521-7db4-4b88-86b0-c2f39cc29d06","Type":"ContainerStarted","Data":"9badf42d101648af8c1dfa69d3391268bdac0f1677b0caabbba2bdd4210c46bd"}
Sep 09 15:24:15.013469 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.013432    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95" event={"ID":"a0546f45-e4aa-4d46-8b43-1b74ba1cc97c","Type":"ContainerStarted","Data":"0929db24af2929b3a1b872c36c621b521032b10624bf1ef8465a4e5b73131b6d"}
Sep 09 15:24:15.015171 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.015144    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk" event={"ID":"a4a00a5e-1b35-450a-bc80-ec5836f1fdc2","Type":"ContainerStarted","Data":"d4fa582ec69757bc90e4c12deffd38cdfbc68dc85c0a748cd10001a837d840f4"}
Sep 09 15:24:15.027375 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.027316    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm" podStartSLOduration=1.782902204 podStartE2EDuration="5.027296601s" totalImagesPullingTime="3.244394397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:24:15.026621013 +0000 UTC m=+239.216823763" watchObservedRunningTime="2026-09-09 15:24:15.027296601 +0000 UTC m=+239.217499355"
Sep 09 15:24:15.042630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.042570    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk" podStartSLOduration=1.7796371770000001 podStartE2EDuration="5.042551046s" totalImagesPullingTime="3.262913869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:24:15.042491087 +0000 UTC m=+239.232693862" watchObservedRunningTime="2026-09-09 15:24:15.042551046 +0000 UTC m=+239.232753806"
Sep 09 15:24:15.060982 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.060922    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95" podStartSLOduration=1.800512694 podStartE2EDuration="5.060900451s" totalImagesPullingTime="3.260387757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:24:15.059312256 +0000 UTC m=+239.249515007" watchObservedRunningTime="2026-09-09 15:24:15.060900451 +0000 UTC m=+239.251103202"
Sep 09 15:24:15.637700 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.637658    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dnlpg"]
Sep 09 15:24:15.642168 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.642143    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:15.644472 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.644444    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 15:24:15.644606 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.644521    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 15:24:15.644606 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.644578    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6tbnq\""
Sep 09 15:24:15.651381 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.651356    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dnlpg"]
Sep 09 15:24:15.743069 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.743026    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n49t\" (UniqueName: \"kubernetes.io/projected/50242e37-ff31-411e-889c-8e547eeac38c-kube-api-access-9n49t\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:15.743240 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.743129    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:15.743240 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.743157    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:15.743240 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.743187    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/50242e37-ff31-411e-889c-8e547eeac38c-crio-socket\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:15.743240 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.743210    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/50242e37-ff31-411e-889c-8e547eeac38c-data-volume\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:15.843800 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.843768    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/50242e37-ff31-411e-889c-8e547eeac38c-crio-socket\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:15.843800 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.843802    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/50242e37-ff31-411e-889c-8e547eeac38c-data-volume\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:15.844008 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.843887    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n49t\" (UniqueName: \"kubernetes.io/projected/50242e37-ff31-411e-889c-8e547eeac38c-kube-api-access-9n49t\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:15.844008 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.843911    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/50242e37-ff31-411e-889c-8e547eeac38c-crio-socket\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:15.844008 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.843991    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:15.844167 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.844018    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:15.844167 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:15.844124    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 15:24:15.844167 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:15.844142    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 15:24:15.844288 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.844177    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/50242e37-ff31-411e-889c-8e547eeac38c-data-volume\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:15.844288 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:15.844191    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls podName:50242e37-ff31-411e-889c-8e547eeac38c nodeName:}" failed. No retries permitted until 2026-09-09 15:24:16.344177483 +0000 UTC m=+240.534380210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnlpg" (UID: "50242e37-ff31-411e-889c-8e547eeac38c") : secret "insights-runtime-extractor-tls" not found
Sep 09 15:24:15.844288 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:15.844203    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm podName:50242e37-ff31-411e-889c-8e547eeac38c nodeName:}" failed. No retries permitted until 2026-09-09 15:24:16.344197639 +0000 UTC m=+240.534400366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dnlpg" (UID: "50242e37-ff31-411e-889c-8e547eeac38c") : configmap "kube-rbac-proxy" not found
Sep 09 15:24:15.852383 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:15.852351    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n49t\" (UniqueName: \"kubernetes.io/projected/50242e37-ff31-411e-889c-8e547eeac38c-kube-api-access-9n49t\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:16.348030 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:16.347994    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:16.348030 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:16.348035    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:16.348319 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:16.348109    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 15:24:16.348319 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:16.348131    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 15:24:16.348319 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:16.348168    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm podName:50242e37-ff31-411e-889c-8e547eeac38c nodeName:}" failed. No retries permitted until 2026-09-09 15:24:17.348152054 +0000 UTC m=+241.538354785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dnlpg" (UID: "50242e37-ff31-411e-889c-8e547eeac38c") : configmap "kube-rbac-proxy" not found
Sep 09 15:24:16.348319 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:16.348181    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls podName:50242e37-ff31-411e-889c-8e547eeac38c nodeName:}" failed. No retries permitted until 2026-09-09 15:24:17.348174938 +0000 UTC m=+241.538377665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnlpg" (UID: "50242e37-ff31-411e-889c-8e547eeac38c") : secret "insights-runtime-extractor-tls" not found
Sep 09 15:24:17.356632 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:17.356589    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:17.356632 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:17.356636    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:17.357103 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:17.356714    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 15:24:17.357103 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:17.356781    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm podName:50242e37-ff31-411e-889c-8e547eeac38c nodeName:}" failed. No retries permitted until 2026-09-09 15:24:19.356765407 +0000 UTC m=+243.546968147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dnlpg" (UID: "50242e37-ff31-411e-889c-8e547eeac38c") : configmap "kube-rbac-proxy" not found
Sep 09 15:24:17.357103 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:17.356781    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 15:24:17.357103 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:17.356825    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls podName:50242e37-ff31-411e-889c-8e547eeac38c nodeName:}" failed. No retries permitted until 2026-09-09 15:24:19.356812558 +0000 UTC m=+243.547015289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnlpg" (UID: "50242e37-ff31-411e-889c-8e547eeac38c") : secret "insights-runtime-extractor-tls" not found
Sep 09 15:24:17.398831 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:17.398803    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hvcjr_f944d3c3-de09-4122-9d8e-06c805dc429d/dns-node-resolver/0.log"
Sep 09 15:24:18.163980 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:18.163937    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:18.164153 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:18.164030    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:18.164153 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:18.164063    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:18.164153 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:18.164106    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle podName:c070c187-ebec-4aed-a8dd-333df054bea6 nodeName:}" failed. No retries permitted until 2026-09-09 15:24:26.164087319 +0000 UTC m=+250.354290045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle") pod "router-default-5cbf75df6d-qr6fh" (UID: "c070c187-ebec-4aed-a8dd-333df054bea6") : configmap references non-existent config key: service-ca.crt
Sep 09 15:24:18.164282 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:18.164158    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 15:24:18.164282 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:18.164165    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 15:24:18.164282 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:18.164183    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5855854ddc-mg7md: secret "image-registry-tls" not found
Sep 09 15:24:18.164282 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:18.164212    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs podName:c070c187-ebec-4aed-a8dd-333df054bea6 nodeName:}" failed. No retries permitted until 2026-09-09 15:24:26.164198364 +0000 UTC m=+250.354401092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs") pod "router-default-5cbf75df6d-qr6fh" (UID: "c070c187-ebec-4aed-a8dd-333df054bea6") : secret "router-metrics-certs-default" not found
Sep 09 15:24:18.164282 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:18.164234    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls podName:470088f9-5cb7-4c95-8c03-aff7448bf15c nodeName:}" failed. No retries permitted until 2026-09-09 15:24:26.164219416 +0000 UTC m=+250.354422169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls") pod "image-registry-5855854ddc-mg7md" (UID: "470088f9-5cb7-4c95-8c03-aff7448bf15c") : secret "image-registry-tls" not found
Sep 09 15:24:18.600938 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:18.600907    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qzwm8_75b69fbd-fc53-47f8-a9d6-d7627959fe2d/node-ca/0.log"
Sep 09 15:24:19.198450 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:19.198420    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5qktk_aef7e653-f35f-4cef-8e0a-42c2fd191106/serve-healthcheck-canary/0.log"
Sep 09 15:24:19.374486 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:19.374450    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:19.374486 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:19.374490    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:19.374702 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:19.374571    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 15:24:19.374702 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:19.374584    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 15:24:19.374702 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:19.374634    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls podName:50242e37-ff31-411e-889c-8e547eeac38c nodeName:}" failed. No retries permitted until 2026-09-09 15:24:23.374621225 +0000 UTC m=+247.564823955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnlpg" (UID: "50242e37-ff31-411e-889c-8e547eeac38c") : secret "insights-runtime-extractor-tls" not found
Sep 09 15:24:19.374702 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:19.374647    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm podName:50242e37-ff31-411e-889c-8e547eeac38c nodeName:}" failed. No retries permitted until 2026-09-09 15:24:23.374640713 +0000 UTC m=+247.564843439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dnlpg" (UID: "50242e37-ff31-411e-889c-8e547eeac38c") : configmap "kube-rbac-proxy" not found
Sep 09 15:24:23.411339 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:23.411301    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:23.411724 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:23.411351    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:23.411724 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:23.411457    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 15:24:23.411724 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:23.411465    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 15:24:23.411724 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:23.411526    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm podName:50242e37-ff31-411e-889c-8e547eeac38c nodeName:}" failed. No retries permitted until 2026-09-09 15:24:31.411509551 +0000 UTC m=+255.601712282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dnlpg" (UID: "50242e37-ff31-411e-889c-8e547eeac38c") : configmap "kube-rbac-proxy" not found
Sep 09 15:24:23.411724 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:23.411541    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls podName:50242e37-ff31-411e-889c-8e547eeac38c nodeName:}" failed. No retries permitted until 2026-09-09 15:24:31.411534419 +0000 UTC m=+255.601737146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnlpg" (UID: "50242e37-ff31-411e-889c-8e547eeac38c") : secret "insights-runtime-extractor-tls" not found
Sep 09 15:24:26.237341 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:26.237302    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:26.237714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:26.237364    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:26.237714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:26.237383    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:26.237714 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:26.237474    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle podName:c070c187-ebec-4aed-a8dd-333df054bea6 nodeName:}" failed. No retries permitted until 2026-09-09 15:24:42.237454112 +0000 UTC m=+266.427656850 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle") pod "router-default-5cbf75df6d-qr6fh" (UID: "c070c187-ebec-4aed-a8dd-333df054bea6") : configmap references non-existent config key: service-ca.crt
Sep 09 15:24:26.237714 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:26.237511    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 15:24:26.237714 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:26.237558    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs podName:c070c187-ebec-4aed-a8dd-333df054bea6 nodeName:}" failed. No retries permitted until 2026-09-09 15:24:42.237546594 +0000 UTC m=+266.427749321 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs") pod "router-default-5cbf75df6d-qr6fh" (UID: "c070c187-ebec-4aed-a8dd-333df054bea6") : secret "router-metrics-certs-default" not found
Sep 09 15:24:26.239892 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:26.239836    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls\") pod \"image-registry-5855854ddc-mg7md\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") " pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:26.340738 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:26.340703    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pzhsz\""
Sep 09 15:24:26.348672 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:26.348647    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:26.629947 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:26.629864    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5855854ddc-mg7md"]
Sep 09 15:24:26.632614 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:24:26.632583    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod470088f9_5cb7_4c95_8c03_aff7448bf15c.slice/crio-78a98c62340de3eec299af5364087ed9767bc7d5c78746359e8ba597e392fb93 WatchSource:0}: Error finding container 78a98c62340de3eec299af5364087ed9767bc7d5c78746359e8ba597e392fb93: Status 404 returned error can't find the container with id 78a98c62340de3eec299af5364087ed9767bc7d5c78746359e8ba597e392fb93
Sep 09 15:24:27.054135 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:27.054103    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5855854ddc-mg7md" event={"ID":"470088f9-5cb7-4c95-8c03-aff7448bf15c","Type":"ContainerStarted","Data":"0c56ccfd326174cbd62090236d7d1a322fa7840c29ceedc09d62973b0b155773"}
Sep 09 15:24:27.054327 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:27.054159    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5855854ddc-mg7md" event={"ID":"470088f9-5cb7-4c95-8c03-aff7448bf15c","Type":"ContainerStarted","Data":"78a98c62340de3eec299af5364087ed9767bc7d5c78746359e8ba597e392fb93"}
Sep 09 15:24:27.054327 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:27.054217    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:24:27.074174 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:27.074125    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5855854ddc-mg7md" podStartSLOduration=17.074106849 podStartE2EDuration="17.074106849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:24:27.072788321 +0000 UTC m=+251.262991097" watchObservedRunningTime="2026-09-09 15:24:27.074106849 +0000 UTC m=+251.264309598"
Sep 09 15:24:27.245339 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:27.245286    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs\") pod \"network-metrics-daemon-zwx9l\" (UID: \"bb11cdb7-08b9-46e4-9d53-eb8092841c48\") " pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:24:27.245725 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:27.245448    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 15:24:27.245725 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:27.245522    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs podName:bb11cdb7-08b9-46e4-9d53-eb8092841c48 nodeName:}" failed. No retries permitted until 2026-09-09 15:26:29.245502785 +0000 UTC m=+373.435705512 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs") pod "network-metrics-daemon-zwx9l" (UID: "bb11cdb7-08b9-46e4-9d53-eb8092841c48") : secret "metrics-daemon-secret" not found
Sep 09 15:24:31.480015 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:31.479975    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:31.480015 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:31.480019    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:31.480434 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:31.480115    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 15:24:31.480434 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:31.480173    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls podName:50242e37-ff31-411e-889c-8e547eeac38c nodeName:}" failed. No retries permitted until 2026-09-09 15:24:47.480158541 +0000 UTC m=+271.670361267 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnlpg" (UID: "50242e37-ff31-411e-889c-8e547eeac38c") : secret "insights-runtime-extractor-tls" not found
Sep 09 15:24:31.480524 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:31.480472    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50242e37-ff31-411e-889c-8e547eeac38c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:37.290863 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:37.290773    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5855854ddc-mg7md"]
Sep 09 15:24:42.261510 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:42.261454    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:42.261949 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:42.261559    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:42.262194 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:42.262174    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c070c187-ebec-4aed-a8dd-333df054bea6-service-ca-bundle\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:42.264037 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:42.264017    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c070c187-ebec-4aed-a8dd-333df054bea6-metrics-certs\") pod \"router-default-5cbf75df6d-qr6fh\" (UID: \"c070c187-ebec-4aed-a8dd-333df054bea6\") " pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:42.535653 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:42.535575    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hcsp8\""
Sep 09 15:24:42.543820 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:42.543794    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:42.816458 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:42.816376    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5cbf75df6d-qr6fh"]
Sep 09 15:24:42.819008 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:24:42.818983    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc070c187_ebec_4aed_a8dd_333df054bea6.slice/crio-b35f8a1451ce39d17ebd0b900942eb7341e7c08fcd9f3faa62946aec41ec0b86 WatchSource:0}: Error finding container b35f8a1451ce39d17ebd0b900942eb7341e7c08fcd9f3faa62946aec41ec0b86: Status 404 returned error can't find the container with id b35f8a1451ce39d17ebd0b900942eb7341e7c08fcd9f3faa62946aec41ec0b86
Sep 09 15:24:43.112550 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:43.112459    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5cbf75df6d-qr6fh" event={"ID":"c070c187-ebec-4aed-a8dd-333df054bea6","Type":"ContainerStarted","Data":"58a91a736326c2096762e1b21cccdfa4e4823d39f3a0e67cd2f705a034982118"}
Sep 09 15:24:43.112550 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:43.112535    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5cbf75df6d-qr6fh" event={"ID":"c070c187-ebec-4aed-a8dd-333df054bea6","Type":"ContainerStarted","Data":"b35f8a1451ce39d17ebd0b900942eb7341e7c08fcd9f3faa62946aec41ec0b86"}
Sep 09 15:24:43.132290 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:43.132241    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5cbf75df6d-qr6fh" podStartSLOduration=33.132226532 podStartE2EDuration="33.132226532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:24:43.131679657 +0000 UTC m=+267.321882407" watchObservedRunningTime="2026-09-09 15:24:43.132226532 +0000 UTC m=+267.322429286"
Sep 09 15:24:43.544045 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:43.544008    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:43.546540 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:43.546512    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:44.116399 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:44.116356    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:44.117594 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:44.117572    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5cbf75df6d-qr6fh"
Sep 09 15:24:47.296147 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:47.296111    2574 patch_prober.go:28] interesting pod/image-registry-5855854ddc-mg7md container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 15:24:47.296523 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:47.296170    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5855854ddc-mg7md" podUID="470088f9-5cb7-4c95-8c03-aff7448bf15c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 15:24:47.504662 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:47.504617    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:47.507067 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:47.507044    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50242e37-ff31-411e-889c-8e547eeac38c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlpg\" (UID: \"50242e37-ff31-411e-889c-8e547eeac38c\") " pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:47.753999 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:47.753961    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6tbnq\""
Sep 09 15:24:47.762006 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:47.761980    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dnlpg"
Sep 09 15:24:48.032225 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:48.032148    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dnlpg"]
Sep 09 15:24:48.035377 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:24:48.035350    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50242e37_ff31_411e_889c_8e547eeac38c.slice/crio-4f1bbbcb1c7829483d7ca2cec06e7d13bbc1133b8a7a2332404fb85f116adeed WatchSource:0}: Error finding container 4f1bbbcb1c7829483d7ca2cec06e7d13bbc1133b8a7a2332404fb85f116adeed: Status 404 returned error can't find the container with id 4f1bbbcb1c7829483d7ca2cec06e7d13bbc1133b8a7a2332404fb85f116adeed
Sep 09 15:24:48.131470 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:48.131436    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dnlpg" event={"ID":"50242e37-ff31-411e-889c-8e547eeac38c","Type":"ContainerStarted","Data":"0f02017187c68f720c19a2ea30362b57de333a852f9850746f91747f3a518517"}
Sep 09 15:24:48.131641 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:48.131492    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dnlpg" event={"ID":"50242e37-ff31-411e-889c-8e547eeac38c","Type":"ContainerStarted","Data":"4f1bbbcb1c7829483d7ca2cec06e7d13bbc1133b8a7a2332404fb85f116adeed"}
Sep 09 15:24:49.136650 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:49.136618    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dnlpg" event={"ID":"50242e37-ff31-411e-889c-8e547eeac38c","Type":"ContainerStarted","Data":"6d7bffff7562aafe19c39691147debd968f8c1c5ede73c96fc8cb6534a59ee54"}
Sep 09 15:24:52.149268 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.149178    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dnlpg" event={"ID":"50242e37-ff31-411e-889c-8e547eeac38c","Type":"ContainerStarted","Data":"b038b314842da36e831fe0cd4b1605ba2025b875880bf77267f597f043b25d81"}
Sep 09 15:24:52.168122 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.168072    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dnlpg" podStartSLOduration=33.485250049 podStartE2EDuration="37.168052649s" totalImagesPullingTime="3.6828026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:24:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:24:52.16721156 +0000 UTC m=+276.357414342" watchObservedRunningTime="2026-09-09 15:24:52.168052649 +0000 UTC m=+276.358255398"
Sep 09 15:24:52.528682 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.528650    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"]
Sep 09 15:24:52.531952 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.531934    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"
Sep 09 15:24:52.534452 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.534430    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 15:24:52.534576 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.534514    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 15:24:52.534640 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.534601    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 09 15:24:52.534814 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.534798    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 09 15:24:52.534938 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.534832    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 15:24:52.534938 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.534830    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-r68nz\""
Sep 09 15:24:52.541556 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.541526    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c6kwc"]
Sep 09 15:24:52.544585 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.544552    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"]
Sep 09 15:24:52.544688 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.544672    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.547345 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.547328    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 15:24:52.547345 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.547338    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7vtq5\""
Sep 09 15:24:52.547736 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.547719    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 15:24:52.547869 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.547780    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 15:24:52.547948 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.547889    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.547948 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.547800    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"]
Sep 09 15:24:52.550317 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.550296    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 09 15:24:52.550414 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.550404    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-clb6t\""
Sep 09 15:24:52.550499 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.550478    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 09 15:24:52.550609 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.550590    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 09 15:24:52.562732 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.562701    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"]
Sep 09 15:24:52.645423 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645389    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b6a5f22-5f20-4874-920f-1dc4e9293d3a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-89fpn\" (UID: \"0b6a5f22-5f20-4874-920f-1dc4e9293d3a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"
Sep 09 15:24:52.645423 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645425    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-accelerators-collector-config\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.645657 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645446    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b6a5f22-5f20-4874-920f-1dc4e9293d3a-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-89fpn\" (UID: \"0b6a5f22-5f20-4874-920f-1dc4e9293d3a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"
Sep 09 15:24:52.645657 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645464    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/248399ce-c6e1-4668-ba6e-01352cce1a47-metrics-client-ca\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.645657 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645478    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c95f93db-0c41-4c15-bcf2-81c504877015-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.645657 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645511    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c95f93db-0c41-4c15-bcf2-81c504877015-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.645657 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645562    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-tls\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.645657 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645623    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t5qw\" (UniqueName: \"kubernetes.io/projected/248399ce-c6e1-4668-ba6e-01352cce1a47-kube-api-access-4t5qw\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.645657 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645653    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95f93db-0c41-4c15-bcf2-81c504877015-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.646009 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645680    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/248399ce-c6e1-4668-ba6e-01352cce1a47-root\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.646009 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645715    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b6a5f22-5f20-4874-920f-1dc4e9293d3a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-89fpn\" (UID: \"0b6a5f22-5f20-4874-920f-1dc4e9293d3a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"
Sep 09 15:24:52.646009 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645744    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-textfile\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.646009 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645792    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c95f93db-0c41-4c15-bcf2-81c504877015-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.646009 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645832    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-wtmp\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.646009 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645914    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c95f93db-0c41-4c15-bcf2-81c504877015-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.646009 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645949    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.646009 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.645974    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvjxz\" (UniqueName: \"kubernetes.io/projected/0b6a5f22-5f20-4874-920f-1dc4e9293d3a-kube-api-access-nvjxz\") pod \"openshift-state-metrics-657fd6c54-89fpn\" (UID: \"0b6a5f22-5f20-4874-920f-1dc4e9293d3a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"
Sep 09 15:24:52.646278 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.646023    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/248399ce-c6e1-4668-ba6e-01352cce1a47-sys\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.646278 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.646050    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlb7t\" (UniqueName: \"kubernetes.io/projected/c95f93db-0c41-4c15-bcf2-81c504877015-kube-api-access-dlb7t\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.746719 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.746681    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b6a5f22-5f20-4874-920f-1dc4e9293d3a-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-89fpn\" (UID: \"0b6a5f22-5f20-4874-920f-1dc4e9293d3a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"
Sep 09 15:24:52.746719 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.746716    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/248399ce-c6e1-4668-ba6e-01352cce1a47-metrics-client-ca\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.746991 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.746734    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c95f93db-0c41-4c15-bcf2-81c504877015-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.746991 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.746754    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c95f93db-0c41-4c15-bcf2-81c504877015-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.746991 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.746772    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-tls\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.746991 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.746791    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t5qw\" (UniqueName: \"kubernetes.io/projected/248399ce-c6e1-4668-ba6e-01352cce1a47-kube-api-access-4t5qw\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.746991 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.746905    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95f93db-0c41-4c15-bcf2-81c504877015-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.746991 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:52.746930    2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 09 15:24:52.746991 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.746969    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/248399ce-c6e1-4668-ba6e-01352cce1a47-root\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.747326 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:52.747005    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-tls podName:248399ce-c6e1-4668-ba6e-01352cce1a47 nodeName:}" failed. No retries permitted until 2026-09-09 15:24:53.246985298 +0000 UTC m=+277.437188030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-tls") pod "node-exporter-c6kwc" (UID: "248399ce-c6e1-4668-ba6e-01352cce1a47") : secret "node-exporter-tls" not found
Sep 09 15:24:52.747326 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747035    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/248399ce-c6e1-4668-ba6e-01352cce1a47-root\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.747326 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747043    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b6a5f22-5f20-4874-920f-1dc4e9293d3a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-89fpn\" (UID: \"0b6a5f22-5f20-4874-920f-1dc4e9293d3a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"
Sep 09 15:24:52.747326 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747116    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-textfile\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.747326 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747146    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c95f93db-0c41-4c15-bcf2-81c504877015-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.747326 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:52.747166    2574 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 09 15:24:52.747326 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747180    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-wtmp\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.747326 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:52.747221    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95f93db-0c41-4c15-bcf2-81c504877015-kube-state-metrics-tls podName:c95f93db-0c41-4c15-bcf2-81c504877015 nodeName:}" failed. No retries permitted until 2026-09-09 15:24:53.247207478 +0000 UTC m=+277.437410230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c95f93db-0c41-4c15-bcf2-81c504877015-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-pvtjt" (UID: "c95f93db-0c41-4c15-bcf2-81c504877015") : secret "kube-state-metrics-tls" not found
Sep 09 15:24:52.747326 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747250    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c95f93db-0c41-4c15-bcf2-81c504877015-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.747326 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747284    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.747326 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747309    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvjxz\" (UniqueName: \"kubernetes.io/projected/0b6a5f22-5f20-4874-920f-1dc4e9293d3a-kube-api-access-nvjxz\") pod \"openshift-state-metrics-657fd6c54-89fpn\" (UID: \"0b6a5f22-5f20-4874-920f-1dc4e9293d3a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"
Sep 09 15:24:52.747326 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747319    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-wtmp\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.747975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747372    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/248399ce-c6e1-4668-ba6e-01352cce1a47-sys\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.747975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747398    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlb7t\" (UniqueName: \"kubernetes.io/projected/c95f93db-0c41-4c15-bcf2-81c504877015-kube-api-access-dlb7t\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.747975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747433    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b6a5f22-5f20-4874-920f-1dc4e9293d3a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-89fpn\" (UID: \"0b6a5f22-5f20-4874-920f-1dc4e9293d3a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"
Sep 09 15:24:52.747975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747447    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/248399ce-c6e1-4668-ba6e-01352cce1a47-metrics-client-ca\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.747975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747461    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-accelerators-collector-config\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.747975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747588    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c95f93db-0c41-4c15-bcf2-81c504877015-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.747975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747608    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c95f93db-0c41-4c15-bcf2-81c504877015-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.747975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747736    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b6a5f22-5f20-4874-920f-1dc4e9293d3a-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-89fpn\" (UID: \"0b6a5f22-5f20-4874-920f-1dc4e9293d3a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"
Sep 09 15:24:52.747975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747797    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/248399ce-c6e1-4668-ba6e-01352cce1a47-sys\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.747975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747830    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-textfile\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.747975 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:52.747900    2574 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 09 15:24:52.747975 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:52.747967    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b6a5f22-5f20-4874-920f-1dc4e9293d3a-openshift-state-metrics-tls podName:0b6a5f22-5f20-4874-920f-1dc4e9293d3a nodeName:}" failed. No retries permitted until 2026-09-09 15:24:53.247949837 +0000 UTC m=+277.438152580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0b6a5f22-5f20-4874-920f-1dc4e9293d3a-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-89fpn" (UID: "0b6a5f22-5f20-4874-920f-1dc4e9293d3a") : secret "openshift-state-metrics-tls" not found
Sep 09 15:24:52.748735 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.747985    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c95f93db-0c41-4c15-bcf2-81c504877015-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.748735 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.748291    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-accelerators-collector-config\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.749775 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.749751    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b6a5f22-5f20-4874-920f-1dc4e9293d3a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-89fpn\" (UID: \"0b6a5f22-5f20-4874-920f-1dc4e9293d3a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"
Sep 09 15:24:52.750144 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.750120    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.750216 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.750183    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c95f93db-0c41-4c15-bcf2-81c504877015-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:52.758770 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.758738    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t5qw\" (UniqueName: \"kubernetes.io/projected/248399ce-c6e1-4668-ba6e-01352cce1a47-kube-api-access-4t5qw\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:52.759334 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.759313    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvjxz\" (UniqueName: \"kubernetes.io/projected/0b6a5f22-5f20-4874-920f-1dc4e9293d3a-kube-api-access-nvjxz\") pod \"openshift-state-metrics-657fd6c54-89fpn\" (UID: \"0b6a5f22-5f20-4874-920f-1dc4e9293d3a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"
Sep 09 15:24:52.759416 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:52.759400    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlb7t\" (UniqueName: \"kubernetes.io/projected/c95f93db-0c41-4c15-bcf2-81c504877015-kube-api-access-dlb7t\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:53.252514 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:53.252458    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95f93db-0c41-4c15-bcf2-81c504877015-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:53.253066 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:53.252741    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b6a5f22-5f20-4874-920f-1dc4e9293d3a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-89fpn\" (UID: \"0b6a5f22-5f20-4874-920f-1dc4e9293d3a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"
Sep 09 15:24:53.253066 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:53.252804    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-tls\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:53.255151 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:53.255113    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95f93db-0c41-4c15-bcf2-81c504877015-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-pvtjt\" (UID: \"c95f93db-0c41-4c15-bcf2-81c504877015\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:53.255151 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:53.255134    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/248399ce-c6e1-4668-ba6e-01352cce1a47-node-exporter-tls\") pod \"node-exporter-c6kwc\" (UID: \"248399ce-c6e1-4668-ba6e-01352cce1a47\") " pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:53.255315 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:53.255219    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b6a5f22-5f20-4874-920f-1dc4e9293d3a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-89fpn\" (UID: \"0b6a5f22-5f20-4874-920f-1dc4e9293d3a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"
Sep 09 15:24:53.441208 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:53.441173    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"
Sep 09 15:24:53.455705 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:53.455604    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c6kwc"
Sep 09 15:24:53.462956 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:53.462920    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"
Sep 09 15:24:53.466696 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:24:53.466672    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248399ce_c6e1_4668_ba6e_01352cce1a47.slice/crio-9aa2353165ec53d36251149831a38b6dab5c9b396bbb12cadb2ff6d971e7ba6d WatchSource:0}: Error finding container 9aa2353165ec53d36251149831a38b6dab5c9b396bbb12cadb2ff6d971e7ba6d: Status 404 returned error can't find the container with id 9aa2353165ec53d36251149831a38b6dab5c9b396bbb12cadb2ff6d971e7ba6d
Sep 09 15:24:53.721523 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:53.721494    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn"]
Sep 09 15:24:53.724585 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:24:53.724550    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b6a5f22_5f20_4874_920f_1dc4e9293d3a.slice/crio-46ed270b2777dfcb1f8ab97545f1b061318dd38ff5e815dfadeb8253bac2291f WatchSource:0}: Error finding container 46ed270b2777dfcb1f8ab97545f1b061318dd38ff5e815dfadeb8253bac2291f: Status 404 returned error can't find the container with id 46ed270b2777dfcb1f8ab97545f1b061318dd38ff5e815dfadeb8253bac2291f
Sep 09 15:24:53.749425 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:53.749399    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt"]
Sep 09 15:24:53.752837 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:24:53.752809    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc95f93db_0c41_4c15_bcf2_81c504877015.slice/crio-dd80d3c1f1abbb68274f9056d1ac2f7be977bfc10197a9718ef5a818e21566c3 WatchSource:0}: Error finding container dd80d3c1f1abbb68274f9056d1ac2f7be977bfc10197a9718ef5a818e21566c3: Status 404 returned error can't find the container with id dd80d3c1f1abbb68274f9056d1ac2f7be977bfc10197a9718ef5a818e21566c3
Sep 09 15:24:54.157869 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:54.157751    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt" event={"ID":"c95f93db-0c41-4c15-bcf2-81c504877015","Type":"ContainerStarted","Data":"dd80d3c1f1abbb68274f9056d1ac2f7be977bfc10197a9718ef5a818e21566c3"}
Sep 09 15:24:54.159231 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:54.159191    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6kwc" event={"ID":"248399ce-c6e1-4668-ba6e-01352cce1a47","Type":"ContainerStarted","Data":"9aa2353165ec53d36251149831a38b6dab5c9b396bbb12cadb2ff6d971e7ba6d"}
Sep 09 15:24:54.161113 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:54.161086    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn" event={"ID":"0b6a5f22-5f20-4874-920f-1dc4e9293d3a","Type":"ContainerStarted","Data":"29f6a760de7fe22f42b384d893a6e2e7b88fdc0c66f57bf0a128d9d29e39eece"}
Sep 09 15:24:54.161240 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:54.161138    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn" event={"ID":"0b6a5f22-5f20-4874-920f-1dc4e9293d3a","Type":"ContainerStarted","Data":"b4349eba5adffbda1257a25b624070e75d3210339c2b7e733f4f1b9c4118cede"}
Sep 09 15:24:54.161240 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:54.161165    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn" event={"ID":"0b6a5f22-5f20-4874-920f-1dc4e9293d3a","Type":"ContainerStarted","Data":"46ed270b2777dfcb1f8ab97545f1b061318dd38ff5e815dfadeb8253bac2291f"}
Sep 09 15:24:55.790149 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:24:55.790111    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vktxv" podUID="a49acd86-0f4f-4da1-a9bc-c4cde626c7cd"
Sep 09 15:24:56.169813 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.169780    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt" event={"ID":"c95f93db-0c41-4c15-bcf2-81c504877015","Type":"ContainerStarted","Data":"bb966191fa510f8857455bdc03dd295497d3da02fcbe5ec497e80a8b4997ed95"}
Sep 09 15:24:56.170013 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.169835    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt" event={"ID":"c95f93db-0c41-4c15-bcf2-81c504877015","Type":"ContainerStarted","Data":"d55520bb8efd7a8b9ca2589b53520818bb90a24619770095a42fe84fb1307c4c"}
Sep 09 15:24:56.170013 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.169881    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt" event={"ID":"c95f93db-0c41-4c15-bcf2-81c504877015","Type":"ContainerStarted","Data":"8e8216f8e6d33733e2dc8d7c7e4d02415eab3cecbdfe38d81859d3c6e2a8355e"}
Sep 09 15:24:56.175861 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.175808    2574 generic.go:356] "Generic (PLEG): container finished" podID="248399ce-c6e1-4668-ba6e-01352cce1a47" containerID="b4a6eae4c51c4debff467f764e88d8cd941237eee3f3b6d8cee0ddbcbcc4981b" exitCode=0
Sep 09 15:24:56.176000 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.175898    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6kwc" event={"ID":"248399ce-c6e1-4668-ba6e-01352cce1a47","Type":"ContainerDied","Data":"b4a6eae4c51c4debff467f764e88d8cd941237eee3f3b6d8cee0ddbcbcc4981b"}
Sep 09 15:24:56.178161 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.178132    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn" event={"ID":"0b6a5f22-5f20-4874-920f-1dc4e9293d3a","Type":"ContainerStarted","Data":"56415ad7637a82601b09647e802a20a206965cb874616c268ff98f857ebcbd8d"}
Sep 09 15:24:56.178297 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.178150    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vktxv"
Sep 09 15:24:56.189254 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.189215    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvtjt" podStartSLOduration=2.588400887 podStartE2EDuration="4.189200738s" totalImagesPullingTime="1.600799851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:24:56.18840068 +0000 UTC m=+280.378603448" watchObservedRunningTime="2026-09-09 15:24:56.189200738 +0000 UTC m=+280.379403486"
Sep 09 15:24:56.204719 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.204677    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-89fpn" podStartSLOduration=2.707088497 podStartE2EDuration="4.20466152s" totalImagesPullingTime="1.497573023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:24:56.203301795 +0000 UTC m=+280.393504573" watchObservedRunningTime="2026-09-09 15:24:56.20466152 +0000 UTC m=+280.394864269"
Sep 09 15:24:56.543111 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.543080    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"]
Sep 09 15:24:56.546825 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.546805    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.549343 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.549321    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 09 15:24:56.549513 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.549495    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 09 15:24:56.549567 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.549537    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 09 15:24:56.549623 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.549602    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 09 15:24:56.549678 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.549625    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-co2j8p5ko8ago\""
Sep 09 15:24:56.549678 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.549634    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vtnvn\""
Sep 09 15:24:56.550031 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.550013    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 09 15:24:56.560963 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.560942    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"]
Sep 09 15:24:56.582189 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.582158    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-metrics-client-ca\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.582189 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.582193    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-grpc-tls\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.582374 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.582223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-thanos-querier-tls\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.582374 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.582299    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.582374 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.582347    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.582473 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.582377    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz6qx\" (UniqueName: \"kubernetes.io/projected/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-kube-api-access-xz6qx\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.582473 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.582396    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.582473 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.582422    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.683700 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.683650    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz6qx\" (UniqueName: \"kubernetes.io/projected/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-kube-api-access-xz6qx\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.683700 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.683701    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.683992 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.683724    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.683992 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.683772    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-metrics-client-ca\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.683992 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.683792    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-grpc-tls\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.683992 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.683819    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-thanos-querier-tls\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.684186 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.684005    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.684186 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.684045    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.684939 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.684669    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-metrics-client-ca\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.688368 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.686766    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-grpc-tls\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.688368 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.686837    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.688368 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.687034    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.688368 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.687147    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-thanos-querier-tls\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.689426 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.689256    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.689426 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.689384    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.691812 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.691790    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz6qx\" (UniqueName: \"kubernetes.io/projected/c3a83b16-b17c-409e-85a9-4d5dd91bd70f-kube-api-access-xz6qx\") pod \"thanos-querier-59d8c5f7c-wpf72\" (UID: \"c3a83b16-b17c-409e-85a9-4d5dd91bd70f\") " pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.856256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.856156    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:24:56.863753 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.863727    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"]
Sep 09 15:24:56.867080 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.867061    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:56.869805 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.869761    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 15:24:56.869970 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.869807    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 09 15:24:56.869970 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.869866    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 09 15:24:56.869970 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.869919    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9ipvk32480nbd\""
Sep 09 15:24:56.870253 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.870234    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 09 15:24:56.870315 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.870254    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8tf7v\""
Sep 09 15:24:56.877021 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.876999    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"]
Sep 09 15:24:56.986621 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.986579    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aae52f1a-baea-4236-9a2b-83672d59dd82-secret-metrics-server-tls\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:56.986621 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.986623    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aae52f1a-baea-4236-9a2b-83672d59dd82-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:56.986823 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.986711    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aae52f1a-baea-4236-9a2b-83672d59dd82-secret-metrics-server-client-certs\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:56.986823 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.986775    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aae52f1a-baea-4236-9a2b-83672d59dd82-audit-log\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:56.986823 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.986801    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aae52f1a-baea-4236-9a2b-83672d59dd82-metrics-server-audit-profiles\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:56.986943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.986825    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aae52f1a-baea-4236-9a2b-83672d59dd82-client-ca-bundle\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:56.986943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:56.986870    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjflg\" (UniqueName: \"kubernetes.io/projected/aae52f1a-baea-4236-9a2b-83672d59dd82-kube-api-access-gjflg\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:57.088210 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.088173    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjflg\" (UniqueName: \"kubernetes.io/projected/aae52f1a-baea-4236-9a2b-83672d59dd82-kube-api-access-gjflg\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:57.088365 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.088227    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aae52f1a-baea-4236-9a2b-83672d59dd82-secret-metrics-server-tls\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:57.088408 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.088352    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aae52f1a-baea-4236-9a2b-83672d59dd82-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:57.088445 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.088421    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aae52f1a-baea-4236-9a2b-83672d59dd82-secret-metrics-server-client-certs\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:57.088504 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.088489    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aae52f1a-baea-4236-9a2b-83672d59dd82-audit-log\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:57.088563 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.088519    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aae52f1a-baea-4236-9a2b-83672d59dd82-metrics-server-audit-profiles\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:57.088624 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.088574    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aae52f1a-baea-4236-9a2b-83672d59dd82-client-ca-bundle\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:57.088828 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.088804    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aae52f1a-baea-4236-9a2b-83672d59dd82-audit-log\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:57.089138 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.089119    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aae52f1a-baea-4236-9a2b-83672d59dd82-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:57.089431 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.089412    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aae52f1a-baea-4236-9a2b-83672d59dd82-metrics-server-audit-profiles\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:57.090864 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.090821    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aae52f1a-baea-4236-9a2b-83672d59dd82-secret-metrics-server-tls\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:57.091047 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.091025    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aae52f1a-baea-4236-9a2b-83672d59dd82-secret-metrics-server-client-certs\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:57.091114 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.091092    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aae52f1a-baea-4236-9a2b-83672d59dd82-client-ca-bundle\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:57.096789 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.096767    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjflg\" (UniqueName: \"kubernetes.io/projected/aae52f1a-baea-4236-9a2b-83672d59dd82-kube-api-access-gjflg\") pod \"metrics-server-7bfc7d4f49-plnd8\" (UID: \"aae52f1a-baea-4236-9a2b-83672d59dd82\") " pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:57.146540 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.146358    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"]
Sep 09 15:24:57.152586 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:24:57.152551    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a83b16_b17c_409e_85a9_4d5dd91bd70f.slice/crio-b6fa09409efe580c3337d05e8add0950d17d762ee4cefbd4e0fb52cc75e3e41c WatchSource:0}: Error finding container b6fa09409efe580c3337d05e8add0950d17d762ee4cefbd4e0fb52cc75e3e41c: Status 404 returned error can't find the container with id b6fa09409efe580c3337d05e8add0950d17d762ee4cefbd4e0fb52cc75e3e41c
Sep 09 15:24:57.187251 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.187214    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72" event={"ID":"c3a83b16-b17c-409e-85a9-4d5dd91bd70f","Type":"ContainerStarted","Data":"b6fa09409efe580c3337d05e8add0950d17d762ee4cefbd4e0fb52cc75e3e41c"}
Sep 09 15:24:57.188617 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.188595    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:24:57.189701 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.189672    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6kwc" event={"ID":"248399ce-c6e1-4668-ba6e-01352cce1a47","Type":"ContainerStarted","Data":"dddbc8fa4b7724d939c89aeed95ba984b365f120ce58b50a3b50dd0f0195adc3"}
Sep 09 15:24:57.189884 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.189729    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6kwc" event={"ID":"248399ce-c6e1-4668-ba6e-01352cce1a47","Type":"ContainerStarted","Data":"eaef960da329c4cc3808b534b4f38c51efd8463cfb6d4eb923bb66af8dc3f0a5"}
Sep 09 15:24:57.207253 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.207210    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c6kwc" podStartSLOduration=3.210388686 podStartE2EDuration="5.207196793s" totalImagesPullingTime="1.888826669s" totalInitContainerRuntime="107.981438ms" isStatefulPod=true podCreationTimestamp="2026-09-09 15:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:24:57.206595606 +0000 UTC m=+281.396798380" watchObservedRunningTime="2026-09-09 15:24:57.207196793 +0000 UTC m=+281.397399542"
Sep 09 15:24:57.296012 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.295980    2574 patch_prober.go:28] interesting pod/image-registry-5855854ddc-mg7md container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 15:24:57.296194 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.296040    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5855854ddc-mg7md" podUID="470088f9-5cb7-4c95-8c03-aff7448bf15c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 15:24:57.462521 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:57.462490    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"]
Sep 09 15:24:57.465015 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:24:57.464989    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae52f1a_baea_4236_9a2b_83672d59dd82.slice/crio-330c975c3283e286aa6be46f53d3af61ae747c739481c1f2c063f37b7f25fdc2 WatchSource:0}: Error finding container 330c975c3283e286aa6be46f53d3af61ae747c739481c1f2c063f37b7f25fdc2: Status 404 returned error can't find the container with id 330c975c3283e286aa6be46f53d3af61ae747c739481c1f2c063f37b7f25fdc2
Sep 09 15:24:58.196198 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:58.196123    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8" event={"ID":"aae52f1a-baea-4236-9a2b-83672d59dd82","Type":"ContainerStarted","Data":"330c975c3283e286aa6be46f53d3af61ae747c739481c1f2c063f37b7f25fdc2"}
Sep 09 15:24:59.613969 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:59.613942    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:24:59.616917 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:59.616894    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49acd86-0f4f-4da1-a9bc-c4cde626c7cd-metrics-tls\") pod \"dns-default-vktxv\" (UID: \"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd\") " pod="openshift-dns/dns-default-vktxv"
Sep 09 15:24:59.780763 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:59.780732    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jnqpd\""
Sep 09 15:24:59.788881 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:24:59.788790    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vktxv"
Sep 09 15:25:00.060902 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:00.060768    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vktxv"]
Sep 09 15:25:00.063319 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:25:00.063295    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda49acd86_0f4f_4da1_a9bc_c4cde626c7cd.slice/crio-77a3b16e3abfe64aa72bb12800052a74f7bf2854df544360d3a286c6d08b3301 WatchSource:0}: Error finding container 77a3b16e3abfe64aa72bb12800052a74f7bf2854df544360d3a286c6d08b3301: Status 404 returned error can't find the container with id 77a3b16e3abfe64aa72bb12800052a74f7bf2854df544360d3a286c6d08b3301
Sep 09 15:25:00.206665 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:00.206627    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72" event={"ID":"c3a83b16-b17c-409e-85a9-4d5dd91bd70f","Type":"ContainerStarted","Data":"199c2db575e98855686f94f697769d8e8486308895c7cdb3e42d9177364c1f25"}
Sep 09 15:25:00.206834 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:00.206697    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72" event={"ID":"c3a83b16-b17c-409e-85a9-4d5dd91bd70f","Type":"ContainerStarted","Data":"15f2263ef50dbd9ae2ef92d4703ed65c094679780c1badb4e5117cce4ff9b670"}
Sep 09 15:25:00.206834 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:00.206739    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72" event={"ID":"c3a83b16-b17c-409e-85a9-4d5dd91bd70f","Type":"ContainerStarted","Data":"8fd0cc4ffdc728e5c07c0b000887013552ec7b1a08b86c6cab84e8c53ec2ed03"}
Sep 09 15:25:00.207868 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:00.207826    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vktxv" event={"ID":"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd","Type":"ContainerStarted","Data":"77a3b16e3abfe64aa72bb12800052a74f7bf2854df544360d3a286c6d08b3301"}
Sep 09 15:25:00.209436 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:00.209406    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8" event={"ID":"aae52f1a-baea-4236-9a2b-83672d59dd82","Type":"ContainerStarted","Data":"77fed0f06077dfecefd510d550cbd96b0d6cedebe99adbf44cde0f74d2b12167"}
Sep 09 15:25:00.226111 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:00.226065    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8" podStartSLOduration=2.159825078 podStartE2EDuration="4.226048028s" totalImagesPullingTime="2.06622295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:25:00.225419764 +0000 UTC m=+284.415622544" watchObservedRunningTime="2026-09-09 15:25:00.226048028 +0000 UTC m=+284.416250777"
Sep 09 15:25:02.220534 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.220501    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vktxv" event={"ID":"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd","Type":"ContainerStarted","Data":"9f5e52bd1e7cf90adbfd63458002c51f750873acf62de9d8565e259b8cc269ed"}
Sep 09 15:25:02.220941 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.220585    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vktxv" event={"ID":"a49acd86-0f4f-4da1-a9bc-c4cde626c7cd","Type":"ContainerStarted","Data":"60e8c4a60cd8af0b95cbb70fe28eaf75afd1e12aeb8608529267449d85b898d5"}
Sep 09 15:25:02.220941 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.220615    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vktxv"
Sep 09 15:25:02.236662 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.236617    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vktxv" podStartSLOduration=251.729264876 podStartE2EDuration="4m13.236600162s" totalImagesPullingTime="1.507335286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:20:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:25:02.235496134 +0000 UTC m=+286.425698900" watchObservedRunningTime="2026-09-09 15:25:02.236600162 +0000 UTC m=+286.426802921"
Sep 09 15:25:02.310293 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.310243    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5855854ddc-mg7md" podUID="470088f9-5cb7-4c95-8c03-aff7448bf15c" containerName="registry" containerID="cri-o://0c56ccfd326174cbd62090236d7d1a322fa7840c29ceedc09d62973b0b155773" gracePeriod=30
Sep 09 15:25:02.546234 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.546204    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:25:02.641938 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.641908    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-bound-sa-token\") pod \"470088f9-5cb7-4c95-8c03-aff7448bf15c\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") "
Sep 09 15:25:02.642118 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.641949    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-certificates\") pod \"470088f9-5cb7-4c95-8c03-aff7448bf15c\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") "
Sep 09 15:25:02.642118 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.641985    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/470088f9-5cb7-4c95-8c03-aff7448bf15c-installation-pull-secrets\") pod \"470088f9-5cb7-4c95-8c03-aff7448bf15c\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") "
Sep 09 15:25:02.642118 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.642009    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/470088f9-5cb7-4c95-8c03-aff7448bf15c-image-registry-private-configuration\") pod \"470088f9-5cb7-4c95-8c03-aff7448bf15c\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") "
Sep 09 15:25:02.642118 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.642049    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/470088f9-5cb7-4c95-8c03-aff7448bf15c-trusted-ca\") pod \"470088f9-5cb7-4c95-8c03-aff7448bf15c\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") "
Sep 09 15:25:02.642118 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.642081    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/470088f9-5cb7-4c95-8c03-aff7448bf15c-ca-trust-extracted\") pod \"470088f9-5cb7-4c95-8c03-aff7448bf15c\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") "
Sep 09 15:25:02.642118 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.642113    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92jbv\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-kube-api-access-92jbv\") pod \"470088f9-5cb7-4c95-8c03-aff7448bf15c\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") "
Sep 09 15:25:02.642415 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.642146    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls\") pod \"470088f9-5cb7-4c95-8c03-aff7448bf15c\" (UID: \"470088f9-5cb7-4c95-8c03-aff7448bf15c\") "
Sep 09 15:25:02.642716 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.642545    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/470088f9-5cb7-4c95-8c03-aff7448bf15c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "470088f9-5cb7-4c95-8c03-aff7448bf15c" (UID: "470088f9-5cb7-4c95-8c03-aff7448bf15c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:25:02.642716 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.642680    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "470088f9-5cb7-4c95-8c03-aff7448bf15c" (UID: "470088f9-5cb7-4c95-8c03-aff7448bf15c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:25:02.644589 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.644561    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-kube-api-access-92jbv" (OuterVolumeSpecName: "kube-api-access-92jbv") pod "470088f9-5cb7-4c95-8c03-aff7448bf15c" (UID: "470088f9-5cb7-4c95-8c03-aff7448bf15c"). InnerVolumeSpecName "kube-api-access-92jbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:25:02.644589 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.644564    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/470088f9-5cb7-4c95-8c03-aff7448bf15c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "470088f9-5cb7-4c95-8c03-aff7448bf15c" (UID: "470088f9-5cb7-4c95-8c03-aff7448bf15c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:25:02.644725 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.644616    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/470088f9-5cb7-4c95-8c03-aff7448bf15c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "470088f9-5cb7-4c95-8c03-aff7448bf15c" (UID: "470088f9-5cb7-4c95-8c03-aff7448bf15c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:25:02.644870 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.644817    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "470088f9-5cb7-4c95-8c03-aff7448bf15c" (UID: "470088f9-5cb7-4c95-8c03-aff7448bf15c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:25:02.644870 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.644830    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "470088f9-5cb7-4c95-8c03-aff7448bf15c" (UID: "470088f9-5cb7-4c95-8c03-aff7448bf15c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:25:02.651187 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.651163    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470088f9-5cb7-4c95-8c03-aff7448bf15c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "470088f9-5cb7-4c95-8c03-aff7448bf15c" (UID: "470088f9-5cb7-4c95-8c03-aff7448bf15c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:25:02.742975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.742889    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-bound-sa-token\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:25:02.742975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.742920    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-certificates\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:25:02.742975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.742931    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/470088f9-5cb7-4c95-8c03-aff7448bf15c-installation-pull-secrets\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:25:02.742975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.742940    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/470088f9-5cb7-4c95-8c03-aff7448bf15c-image-registry-private-configuration\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:25:02.742975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.742951    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/470088f9-5cb7-4c95-8c03-aff7448bf15c-trusted-ca\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:25:02.742975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.742960    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/470088f9-5cb7-4c95-8c03-aff7448bf15c-ca-trust-extracted\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:25:02.742975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.742967    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92jbv\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-kube-api-access-92jbv\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:25:02.742975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:02.742975    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470088f9-5cb7-4c95-8c03-aff7448bf15c-registry-tls\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:25:03.226810 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:03.226769    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72" event={"ID":"c3a83b16-b17c-409e-85a9-4d5dd91bd70f","Type":"ContainerStarted","Data":"7195f11dd079308f11cd6b8af433b43d7ac57bf8d5ad335cefcf9c57f8448265"}
Sep 09 15:25:03.227320 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:03.226871    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72" event={"ID":"c3a83b16-b17c-409e-85a9-4d5dd91bd70f","Type":"ContainerStarted","Data":"e56b89e08d9206d7a765b64ab4e8b2e3a51da7172be7231256e0cd7bd7616009"}
Sep 09 15:25:03.227320 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:03.226907    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72" event={"ID":"c3a83b16-b17c-409e-85a9-4d5dd91bd70f","Type":"ContainerStarted","Data":"bec2089296ef579fb08c08c25f4e896f3d23458f85adfd97b55d53c4c050f4d3"}
Sep 09 15:25:03.227320 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:03.226937    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:25:03.228141 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:03.228116    2574 generic.go:356] "Generic (PLEG): container finished" podID="470088f9-5cb7-4c95-8c03-aff7448bf15c" containerID="0c56ccfd326174cbd62090236d7d1a322fa7840c29ceedc09d62973b0b155773" exitCode=0
Sep 09 15:25:03.228246 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:03.228156    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5855854ddc-mg7md"
Sep 09 15:25:03.228246 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:03.228185    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5855854ddc-mg7md" event={"ID":"470088f9-5cb7-4c95-8c03-aff7448bf15c","Type":"ContainerDied","Data":"0c56ccfd326174cbd62090236d7d1a322fa7840c29ceedc09d62973b0b155773"}
Sep 09 15:25:03.228246 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:03.228225    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5855854ddc-mg7md" event={"ID":"470088f9-5cb7-4c95-8c03-aff7448bf15c","Type":"ContainerDied","Data":"78a98c62340de3eec299af5364087ed9767bc7d5c78746359e8ba597e392fb93"}
Sep 09 15:25:03.228357 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:03.228266    2574 scope.go:117] "RemoveContainer" containerID="0c56ccfd326174cbd62090236d7d1a322fa7840c29ceedc09d62973b0b155773"
Sep 09 15:25:03.237590 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:03.237574    2574 scope.go:117] "RemoveContainer" containerID="0c56ccfd326174cbd62090236d7d1a322fa7840c29ceedc09d62973b0b155773"
Sep 09 15:25:03.237898 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:25:03.237879    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c56ccfd326174cbd62090236d7d1a322fa7840c29ceedc09d62973b0b155773\": container with ID starting with 0c56ccfd326174cbd62090236d7d1a322fa7840c29ceedc09d62973b0b155773 not found: ID does not exist" containerID="0c56ccfd326174cbd62090236d7d1a322fa7840c29ceedc09d62973b0b155773"
Sep 09 15:25:03.237950 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:03.237907    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c56ccfd326174cbd62090236d7d1a322fa7840c29ceedc09d62973b0b155773"} err="failed to get container status \"0c56ccfd326174cbd62090236d7d1a322fa7840c29ceedc09d62973b0b155773\": rpc error: code = NotFound desc = could not find container \"0c56ccfd326174cbd62090236d7d1a322fa7840c29ceedc09d62973b0b155773\": container with ID starting with 0c56ccfd326174cbd62090236d7d1a322fa7840c29ceedc09d62973b0b155773 not found: ID does not exist"
Sep 09 15:25:03.250451 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:03.250403    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72" podStartSLOduration=2.369231557 podStartE2EDuration="7.250388709s" totalImagesPullingTime="4.881157152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:24:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:25:03.249412179 +0000 UTC m=+287.439614954" watchObservedRunningTime="2026-09-09 15:25:03.250388709 +0000 UTC m=+287.440591500"
Sep 09 15:25:03.263669 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:03.263635    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5855854ddc-mg7md"]
Sep 09 15:25:03.265418 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:03.265396    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5855854ddc-mg7md"]
Sep 09 15:25:04.238774 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.238744    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-59d8c5f7c-wpf72"
Sep 09 15:25:04.319566 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.319531    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="470088f9-5cb7-4c95-8c03-aff7448bf15c" path="/var/lib/kubelet/pods/470088f9-5cb7-4c95-8c03-aff7448bf15c/volumes"
Sep 09 15:25:04.678279 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.678185    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76b5fbb9dc-hfpv7"]
Sep 09 15:25:04.678499 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.678486    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="470088f9-5cb7-4c95-8c03-aff7448bf15c" containerName="registry"
Sep 09 15:25:04.678499 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.678500    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="470088f9-5cb7-4c95-8c03-aff7448bf15c" containerName="registry"
Sep 09 15:25:04.678581 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.678565    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="470088f9-5cb7-4c95-8c03-aff7448bf15c" containerName="registry"
Sep 09 15:25:04.683285 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.683268    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.686363 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.686339    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 09 15:25:04.686470 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.686386    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 09 15:25:04.687389 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.687367    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 09 15:25:04.687476 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.687394    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 09 15:25:04.687535 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.687496    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m6hd7\""
Sep 09 15:25:04.687535 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.687504    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 09 15:25:04.687535 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.687508    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 09 15:25:04.687671 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.687496    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 09 15:25:04.696083 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.696060    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76b5fbb9dc-hfpv7"]
Sep 09 15:25:04.760197 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.760162    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-config\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.760365 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.760235    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-service-ca\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.760365 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.760257    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tqt7\" (UniqueName: \"kubernetes.io/projected/3a26ec96-7c13-4bc1-9b04-5735d2f13399-kube-api-access-4tqt7\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.760365 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.760304    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-oauth-config\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.760365 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.760332    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-oauth-serving-cert\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.760365 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.760351    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-serving-cert\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.861537 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.861499    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-oauth-config\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.861537 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.861537    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-oauth-serving-cert\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.861755 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.861557    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-serving-cert\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.861755 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.861603    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-config\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.861755 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.861645    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-service-ca\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.861755 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.861674    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tqt7\" (UniqueName: \"kubernetes.io/projected/3a26ec96-7c13-4bc1-9b04-5735d2f13399-kube-api-access-4tqt7\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.862346 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.862311    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-oauth-serving-cert\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.862622 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.862416    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-service-ca\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.862870 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.862827    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-config\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.864357 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.864327    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-oauth-config\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.864463 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.864334    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-serving-cert\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.869415 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.869388    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tqt7\" (UniqueName: \"kubernetes.io/projected/3a26ec96-7c13-4bc1-9b04-5735d2f13399-kube-api-access-4tqt7\") pod \"console-76b5fbb9dc-hfpv7\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") " pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:04.992394 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:04.992352    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:05.263300 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:05.263224    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76b5fbb9dc-hfpv7"]
Sep 09 15:25:05.266199 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:25:05.266170    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a26ec96_7c13_4bc1_9b04_5735d2f13399.slice/crio-5a7ac3a933ffd6c1c965bd6c28a41841d4e1ec11fcf2a153de33f27a2a824ffd WatchSource:0}: Error finding container 5a7ac3a933ffd6c1c965bd6c28a41841d4e1ec11fcf2a153de33f27a2a824ffd: Status 404 returned error can't find the container with id 5a7ac3a933ffd6c1c965bd6c28a41841d4e1ec11fcf2a153de33f27a2a824ffd
Sep 09 15:25:06.242652 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:06.242608    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b5fbb9dc-hfpv7" event={"ID":"3a26ec96-7c13-4bc1-9b04-5735d2f13399","Type":"ContainerStarted","Data":"5a7ac3a933ffd6c1c965bd6c28a41841d4e1ec11fcf2a153de33f27a2a824ffd"}
Sep 09 15:25:09.256909 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:09.256873    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b5fbb9dc-hfpv7" event={"ID":"3a26ec96-7c13-4bc1-9b04-5735d2f13399","Type":"ContainerStarted","Data":"d28aa7febcafad908057778d0bd840bb9627783c47697dda51ed228e5e946406"}
Sep 09 15:25:09.274409 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:09.274364    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76b5fbb9dc-hfpv7" podStartSLOduration=2.081744698 podStartE2EDuration="5.274347552s" totalImagesPullingTime="3.192602854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:25:09.273630352 +0000 UTC m=+293.463833102" watchObservedRunningTime="2026-09-09 15:25:09.274347552 +0000 UTC m=+293.464550301"
Sep 09 15:25:12.231369 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.231338    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vktxv"
Sep 09 15:25:12.315665 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:25:12.315630    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zwx9l" podUID="bb11cdb7-08b9-46e4-9d53-eb8092841c48"
Sep 09 15:25:12.429379 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.429336    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f66689c85-jw2jh"]
Sep 09 15:25:12.432961 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.432938    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.439522 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.439500    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 09 15:25:12.443143 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.443120    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f66689c85-jw2jh"]
Sep 09 15:25:12.530834 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.530737    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-service-ca\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.531000 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.530902    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-oauth-serving-cert\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.531000 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.530929    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-config\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.531000 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.530952    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-serving-cert\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.531000 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.530968    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-trusted-ca-bundle\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.531173 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.531013    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82sqx\" (UniqueName: \"kubernetes.io/projected/8aea19f7-c0cd-4140-a16d-f2dc780c008e-kube-api-access-82sqx\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.531173 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.531061    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-oauth-config\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.632125 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.632081    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-oauth-config\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.632277 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.632138    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-service-ca\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.632277 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.632251    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-oauth-serving-cert\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.632370 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.632278    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-config\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.632370 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.632313    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-serving-cert\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.632370 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.632337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-trusted-ca-bundle\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.632370 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.632364    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82sqx\" (UniqueName: \"kubernetes.io/projected/8aea19f7-c0cd-4140-a16d-f2dc780c008e-kube-api-access-82sqx\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.633075 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.633046    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-service-ca\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.633217 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.633093    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-config\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.633303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.633276    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-oauth-serving-cert\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.633452 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.633429    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-trusted-ca-bundle\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.634768 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.634738    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-oauth-config\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.635041 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.635021    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-serving-cert\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.639797 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.639781    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82sqx\" (UniqueName: \"kubernetes.io/projected/8aea19f7-c0cd-4140-a16d-f2dc780c008e-kube-api-access-82sqx\") pod \"console-f66689c85-jw2jh\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") " pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:12.743198 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:12.743144    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:13.013020 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:13.012983    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f66689c85-jw2jh"]
Sep 09 15:25:13.015786 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:25:13.015744    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aea19f7_c0cd_4140_a16d_f2dc780c008e.slice/crio-47eb6d5861a357a775634bfad9ef1f3ea5d2be961c39f15a119dbf6b57e4b46d WatchSource:0}: Error finding container 47eb6d5861a357a775634bfad9ef1f3ea5d2be961c39f15a119dbf6b57e4b46d: Status 404 returned error can't find the container with id 47eb6d5861a357a775634bfad9ef1f3ea5d2be961c39f15a119dbf6b57e4b46d
Sep 09 15:25:13.273761 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:13.273725    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f66689c85-jw2jh" event={"ID":"8aea19f7-c0cd-4140-a16d-f2dc780c008e","Type":"ContainerStarted","Data":"fdac9170fe020edbb2f739b6d8fa3899b122845d71b2a031ca0f063936f0daf6"}
Sep 09 15:25:13.274126 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:13.273783    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f66689c85-jw2jh" event={"ID":"8aea19f7-c0cd-4140-a16d-f2dc780c008e","Type":"ContainerStarted","Data":"47eb6d5861a357a775634bfad9ef1f3ea5d2be961c39f15a119dbf6b57e4b46d"}
Sep 09 15:25:13.290916 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:13.290866    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f66689c85-jw2jh" podStartSLOduration=1.29082239 podStartE2EDuration="1.29082239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:25:13.289835386 +0000 UTC m=+297.480038135" watchObservedRunningTime="2026-09-09 15:25:13.29082239 +0000 UTC m=+297.481025142"
Sep 09 15:25:14.993175 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:14.993138    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:14.993626 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:14.993221    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:14.998021 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:14.997999    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:15.285410 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:15.285326    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:16.277898 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:16.277873    2574 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 15:25:17.189652 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:17.189609    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:25:17.191953 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:17.189678    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:25:20.300456 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:20.300421    2574 generic.go:356] "Generic (PLEG): container finished" podID="a4a00a5e-1b35-450a-bc80-ec5836f1fdc2" containerID="d4fa582ec69757bc90e4c12deffd38cdfbc68dc85c0a748cd10001a837d840f4" exitCode=0
Sep 09 15:25:20.300926 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:20.300497    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk" event={"ID":"a4a00a5e-1b35-450a-bc80-ec5836f1fdc2","Type":"ContainerDied","Data":"d4fa582ec69757bc90e4c12deffd38cdfbc68dc85c0a748cd10001a837d840f4"}
Sep 09 15:25:20.300926 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:20.300865    2574 scope.go:117] "RemoveContainer" containerID="d4fa582ec69757bc90e4c12deffd38cdfbc68dc85c0a748cd10001a837d840f4"
Sep 09 15:25:21.306347 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:21.306312    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kwpmk" event={"ID":"a4a00a5e-1b35-450a-bc80-ec5836f1fdc2","Type":"ContainerStarted","Data":"4d509b9ca146bcca7a5aea798a526f4857b5af0a5661ec6d401e31d802a87ce2"}
Sep 09 15:25:22.744339 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:22.744301    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:22.744739 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:22.744369    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:22.749188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:22.749165    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:23.317823 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:23.317785    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:25:23.360493 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:23.360455    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76b5fbb9dc-hfpv7"]
Sep 09 15:25:26.315426 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:26.315387    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:25:35.359994 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:35.359955    2574 generic.go:356] "Generic (PLEG): container finished" podID="1ca22521-7db4-4b88-86b0-c2f39cc29d06" containerID="9badf42d101648af8c1dfa69d3391268bdac0f1677b0caabbba2bdd4210c46bd" exitCode=0
Sep 09 15:25:35.360368 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:35.360028    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm" event={"ID":"1ca22521-7db4-4b88-86b0-c2f39cc29d06","Type":"ContainerDied","Data":"9badf42d101648af8c1dfa69d3391268bdac0f1677b0caabbba2bdd4210c46bd"}
Sep 09 15:25:35.360412 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:35.360371    2574 scope.go:117] "RemoveContainer" containerID="9badf42d101648af8c1dfa69d3391268bdac0f1677b0caabbba2bdd4210c46bd"
Sep 09 15:25:36.364861 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:36.364811    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-ztdgm" event={"ID":"1ca22521-7db4-4b88-86b0-c2f39cc29d06","Type":"ContainerStarted","Data":"704266b224110ba48626c534c7a7a61e3e7a33bdfe7d79d92f2f9df7b710532f"}
Sep 09 15:25:37.194523 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:37.194489    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:25:37.198244 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:37.198223    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7bfc7d4f49-plnd8"
Sep 09 15:25:45.400011 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:45.399925    2574 generic.go:356] "Generic (PLEG): container finished" podID="a0546f45-e4aa-4d46-8b43-1b74ba1cc97c" containerID="0929db24af2929b3a1b872c36c621b521032b10624bf1ef8465a4e5b73131b6d" exitCode=0
Sep 09 15:25:45.400011 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:45.399989    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95" event={"ID":"a0546f45-e4aa-4d46-8b43-1b74ba1cc97c","Type":"ContainerDied","Data":"0929db24af2929b3a1b872c36c621b521032b10624bf1ef8465a4e5b73131b6d"}
Sep 09 15:25:45.400390 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:45.400280    2574 scope.go:117] "RemoveContainer" containerID="0929db24af2929b3a1b872c36c621b521032b10624bf1ef8465a4e5b73131b6d"
Sep 09 15:25:46.405823 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:46.405783    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-qkx95" event={"ID":"a0546f45-e4aa-4d46-8b43-1b74ba1cc97c","Type":"ContainerStarted","Data":"4d21ffdb18f48164d52d775372b7f585fb6121c5dde71712cb645023abf41394"}
Sep 09 15:25:48.381054 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.381013    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76b5fbb9dc-hfpv7" podUID="3a26ec96-7c13-4bc1-9b04-5735d2f13399" containerName="console" containerID="cri-o://d28aa7febcafad908057778d0bd840bb9627783c47697dda51ed228e5e946406" gracePeriod=15
Sep 09 15:25:48.659028 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.658996    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:48.745802 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.745769    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-serving-cert\") pod \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") "
Sep 09 15:25:48.745802 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.745801    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-oauth-serving-cert\") pod \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") "
Sep 09 15:25:48.746087 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.745836    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-oauth-config\") pod \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") "
Sep 09 15:25:48.746087 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.745994    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-service-ca\") pod \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") "
Sep 09 15:25:48.746087 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.746065    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tqt7\" (UniqueName: \"kubernetes.io/projected/3a26ec96-7c13-4bc1-9b04-5735d2f13399-kube-api-access-4tqt7\") pod \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") "
Sep 09 15:25:48.746231 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.746130    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-config\") pod \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\" (UID: \"3a26ec96-7c13-4bc1-9b04-5735d2f13399\") "
Sep 09 15:25:48.746231 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.746221    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3a26ec96-7c13-4bc1-9b04-5735d2f13399" (UID: "3a26ec96-7c13-4bc1-9b04-5735d2f13399"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:25:48.746331 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.746281    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-service-ca" (OuterVolumeSpecName: "service-ca") pod "3a26ec96-7c13-4bc1-9b04-5735d2f13399" (UID: "3a26ec96-7c13-4bc1-9b04-5735d2f13399"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:25:48.746457 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.746435    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-config" (OuterVolumeSpecName: "console-config") pod "3a26ec96-7c13-4bc1-9b04-5735d2f13399" (UID: "3a26ec96-7c13-4bc1-9b04-5735d2f13399"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:25:48.746524 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.746444    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-oauth-serving-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:25:48.746524 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.746479    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-service-ca\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:25:48.748330 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.748297    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3a26ec96-7c13-4bc1-9b04-5735d2f13399" (UID: "3a26ec96-7c13-4bc1-9b04-5735d2f13399"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:25:48.748441 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.748327    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a26ec96-7c13-4bc1-9b04-5735d2f13399-kube-api-access-4tqt7" (OuterVolumeSpecName: "kube-api-access-4tqt7") pod "3a26ec96-7c13-4bc1-9b04-5735d2f13399" (UID: "3a26ec96-7c13-4bc1-9b04-5735d2f13399"). InnerVolumeSpecName "kube-api-access-4tqt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:25:48.748441 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.748380    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3a26ec96-7c13-4bc1-9b04-5735d2f13399" (UID: "3a26ec96-7c13-4bc1-9b04-5735d2f13399"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:25:48.847640 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.847606    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tqt7\" (UniqueName: \"kubernetes.io/projected/3a26ec96-7c13-4bc1-9b04-5735d2f13399-kube-api-access-4tqt7\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:25:48.847640 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.847635    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-config\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:25:48.847640 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.847645    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-serving-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:25:48.847873 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:48.847654    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a26ec96-7c13-4bc1-9b04-5735d2f13399-console-oauth-config\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:25:49.419055 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:49.419025    2574 generic.go:356] "Generic (PLEG): container finished" podID="3a26ec96-7c13-4bc1-9b04-5735d2f13399" containerID="d28aa7febcafad908057778d0bd840bb9627783c47697dda51ed228e5e946406" exitCode=0
Sep 09 15:25:49.419479 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:49.419075    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b5fbb9dc-hfpv7"
Sep 09 15:25:49.419479 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:49.419107    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b5fbb9dc-hfpv7" event={"ID":"3a26ec96-7c13-4bc1-9b04-5735d2f13399","Type":"ContainerDied","Data":"d28aa7febcafad908057778d0bd840bb9627783c47697dda51ed228e5e946406"}
Sep 09 15:25:49.419479 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:49.419151    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b5fbb9dc-hfpv7" event={"ID":"3a26ec96-7c13-4bc1-9b04-5735d2f13399","Type":"ContainerDied","Data":"5a7ac3a933ffd6c1c965bd6c28a41841d4e1ec11fcf2a153de33f27a2a824ffd"}
Sep 09 15:25:49.419479 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:49.419170    2574 scope.go:117] "RemoveContainer" containerID="d28aa7febcafad908057778d0bd840bb9627783c47697dda51ed228e5e946406"
Sep 09 15:25:49.429044 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:49.429008    2574 scope.go:117] "RemoveContainer" containerID="d28aa7febcafad908057778d0bd840bb9627783c47697dda51ed228e5e946406"
Sep 09 15:25:49.429402 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:25:49.429379    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d28aa7febcafad908057778d0bd840bb9627783c47697dda51ed228e5e946406\": container with ID starting with d28aa7febcafad908057778d0bd840bb9627783c47697dda51ed228e5e946406 not found: ID does not exist" containerID="d28aa7febcafad908057778d0bd840bb9627783c47697dda51ed228e5e946406"
Sep 09 15:25:49.429481 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:49.429411    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d28aa7febcafad908057778d0bd840bb9627783c47697dda51ed228e5e946406"} err="failed to get container status \"d28aa7febcafad908057778d0bd840bb9627783c47697dda51ed228e5e946406\": rpc error: code = NotFound desc = could not find container \"d28aa7febcafad908057778d0bd840bb9627783c47697dda51ed228e5e946406\": container with ID starting with d28aa7febcafad908057778d0bd840bb9627783c47697dda51ed228e5e946406 not found: ID does not exist"
Sep 09 15:25:49.440717 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:49.440694    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76b5fbb9dc-hfpv7"]
Sep 09 15:25:49.444246 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:49.444223    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76b5fbb9dc-hfpv7"]
Sep 09 15:25:50.319322 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:25:50.319286    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a26ec96-7c13-4bc1-9b04-5735d2f13399" path="/var/lib/kubelet/pods/3a26ec96-7c13-4bc1-9b04-5735d2f13399/volumes"
Sep 09 15:26:23.294669 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.294632    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d6659bbd6-zd2lb"]
Sep 09 15:26:23.295099 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.294938    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a26ec96-7c13-4bc1-9b04-5735d2f13399" containerName="console"
Sep 09 15:26:23.295099 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.294949    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a26ec96-7c13-4bc1-9b04-5735d2f13399" containerName="console"
Sep 09 15:26:23.295099 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.295013    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a26ec96-7c13-4bc1-9b04-5735d2f13399" containerName="console"
Sep 09 15:26:23.299211 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.299195    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.312044 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.312019    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d6659bbd6-zd2lb"]
Sep 09 15:26:23.330192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.330165    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-service-ca\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.330314 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.330209    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqdvh\" (UniqueName: \"kubernetes.io/projected/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-kube-api-access-bqdvh\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.330314 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.330250    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-config\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.330314 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.330267    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-trusted-ca-bundle\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.330314 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.330306    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-serving-cert\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.330456 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.330330    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-oauth-config\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.330456 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.330347    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-oauth-serving-cert\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.431213 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.431178    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-serving-cert\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.431213 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.431215    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-oauth-config\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.431456 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.431239    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-oauth-serving-cert\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.431456 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.431322    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-service-ca\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.431456 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.431351    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqdvh\" (UniqueName: \"kubernetes.io/projected/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-kube-api-access-bqdvh\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.431456 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.431378    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-config\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.431456 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.431398    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-trusted-ca-bundle\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.432067 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.432039    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-oauth-serving-cert\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.432187 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.432125    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-config\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.432187 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.432125    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-service-ca\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.432308 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.432288    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-trusted-ca-bundle\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.434306 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.434282    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-oauth-config\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.434404 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.434358    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-serving-cert\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.440410 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.440382    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqdvh\" (UniqueName: \"kubernetes.io/projected/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-kube-api-access-bqdvh\") pod \"console-5d6659bbd6-zd2lb\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") " pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.608437 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.608334    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:23.881788 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:23.881717    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d6659bbd6-zd2lb"]
Sep 09 15:26:23.886334 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:26:23.886301    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a698d5b_9a8e_4f7c_b795_7a8f0f88fd58.slice/crio-b8a1b7c93bf9a9fb5e773513cd5af843f0db27c2b7d55d6cb558a44233e26173 WatchSource:0}: Error finding container b8a1b7c93bf9a9fb5e773513cd5af843f0db27c2b7d55d6cb558a44233e26173: Status 404 returned error can't find the container with id b8a1b7c93bf9a9fb5e773513cd5af843f0db27c2b7d55d6cb558a44233e26173
Sep 09 15:26:24.556579 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:24.556541    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d6659bbd6-zd2lb" event={"ID":"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58","Type":"ContainerStarted","Data":"fd4542edcdd670d4230d6749494ea1e44a624f1314799d1fc9643dd63dc61b3c"}
Sep 09 15:26:24.557068 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:24.556624    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d6659bbd6-zd2lb" event={"ID":"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58","Type":"ContainerStarted","Data":"b8a1b7c93bf9a9fb5e773513cd5af843f0db27c2b7d55d6cb558a44233e26173"}
Sep 09 15:26:24.573620 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:24.573575    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d6659bbd6-zd2lb" podStartSLOduration=1.573561245 podStartE2EDuration="1.573561245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:26:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:26:24.572223913 +0000 UTC m=+368.762426690" watchObservedRunningTime="2026-09-09 15:26:24.573561245 +0000 UTC m=+368.763763993"
Sep 09 15:26:29.281024 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:29.280979    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs\") pod \"network-metrics-daemon-zwx9l\" (UID: \"bb11cdb7-08b9-46e4-9d53-eb8092841c48\") " pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:26:29.283491 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:29.283455    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb11cdb7-08b9-46e4-9d53-eb8092841c48-metrics-certs\") pod \"network-metrics-daemon-zwx9l\" (UID: \"bb11cdb7-08b9-46e4-9d53-eb8092841c48\") " pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:26:29.319051 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:29.319018    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xdr6q\""
Sep 09 15:26:29.326908 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:29.326883    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwx9l"
Sep 09 15:26:29.594883 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:29.594783    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zwx9l"]
Sep 09 15:26:29.597621 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:26:29.597594    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb11cdb7_08b9_46e4_9d53_eb8092841c48.slice/crio-0bbde516bfa45b39be5ebabae913db8f8edfe27b5ec434c18e7b5c4af475a455 WatchSource:0}: Error finding container 0bbde516bfa45b39be5ebabae913db8f8edfe27b5ec434c18e7b5c4af475a455: Status 404 returned error can't find the container with id 0bbde516bfa45b39be5ebabae913db8f8edfe27b5ec434c18e7b5c4af475a455
Sep 09 15:26:29.599731 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:29.599711    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 15:26:30.581713 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:30.581659    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zwx9l" event={"ID":"bb11cdb7-08b9-46e4-9d53-eb8092841c48","Type":"ContainerStarted","Data":"0bbde516bfa45b39be5ebabae913db8f8edfe27b5ec434c18e7b5c4af475a455"}
Sep 09 15:26:31.587569 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:31.587532    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zwx9l" event={"ID":"bb11cdb7-08b9-46e4-9d53-eb8092841c48","Type":"ContainerStarted","Data":"2e9adf2e7479c352b01d767d40442d297ede3b55ce2f2d67a3f3c937c25726e0"}
Sep 09 15:26:31.588007 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:31.587584    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zwx9l" event={"ID":"bb11cdb7-08b9-46e4-9d53-eb8092841c48","Type":"ContainerStarted","Data":"28cb008b112de01530e68964bd983cd8039951ebc0094bcfa539425f82130ec5"}
Sep 09 15:26:31.603660 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:31.603601    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zwx9l" podStartSLOduration=373.644153186 podStartE2EDuration="6m14.603584507s" totalImagesPullingTime="959.431321ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:26:31.602298713 +0000 UTC m=+375.792501482" watchObservedRunningTime="2026-09-09 15:26:31.603584507 +0000 UTC m=+375.793787255"
Sep 09 15:26:33.608915 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:33.608872    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:33.609303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:33.608942    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:33.613792 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:33.613768    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:34.602779 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:34.602746    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:26:34.644779 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:34.644743    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f66689c85-jw2jh"]
Sep 09 15:26:59.667324 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:59.667265    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f66689c85-jw2jh" podUID="8aea19f7-c0cd-4140-a16d-f2dc780c008e" containerName="console" containerID="cri-o://fdac9170fe020edbb2f739b6d8fa3899b122845d71b2a031ca0f063936f0daf6" gracePeriod=15
Sep 09 15:26:59.913017 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:26:59.912986    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:27:00.048421 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.048364    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-config\") pod \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") "
Sep 09 15:27:00.048421 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.048434    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82sqx\" (UniqueName: \"kubernetes.io/projected/8aea19f7-c0cd-4140-a16d-f2dc780c008e-kube-api-access-82sqx\") pod \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") "
Sep 09 15:27:00.048711 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.048465    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-oauth-config\") pod \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") "
Sep 09 15:27:00.048711 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.048533    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-oauth-serving-cert\") pod \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") "
Sep 09 15:27:00.048711 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.048660    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-service-ca\") pod \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") "
Sep 09 15:27:00.048711 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.048698    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-trusted-ca-bundle\") pod \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") "
Sep 09 15:27:00.048967 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.048755    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-serving-cert\") pod \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\" (UID: \"8aea19f7-c0cd-4140-a16d-f2dc780c008e\") "
Sep 09 15:27:00.048967 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.048879    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-config" (OuterVolumeSpecName: "console-config") pod "8aea19f7-c0cd-4140-a16d-f2dc780c008e" (UID: "8aea19f7-c0cd-4140-a16d-f2dc780c008e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:27:00.049121 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.049093    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-service-ca" (OuterVolumeSpecName: "service-ca") pod "8aea19f7-c0cd-4140-a16d-f2dc780c008e" (UID: "8aea19f7-c0cd-4140-a16d-f2dc780c008e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:27:00.049191 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.049174    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-service-ca\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:27:00.049237 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.049198    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-config\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:27:00.049431 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.049406    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8aea19f7-c0cd-4140-a16d-f2dc780c008e" (UID: "8aea19f7-c0cd-4140-a16d-f2dc780c008e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:27:00.049516 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.049497    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8aea19f7-c0cd-4140-a16d-f2dc780c008e" (UID: "8aea19f7-c0cd-4140-a16d-f2dc780c008e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:27:00.050758 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.050737    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8aea19f7-c0cd-4140-a16d-f2dc780c008e" (UID: "8aea19f7-c0cd-4140-a16d-f2dc780c008e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:27:00.050920 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.050901    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8aea19f7-c0cd-4140-a16d-f2dc780c008e" (UID: "8aea19f7-c0cd-4140-a16d-f2dc780c008e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:27:00.050982 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.050942    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aea19f7-c0cd-4140-a16d-f2dc780c008e-kube-api-access-82sqx" (OuterVolumeSpecName: "kube-api-access-82sqx") pod "8aea19f7-c0cd-4140-a16d-f2dc780c008e" (UID: "8aea19f7-c0cd-4140-a16d-f2dc780c008e"). InnerVolumeSpecName "kube-api-access-82sqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:27:00.150029 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.149979    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82sqx\" (UniqueName: \"kubernetes.io/projected/8aea19f7-c0cd-4140-a16d-f2dc780c008e-kube-api-access-82sqx\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:27:00.150029 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.150023    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-oauth-config\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:27:00.150029 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.150034    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-oauth-serving-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:27:00.150029 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.150043    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aea19f7-c0cd-4140-a16d-f2dc780c008e-trusted-ca-bundle\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:27:00.150283 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.150051    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8aea19f7-c0cd-4140-a16d-f2dc780c008e-console-serving-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:27:00.700755 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.700715    2574 generic.go:356] "Generic (PLEG): container finished" podID="8aea19f7-c0cd-4140-a16d-f2dc780c008e" containerID="fdac9170fe020edbb2f739b6d8fa3899b122845d71b2a031ca0f063936f0daf6" exitCode=0
Sep 09 15:27:00.701234 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.700779    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f66689c85-jw2jh"
Sep 09 15:27:00.701234 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.700782    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f66689c85-jw2jh" event={"ID":"8aea19f7-c0cd-4140-a16d-f2dc780c008e","Type":"ContainerDied","Data":"fdac9170fe020edbb2f739b6d8fa3899b122845d71b2a031ca0f063936f0daf6"}
Sep 09 15:27:00.701234 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.700835    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f66689c85-jw2jh" event={"ID":"8aea19f7-c0cd-4140-a16d-f2dc780c008e","Type":"ContainerDied","Data":"47eb6d5861a357a775634bfad9ef1f3ea5d2be961c39f15a119dbf6b57e4b46d"}
Sep 09 15:27:00.701234 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.700896    2574 scope.go:117] "RemoveContainer" containerID="fdac9170fe020edbb2f739b6d8fa3899b122845d71b2a031ca0f063936f0daf6"
Sep 09 15:27:00.709504 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.709484    2574 scope.go:117] "RemoveContainer" containerID="fdac9170fe020edbb2f739b6d8fa3899b122845d71b2a031ca0f063936f0daf6"
Sep 09 15:27:00.709825 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:27:00.709804    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdac9170fe020edbb2f739b6d8fa3899b122845d71b2a031ca0f063936f0daf6\": container with ID starting with fdac9170fe020edbb2f739b6d8fa3899b122845d71b2a031ca0f063936f0daf6 not found: ID does not exist" containerID="fdac9170fe020edbb2f739b6d8fa3899b122845d71b2a031ca0f063936f0daf6"
Sep 09 15:27:00.709918 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.709835    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdac9170fe020edbb2f739b6d8fa3899b122845d71b2a031ca0f063936f0daf6"} err="failed to get container status \"fdac9170fe020edbb2f739b6d8fa3899b122845d71b2a031ca0f063936f0daf6\": rpc error: code = NotFound desc = could not find container \"fdac9170fe020edbb2f739b6d8fa3899b122845d71b2a031ca0f063936f0daf6\": container with ID starting with fdac9170fe020edbb2f739b6d8fa3899b122845d71b2a031ca0f063936f0daf6 not found: ID does not exist"
Sep 09 15:27:00.718165 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.718139    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f66689c85-jw2jh"]
Sep 09 15:27:00.720606 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:00.720584    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f66689c85-jw2jh"]
Sep 09 15:27:02.319127 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:02.319092    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8aea19f7-c0cd-4140-a16d-f2dc780c008e" path="/var/lib/kubelet/pods/8aea19f7-c0cd-4140-a16d-f2dc780c008e/volumes"
Sep 09 15:27:32.676365 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.676330    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-687d5c7cc8-r22tf"]
Sep 09 15:27:32.676859 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.676637    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aea19f7-c0cd-4140-a16d-f2dc780c008e" containerName="console"
Sep 09 15:27:32.676859 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.676649    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aea19f7-c0cd-4140-a16d-f2dc780c008e" containerName="console"
Sep 09 15:27:32.676859 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.676697    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aea19f7-c0cd-4140-a16d-f2dc780c008e" containerName="console"
Sep 09 15:27:32.680979 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.680957    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.697351 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.697316    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687d5c7cc8-r22tf"]
Sep 09 15:27:32.704100 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.704073    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-trusted-ca-bundle\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.704256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.704110    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7mbg\" (UniqueName: \"kubernetes.io/projected/29d36da0-dc1d-4140-9c3c-9dfc904e50af-kube-api-access-q7mbg\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.704256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.704130    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-oauth-serving-cert\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.704256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.704147    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-config\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.704256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.704198    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-oauth-config\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.704256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.704213    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-serving-cert\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.704256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.704234    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-service-ca\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.805030 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.804994    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-trusted-ca-bundle\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.805201 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.805045    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7mbg\" (UniqueName: \"kubernetes.io/projected/29d36da0-dc1d-4140-9c3c-9dfc904e50af-kube-api-access-q7mbg\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.805201 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.805071    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-oauth-serving-cert\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.805201 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.805187    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-config\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.805319 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.805254    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-oauth-config\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.805319 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.805292    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-serving-cert\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.805427 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.805325    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-service-ca\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.806270 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.806230    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-config\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.806552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.806338    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-oauth-serving-cert\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.806552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.806392    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-service-ca\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.806552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.806438    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-trusted-ca-bundle\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.808690 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.808668    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-oauth-config\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.808884 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.808831    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-serving-cert\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.814441 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.814419    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7mbg\" (UniqueName: \"kubernetes.io/projected/29d36da0-dc1d-4140-9c3c-9dfc904e50af-kube-api-access-q7mbg\") pod \"console-687d5c7cc8-r22tf\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") " pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:32.990520 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:32.990492    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:33.261742 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:33.261716    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687d5c7cc8-r22tf"]
Sep 09 15:27:33.264465 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:27:33.264430    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29d36da0_dc1d_4140_9c3c_9dfc904e50af.slice/crio-87c2a5f484f401ead658a144732dc90936d89a6baa2639e9c58d121a776e8620 WatchSource:0}: Error finding container 87c2a5f484f401ead658a144732dc90936d89a6baa2639e9c58d121a776e8620: Status 404 returned error can't find the container with id 87c2a5f484f401ead658a144732dc90936d89a6baa2639e9c58d121a776e8620
Sep 09 15:27:33.831952 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:33.831907    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687d5c7cc8-r22tf" event={"ID":"29d36da0-dc1d-4140-9c3c-9dfc904e50af","Type":"ContainerStarted","Data":"cb0f199c337cbf365ffdb33022ae73d8c8e4b74f713643de996a34f632dd90ba"}
Sep 09 15:27:33.832333 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:33.831972    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687d5c7cc8-r22tf" event={"ID":"29d36da0-dc1d-4140-9c3c-9dfc904e50af","Type":"ContainerStarted","Data":"87c2a5f484f401ead658a144732dc90936d89a6baa2639e9c58d121a776e8620"}
Sep 09 15:27:33.848996 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:33.848939    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-687d5c7cc8-r22tf" podStartSLOduration=1.848922166 podStartE2EDuration="1.848922166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:27:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:27:33.848424107 +0000 UTC m=+438.038626881" watchObservedRunningTime="2026-09-09 15:27:33.848922166 +0000 UTC m=+438.039124914"
Sep 09 15:27:42.990790 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:42.990710    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:42.990790 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:42.990766    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:42.995393 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:42.995370    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:43.876044 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:43.876013    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:27:43.919473 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:27:43.919439    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d6659bbd6-zd2lb"]
Sep 09 15:28:08.941910 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:08.941824    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d6659bbd6-zd2lb" podUID="9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58" containerName="console" containerID="cri-o://fd4542edcdd670d4230d6749494ea1e44a624f1314799d1fc9643dd63dc61b3c" gracePeriod=15
Sep 09 15:28:09.175969 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.175945    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:28:09.309765 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.309676    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-service-ca\") pod \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") "
Sep 09 15:28:09.309765 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.309711    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-oauth-config\") pod \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") "
Sep 09 15:28:09.309765 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.309745    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqdvh\" (UniqueName: \"kubernetes.io/projected/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-kube-api-access-bqdvh\") pod \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") "
Sep 09 15:28:09.309765 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.309766    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-config\") pod \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") "
Sep 09 15:28:09.310079 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.309884    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-trusted-ca-bundle\") pod \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") "
Sep 09 15:28:09.310079 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.309923    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-oauth-serving-cert\") pod \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") "
Sep 09 15:28:09.310079 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.310017    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-serving-cert\") pod \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\" (UID: \"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58\") "
Sep 09 15:28:09.310288 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.310243    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-service-ca" (OuterVolumeSpecName: "service-ca") pod "9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58" (UID: "9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:28:09.310414 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.310283    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-config" (OuterVolumeSpecName: "console-config") pod "9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58" (UID: "9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:28:09.310414 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.310360    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58" (UID: "9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:28:09.310513 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.310418    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58" (UID: "9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:28:09.312306 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.312276    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58" (UID: "9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:28:09.312563 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.312546    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58" (UID: "9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:28:09.312627 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.312609    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-kube-api-access-bqdvh" (OuterVolumeSpecName: "kube-api-access-bqdvh") pod "9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58" (UID: "9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58"). InnerVolumeSpecName "kube-api-access-bqdvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:28:09.410910 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.410869    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-serving-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:28:09.410910 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.410900    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-service-ca\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:28:09.411099 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.410928    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-oauth-config\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:28:09.411099 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.410938    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqdvh\" (UniqueName: \"kubernetes.io/projected/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-kube-api-access-bqdvh\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:28:09.411099 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.410947    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-console-config\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:28:09.411099 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.410955    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-trusted-ca-bundle\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:28:09.411099 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.410963    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58-oauth-serving-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:28:09.974072 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.974037    2574 generic.go:356] "Generic (PLEG): container finished" podID="9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58" containerID="fd4542edcdd670d4230d6749494ea1e44a624f1314799d1fc9643dd63dc61b3c" exitCode=0
Sep 09 15:28:09.974440 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.974084    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d6659bbd6-zd2lb"
Sep 09 15:28:09.974440 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.974085    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d6659bbd6-zd2lb" event={"ID":"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58","Type":"ContainerDied","Data":"fd4542edcdd670d4230d6749494ea1e44a624f1314799d1fc9643dd63dc61b3c"}
Sep 09 15:28:09.974440 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.974216    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d6659bbd6-zd2lb" event={"ID":"9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58","Type":"ContainerDied","Data":"b8a1b7c93bf9a9fb5e773513cd5af843f0db27c2b7d55d6cb558a44233e26173"}
Sep 09 15:28:09.974440 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.974248    2574 scope.go:117] "RemoveContainer" containerID="fd4542edcdd670d4230d6749494ea1e44a624f1314799d1fc9643dd63dc61b3c"
Sep 09 15:28:09.983335 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.983318    2574 scope.go:117] "RemoveContainer" containerID="fd4542edcdd670d4230d6749494ea1e44a624f1314799d1fc9643dd63dc61b3c"
Sep 09 15:28:09.983666 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:28:09.983647    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd4542edcdd670d4230d6749494ea1e44a624f1314799d1fc9643dd63dc61b3c\": container with ID starting with fd4542edcdd670d4230d6749494ea1e44a624f1314799d1fc9643dd63dc61b3c not found: ID does not exist" containerID="fd4542edcdd670d4230d6749494ea1e44a624f1314799d1fc9643dd63dc61b3c"
Sep 09 15:28:09.983716 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.983677    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4542edcdd670d4230d6749494ea1e44a624f1314799d1fc9643dd63dc61b3c"} err="failed to get container status \"fd4542edcdd670d4230d6749494ea1e44a624f1314799d1fc9643dd63dc61b3c\": rpc error: code = NotFound desc = could not find container \"fd4542edcdd670d4230d6749494ea1e44a624f1314799d1fc9643dd63dc61b3c\": container with ID starting with fd4542edcdd670d4230d6749494ea1e44a624f1314799d1fc9643dd63dc61b3c not found: ID does not exist"
Sep 09 15:28:09.994270 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.994242    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d6659bbd6-zd2lb"]
Sep 09 15:28:09.997771 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:09.997746    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d6659bbd6-zd2lb"]
Sep 09 15:28:10.320482 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:10.320376    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58" path="/var/lib/kubelet/pods/9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58/volumes"
Sep 09 15:28:55.483472 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.483439    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr"]
Sep 09 15:28:55.483886 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.483742    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58" containerName="console"
Sep 09 15:28:55.483886 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.483755    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58" containerName="console"
Sep 09 15:28:55.483886 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.483818    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a698d5b-9a8e-4f7c-b795-7a8f0f88fd58" containerName="console"
Sep 09 15:28:55.486490 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.486473    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr"
Sep 09 15:28:55.490186 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.490165    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 15:28:55.490288 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.490269    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vln6l\""
Sep 09 15:28:55.491262 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.491248    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 15:28:55.497067 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.497036    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr"]
Sep 09 15:28:55.560925 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.560890    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1e4991e-30c8-4e52-b200-da042ff1ed1c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr\" (UID: \"b1e4991e-30c8-4e52-b200-da042ff1ed1c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr"
Sep 09 15:28:55.561091 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.560949    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b764b\" (UniqueName: \"kubernetes.io/projected/b1e4991e-30c8-4e52-b200-da042ff1ed1c-kube-api-access-b764b\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr\" (UID: \"b1e4991e-30c8-4e52-b200-da042ff1ed1c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr"
Sep 09 15:28:55.561091 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.561000    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1e4991e-30c8-4e52-b200-da042ff1ed1c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr\" (UID: \"b1e4991e-30c8-4e52-b200-da042ff1ed1c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr"
Sep 09 15:28:55.662088 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.662054    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b764b\" (UniqueName: \"kubernetes.io/projected/b1e4991e-30c8-4e52-b200-da042ff1ed1c-kube-api-access-b764b\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr\" (UID: \"b1e4991e-30c8-4e52-b200-da042ff1ed1c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr"
Sep 09 15:28:55.662177 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.662107    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1e4991e-30c8-4e52-b200-da042ff1ed1c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr\" (UID: \"b1e4991e-30c8-4e52-b200-da042ff1ed1c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr"
Sep 09 15:28:55.662177 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.662145    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1e4991e-30c8-4e52-b200-da042ff1ed1c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr\" (UID: \"b1e4991e-30c8-4e52-b200-da042ff1ed1c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr"
Sep 09 15:28:55.662456 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.662441    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1e4991e-30c8-4e52-b200-da042ff1ed1c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr\" (UID: \"b1e4991e-30c8-4e52-b200-da042ff1ed1c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr"
Sep 09 15:28:55.662535 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.662514    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1e4991e-30c8-4e52-b200-da042ff1ed1c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr\" (UID: \"b1e4991e-30c8-4e52-b200-da042ff1ed1c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr"
Sep 09 15:28:55.670944 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.670919    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b764b\" (UniqueName: \"kubernetes.io/projected/b1e4991e-30c8-4e52-b200-da042ff1ed1c-kube-api-access-b764b\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr\" (UID: \"b1e4991e-30c8-4e52-b200-da042ff1ed1c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr"
Sep 09 15:28:55.796019 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:55.795924    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr"
Sep 09 15:28:56.068115 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:56.068090    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr"]
Sep 09 15:28:56.070978 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:28:56.070955    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e4991e_30c8_4e52_b200_da042ff1ed1c.slice/crio-c0ff5f71023de5592c892621f3cc6065751660f2bee80e3eee74bb4d5b14d1c5 WatchSource:0}: Error finding container c0ff5f71023de5592c892621f3cc6065751660f2bee80e3eee74bb4d5b14d1c5: Status 404 returned error can't find the container with id c0ff5f71023de5592c892621f3cc6065751660f2bee80e3eee74bb4d5b14d1c5
Sep 09 15:28:56.149021 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:28:56.148980    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr" event={"ID":"b1e4991e-30c8-4e52-b200-da042ff1ed1c","Type":"ContainerStarted","Data":"c0ff5f71023de5592c892621f3cc6065751660f2bee80e3eee74bb4d5b14d1c5"}
Sep 09 15:29:02.177643 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:02.177604    2574 generic.go:356] "Generic (PLEG): container finished" podID="b1e4991e-30c8-4e52-b200-da042ff1ed1c" containerID="9b8c37c6b922efb81359187b52f776a94c38092795ee3ca4b4bb9ac7cf7ae4dd" exitCode=0
Sep 09 15:29:02.178044 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:02.177685    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr" event={"ID":"b1e4991e-30c8-4e52-b200-da042ff1ed1c","Type":"ContainerDied","Data":"9b8c37c6b922efb81359187b52f776a94c38092795ee3ca4b4bb9ac7cf7ae4dd"}
Sep 09 15:29:05.192781 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:05.192746    2574 generic.go:356] "Generic (PLEG): container finished" podID="b1e4991e-30c8-4e52-b200-da042ff1ed1c" containerID="ad644ad6183aae4e12152269950d9d4e6bea84462063b69e6d1772d40f753676" exitCode=0
Sep 09 15:29:05.193186 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:05.192803    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr" event={"ID":"b1e4991e-30c8-4e52-b200-da042ff1ed1c","Type":"ContainerDied","Data":"ad644ad6183aae4e12152269950d9d4e6bea84462063b69e6d1772d40f753676"}
Sep 09 15:29:12.233006 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:12.232965    2574 generic.go:356] "Generic (PLEG): container finished" podID="b1e4991e-30c8-4e52-b200-da042ff1ed1c" containerID="692ca26bf94f9e64f21802816dc778830aa7ca5e75e6c0c53afacf3f49e0fbc2" exitCode=0
Sep 09 15:29:12.233380 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:12.233051    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr" event={"ID":"b1e4991e-30c8-4e52-b200-da042ff1ed1c","Type":"ContainerDied","Data":"692ca26bf94f9e64f21802816dc778830aa7ca5e75e6c0c53afacf3f49e0fbc2"}
Sep 09 15:29:13.363614 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:13.363585    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr"
Sep 09 15:29:13.420174 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:13.420138    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1e4991e-30c8-4e52-b200-da042ff1ed1c-util\") pod \"b1e4991e-30c8-4e52-b200-da042ff1ed1c\" (UID: \"b1e4991e-30c8-4e52-b200-da042ff1ed1c\") "
Sep 09 15:29:13.420342 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:13.420208    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1e4991e-30c8-4e52-b200-da042ff1ed1c-bundle\") pod \"b1e4991e-30c8-4e52-b200-da042ff1ed1c\" (UID: \"b1e4991e-30c8-4e52-b200-da042ff1ed1c\") "
Sep 09 15:29:13.420342 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:13.420275    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b764b\" (UniqueName: \"kubernetes.io/projected/b1e4991e-30c8-4e52-b200-da042ff1ed1c-kube-api-access-b764b\") pod \"b1e4991e-30c8-4e52-b200-da042ff1ed1c\" (UID: \"b1e4991e-30c8-4e52-b200-da042ff1ed1c\") "
Sep 09 15:29:13.420884 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:13.420829    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1e4991e-30c8-4e52-b200-da042ff1ed1c-bundle" (OuterVolumeSpecName: "bundle") pod "b1e4991e-30c8-4e52-b200-da042ff1ed1c" (UID: "b1e4991e-30c8-4e52-b200-da042ff1ed1c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:29:13.422642 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:13.422614    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1e4991e-30c8-4e52-b200-da042ff1ed1c-kube-api-access-b764b" (OuterVolumeSpecName: "kube-api-access-b764b") pod "b1e4991e-30c8-4e52-b200-da042ff1ed1c" (UID: "b1e4991e-30c8-4e52-b200-da042ff1ed1c"). InnerVolumeSpecName "kube-api-access-b764b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:29:13.426674 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:13.426643    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1e4991e-30c8-4e52-b200-da042ff1ed1c-util" (OuterVolumeSpecName: "util") pod "b1e4991e-30c8-4e52-b200-da042ff1ed1c" (UID: "b1e4991e-30c8-4e52-b200-da042ff1ed1c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:29:13.521778 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:13.521688    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b764b\" (UniqueName: \"kubernetes.io/projected/b1e4991e-30c8-4e52-b200-da042ff1ed1c-kube-api-access-b764b\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:29:13.521778 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:13.521723    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1e4991e-30c8-4e52-b200-da042ff1ed1c-util\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:29:13.521778 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:13.521732    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1e4991e-30c8-4e52-b200-da042ff1ed1c-bundle\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:29:14.241789 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:14.241761    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr"
Sep 09 15:29:14.241789 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:14.241768    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540252tr" event={"ID":"b1e4991e-30c8-4e52-b200-da042ff1ed1c","Type":"ContainerDied","Data":"c0ff5f71023de5592c892621f3cc6065751660f2bee80e3eee74bb4d5b14d1c5"}
Sep 09 15:29:14.242026 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:14.241812    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0ff5f71023de5592c892621f3cc6065751660f2bee80e3eee74bb4d5b14d1c5"
Sep 09 15:29:18.474974 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.474939    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzr82"]
Sep 09 15:29:18.475344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.475244    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1e4991e-30c8-4e52-b200-da042ff1ed1c" containerName="pull"
Sep 09 15:29:18.475344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.475257    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e4991e-30c8-4e52-b200-da042ff1ed1c" containerName="pull"
Sep 09 15:29:18.475344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.475275    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1e4991e-30c8-4e52-b200-da042ff1ed1c" containerName="extract"
Sep 09 15:29:18.475344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.475280    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e4991e-30c8-4e52-b200-da042ff1ed1c" containerName="extract"
Sep 09 15:29:18.475344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.475289    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1e4991e-30c8-4e52-b200-da042ff1ed1c" containerName="util"
Sep 09 15:29:18.475344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.475294    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e4991e-30c8-4e52-b200-da042ff1ed1c" containerName="util"
Sep 09 15:29:18.475344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.475343    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1e4991e-30c8-4e52-b200-da042ff1ed1c" containerName="extract"
Sep 09 15:29:18.511173 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.511140    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzr82"]
Sep 09 15:29:18.511340 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.511238    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzr82"
Sep 09 15:29:18.513937 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.513903    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 09 15:29:18.514090 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.513976    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 09 15:29:18.514090 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.514011    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rccfh\""
Sep 09 15:29:18.664657 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.664610    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c85161aa-fa15-43be-9250-70637dc47fc0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzr82\" (UID: \"c85161aa-fa15-43be-9250-70637dc47fc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzr82"
Sep 09 15:29:18.664831 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.664676    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bplj\" (UniqueName: \"kubernetes.io/projected/c85161aa-fa15-43be-9250-70637dc47fc0-kube-api-access-5bplj\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzr82\" (UID: \"c85161aa-fa15-43be-9250-70637dc47fc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzr82"
Sep 09 15:29:18.765338 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.765250    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bplj\" (UniqueName: \"kubernetes.io/projected/c85161aa-fa15-43be-9250-70637dc47fc0-kube-api-access-5bplj\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzr82\" (UID: \"c85161aa-fa15-43be-9250-70637dc47fc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzr82"
Sep 09 15:29:18.765338 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.765322    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c85161aa-fa15-43be-9250-70637dc47fc0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzr82\" (UID: \"c85161aa-fa15-43be-9250-70637dc47fc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzr82"
Sep 09 15:29:18.765694 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.765677    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c85161aa-fa15-43be-9250-70637dc47fc0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzr82\" (UID: \"c85161aa-fa15-43be-9250-70637dc47fc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzr82"
Sep 09 15:29:18.773798 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.773777    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bplj\" (UniqueName: \"kubernetes.io/projected/c85161aa-fa15-43be-9250-70637dc47fc0-kube-api-access-5bplj\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzr82\" (UID: \"c85161aa-fa15-43be-9250-70637dc47fc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzr82"
Sep 09 15:29:18.820768 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:18.820733    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzr82"
Sep 09 15:29:19.116909 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:19.116889    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzr82"]
Sep 09 15:29:19.119792 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:29:19.119762    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85161aa_fa15_43be_9250_70637dc47fc0.slice/crio-7de034534566fcdd55ed09d822001353ef0cb4977c588df241912df372af0f7c WatchSource:0}: Error finding container 7de034534566fcdd55ed09d822001353ef0cb4977c588df241912df372af0f7c: Status 404 returned error can't find the container with id 7de034534566fcdd55ed09d822001353ef0cb4977c588df241912df372af0f7c
Sep 09 15:29:19.268578 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:19.268541    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzr82" event={"ID":"c85161aa-fa15-43be-9250-70637dc47fc0","Type":"ContainerStarted","Data":"7de034534566fcdd55ed09d822001353ef0cb4977c588df241912df372af0f7c"}
Sep 09 15:29:22.286214 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.286176    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzr82" event={"ID":"c85161aa-fa15-43be-9250-70637dc47fc0","Type":"ContainerStarted","Data":"fbc423dc478737bc8edb8f1f6a81db74a531c7eb66ea447d64e815f4b153548f"}
Sep 09 15:29:22.325012 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.324957    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzr82" podStartSLOduration=2.111232779 podStartE2EDuration="4.32494121s" totalImagesPullingTime="2.213708431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:29:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:29:22.324567722 +0000 UTC m=+546.514770487" watchObservedRunningTime="2026-09-09 15:29:22.32494121 +0000 UTC m=+546.515143959"
Sep 09 15:29:22.456627 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.456588    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sv52m"]
Sep 09 15:29:22.479667 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.479635    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sv52m"]
Sep 09 15:29:22.479824 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.479742    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sv52m"
Sep 09 15:29:22.482490 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.482466    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 15:29:22.482627 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.482496    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 15:29:22.482627 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.482598    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-55qsn\""
Sep 09 15:29:22.599058 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.598963    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d5c969a-22a4-426d-ae37-a59c4ffeb3ea-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sv52m\" (UID: \"6d5c969a-22a4-426d-ae37-a59c4ffeb3ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sv52m"
Sep 09 15:29:22.599058 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.599018    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5t7z\" (UniqueName: \"kubernetes.io/projected/6d5c969a-22a4-426d-ae37-a59c4ffeb3ea-kube-api-access-g5t7z\") pod \"cert-manager-webhook-6486ffd997-sv52m\" (UID: \"6d5c969a-22a4-426d-ae37-a59c4ffeb3ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sv52m"
Sep 09 15:29:22.700399 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.700362    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5t7z\" (UniqueName: \"kubernetes.io/projected/6d5c969a-22a4-426d-ae37-a59c4ffeb3ea-kube-api-access-g5t7z\") pod \"cert-manager-webhook-6486ffd997-sv52m\" (UID: \"6d5c969a-22a4-426d-ae37-a59c4ffeb3ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sv52m"
Sep 09 15:29:22.700551 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.700464    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d5c969a-22a4-426d-ae37-a59c4ffeb3ea-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sv52m\" (UID: \"6d5c969a-22a4-426d-ae37-a59c4ffeb3ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sv52m"
Sep 09 15:29:22.713959 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.713929    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d5c969a-22a4-426d-ae37-a59c4ffeb3ea-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sv52m\" (UID: \"6d5c969a-22a4-426d-ae37-a59c4ffeb3ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sv52m"
Sep 09 15:29:22.714187 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.714168    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5t7z\" (UniqueName: \"kubernetes.io/projected/6d5c969a-22a4-426d-ae37-a59c4ffeb3ea-kube-api-access-g5t7z\") pod \"cert-manager-webhook-6486ffd997-sv52m\" (UID: \"6d5c969a-22a4-426d-ae37-a59c4ffeb3ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sv52m"
Sep 09 15:29:22.801976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.801940    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sv52m"
Sep 09 15:29:22.876780 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.876742    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl"]
Sep 09 15:29:22.893344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.893314    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl"
Sep 09 15:29:22.894252 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.894230    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl"]
Sep 09 15:29:22.896726 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.896702    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 15:29:22.896915 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.896702    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 15:29:22.897141 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:22.897126    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vln6l\""
Sep 09 15:29:23.003807 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:23.003772    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e533e691-ba83-43f9-8092-86660bf6be8c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl\" (UID: \"e533e691-ba83-43f9-8092-86660bf6be8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl"
Sep 09 15:29:23.003995 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:23.003892    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmxl8\" (UniqueName: \"kubernetes.io/projected/e533e691-ba83-43f9-8092-86660bf6be8c-kube-api-access-cmxl8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl\" (UID: \"e533e691-ba83-43f9-8092-86660bf6be8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl"
Sep 09 15:29:23.003995 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:23.003927    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e533e691-ba83-43f9-8092-86660bf6be8c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl\" (UID: \"e533e691-ba83-43f9-8092-86660bf6be8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl"
Sep 09 15:29:23.100747 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:23.100714    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sv52m"]
Sep 09 15:29:23.104037 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:29:23.104006    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d5c969a_22a4_426d_ae37_a59c4ffeb3ea.slice/crio-9a3b76f9649e452e8f0d86bf4665bed9696d9e39e1bf95fa272a48b9f6905400 WatchSource:0}: Error finding container 9a3b76f9649e452e8f0d86bf4665bed9696d9e39e1bf95fa272a48b9f6905400: Status 404 returned error can't find the container with id 9a3b76f9649e452e8f0d86bf4665bed9696d9e39e1bf95fa272a48b9f6905400
Sep 09 15:29:23.104303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:23.104285    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmxl8\" (UniqueName: \"kubernetes.io/projected/e533e691-ba83-43f9-8092-86660bf6be8c-kube-api-access-cmxl8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl\" (UID: \"e533e691-ba83-43f9-8092-86660bf6be8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl"
Sep 09 15:29:23.104359 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:23.104316    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e533e691-ba83-43f9-8092-86660bf6be8c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl\" (UID: \"e533e691-ba83-43f9-8092-86660bf6be8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl"
Sep 09 15:29:23.104397 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:23.104365    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e533e691-ba83-43f9-8092-86660bf6be8c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl\" (UID: \"e533e691-ba83-43f9-8092-86660bf6be8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl"
Sep 09 15:29:23.104755 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:23.104689    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e533e691-ba83-43f9-8092-86660bf6be8c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl\" (UID: \"e533e691-ba83-43f9-8092-86660bf6be8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl"
Sep 09 15:29:23.104755 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:23.104741    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e533e691-ba83-43f9-8092-86660bf6be8c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl\" (UID: \"e533e691-ba83-43f9-8092-86660bf6be8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl"
Sep 09 15:29:23.116633 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:23.116581    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmxl8\" (UniqueName: \"kubernetes.io/projected/e533e691-ba83-43f9-8092-86660bf6be8c-kube-api-access-cmxl8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl\" (UID: \"e533e691-ba83-43f9-8092-86660bf6be8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl"
Sep 09 15:29:23.204060 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:23.204017    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl"
Sep 09 15:29:23.293502 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:23.293465    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sv52m" event={"ID":"6d5c969a-22a4-426d-ae37-a59c4ffeb3ea","Type":"ContainerStarted","Data":"9a3b76f9649e452e8f0d86bf4665bed9696d9e39e1bf95fa272a48b9f6905400"}
Sep 09 15:29:23.506430 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:23.506402    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl"]
Sep 09 15:29:23.508889 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:29:23.508836    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode533e691_ba83_43f9_8092_86660bf6be8c.slice/crio-6e8a401079181c7e31174c4abbe842a5859e9fef756dd39c7c4d8b0e84a0cced WatchSource:0}: Error finding container 6e8a401079181c7e31174c4abbe842a5859e9fef756dd39c7c4d8b0e84a0cced: Status 404 returned error can't find the container with id 6e8a401079181c7e31174c4abbe842a5859e9fef756dd39c7c4d8b0e84a0cced
Sep 09 15:29:24.300022 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:24.299988    2574 generic.go:356] "Generic (PLEG): container finished" podID="e533e691-ba83-43f9-8092-86660bf6be8c" containerID="3591f12ba2726ba81ab7f75cde8aa2cf194998662d0736008f71dbbe71d31b68" exitCode=0
Sep 09 15:29:24.300463 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:24.300038    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl" event={"ID":"e533e691-ba83-43f9-8092-86660bf6be8c","Type":"ContainerDied","Data":"3591f12ba2726ba81ab7f75cde8aa2cf194998662d0736008f71dbbe71d31b68"}
Sep 09 15:29:24.300463 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:24.300085    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl" event={"ID":"e533e691-ba83-43f9-8092-86660bf6be8c","Type":"ContainerStarted","Data":"6e8a401079181c7e31174c4abbe842a5859e9fef756dd39c7c4d8b0e84a0cced"}
Sep 09 15:29:26.311784 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:26.311748    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sv52m" event={"ID":"6d5c969a-22a4-426d-ae37-a59c4ffeb3ea","Type":"ContainerStarted","Data":"ae64be55ab39d181579c286ebd2a2a82bf3457a2325b2186a582a26c537b9f7e"}
Sep 09 15:29:26.312320 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:26.311889    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sv52m"
Sep 09 15:29:26.329093 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:26.329039    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-sv52m" podStartSLOduration=1.593032734 podStartE2EDuration="4.329024985s" totalImagesPullingTime="2.735992251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:29:26.327810037 +0000 UTC m=+550.518012786" watchObservedRunningTime="2026-09-09 15:29:26.329024985 +0000 UTC m=+550.519227734"
Sep 09 15:29:28.322130 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:28.322092    2574 generic.go:356] "Generic (PLEG): container finished" podID="e533e691-ba83-43f9-8092-86660bf6be8c" containerID="2796d0b89d34a862100ff137c9c1fd51ead198e916314a87f8da38edc58877a0" exitCode=0
Sep 09 15:29:28.322537 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:28.322180    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl" event={"ID":"e533e691-ba83-43f9-8092-86660bf6be8c","Type":"ContainerDied","Data":"2796d0b89d34a862100ff137c9c1fd51ead198e916314a87f8da38edc58877a0"}
Sep 09 15:29:29.329254 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:29.329216    2574 generic.go:356] "Generic (PLEG): container finished" podID="e533e691-ba83-43f9-8092-86660bf6be8c" containerID="a732db2c97bdb6a8fba15d2c5c6fac61120540c7156c4f581f2439aa08dfaa89" exitCode=0
Sep 09 15:29:29.329657 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:29.329267    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl" event={"ID":"e533e691-ba83-43f9-8092-86660bf6be8c","Type":"ContainerDied","Data":"a732db2c97bdb6a8fba15d2c5c6fac61120540c7156c4f581f2439aa08dfaa89"}
Sep 09 15:29:30.263310 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.263272    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5dwjw"]
Sep 09 15:29:30.267424 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.267401    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dwjw"
Sep 09 15:29:30.270162 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.270134    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-66jph\""
Sep 09 15:29:30.274083 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.274059    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5dwjw"]
Sep 09 15:29:30.366574 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.366532    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-786rb\" (UniqueName: \"kubernetes.io/projected/7141d5ac-9352-4406-aa90-066517b1a114-kube-api-access-786rb\") pod \"cert-manager-cainjector-559cdd8c87-5dwjw\" (UID: \"7141d5ac-9352-4406-aa90-066517b1a114\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dwjw"
Sep 09 15:29:30.366998 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.366668    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7141d5ac-9352-4406-aa90-066517b1a114-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5dwjw\" (UID: \"7141d5ac-9352-4406-aa90-066517b1a114\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dwjw"
Sep 09 15:29:30.458607 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.458581    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl"
Sep 09 15:29:30.467604 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.467583    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7141d5ac-9352-4406-aa90-066517b1a114-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5dwjw\" (UID: \"7141d5ac-9352-4406-aa90-066517b1a114\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dwjw"
Sep 09 15:29:30.467708 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.467633    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-786rb\" (UniqueName: \"kubernetes.io/projected/7141d5ac-9352-4406-aa90-066517b1a114-kube-api-access-786rb\") pod \"cert-manager-cainjector-559cdd8c87-5dwjw\" (UID: \"7141d5ac-9352-4406-aa90-066517b1a114\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dwjw"
Sep 09 15:29:30.480521 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.480494    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7141d5ac-9352-4406-aa90-066517b1a114-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5dwjw\" (UID: \"7141d5ac-9352-4406-aa90-066517b1a114\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dwjw"
Sep 09 15:29:30.480725 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.480702    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-786rb\" (UniqueName: \"kubernetes.io/projected/7141d5ac-9352-4406-aa90-066517b1a114-kube-api-access-786rb\") pod \"cert-manager-cainjector-559cdd8c87-5dwjw\" (UID: \"7141d5ac-9352-4406-aa90-066517b1a114\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dwjw"
Sep 09 15:29:30.568758 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.568668    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e533e691-ba83-43f9-8092-86660bf6be8c-bundle\") pod \"e533e691-ba83-43f9-8092-86660bf6be8c\" (UID: \"e533e691-ba83-43f9-8092-86660bf6be8c\") "
Sep 09 15:29:30.568758 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.568732    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmxl8\" (UniqueName: \"kubernetes.io/projected/e533e691-ba83-43f9-8092-86660bf6be8c-kube-api-access-cmxl8\") pod \"e533e691-ba83-43f9-8092-86660bf6be8c\" (UID: \"e533e691-ba83-43f9-8092-86660bf6be8c\") "
Sep 09 15:29:30.569009 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.568773    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e533e691-ba83-43f9-8092-86660bf6be8c-util\") pod \"e533e691-ba83-43f9-8092-86660bf6be8c\" (UID: \"e533e691-ba83-43f9-8092-86660bf6be8c\") "
Sep 09 15:29:30.569174 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.569151    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e533e691-ba83-43f9-8092-86660bf6be8c-bundle" (OuterVolumeSpecName: "bundle") pod "e533e691-ba83-43f9-8092-86660bf6be8c" (UID: "e533e691-ba83-43f9-8092-86660bf6be8c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:29:30.571024 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.571001    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e533e691-ba83-43f9-8092-86660bf6be8c-kube-api-access-cmxl8" (OuterVolumeSpecName: "kube-api-access-cmxl8") pod "e533e691-ba83-43f9-8092-86660bf6be8c" (UID: "e533e691-ba83-43f9-8092-86660bf6be8c"). InnerVolumeSpecName "kube-api-access-cmxl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:29:30.573799 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.573775    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e533e691-ba83-43f9-8092-86660bf6be8c-util" (OuterVolumeSpecName: "util") pod "e533e691-ba83-43f9-8092-86660bf6be8c" (UID: "e533e691-ba83-43f9-8092-86660bf6be8c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:29:30.577133 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.577108    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dwjw"
Sep 09 15:29:30.669954 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.669923    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmxl8\" (UniqueName: \"kubernetes.io/projected/e533e691-ba83-43f9-8092-86660bf6be8c-kube-api-access-cmxl8\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:29:30.669954 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.669950    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e533e691-ba83-43f9-8092-86660bf6be8c-util\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:29:30.669954 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.669961    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e533e691-ba83-43f9-8092-86660bf6be8c-bundle\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:29:30.849782 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:30.849700    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5dwjw"]
Sep 09 15:29:30.852482 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:29:30.852451    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7141d5ac_9352_4406_aa90_066517b1a114.slice/crio-8d37ec3ae141d936205802c902fb49059e8df6678e5161a7ab89f1389602299d WatchSource:0}: Error finding container 8d37ec3ae141d936205802c902fb49059e8df6678e5161a7ab89f1389602299d: Status 404 returned error can't find the container with id 8d37ec3ae141d936205802c902fb49059e8df6678e5161a7ab89f1389602299d
Sep 09 15:29:31.339967 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:31.339925    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dwjw" event={"ID":"7141d5ac-9352-4406-aa90-066517b1a114","Type":"ContainerStarted","Data":"e5a5bf0710d2d7953a523fd283c12332792fb86e4484e56c2f053c5597574712"}
Sep 09 15:29:31.340177 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:31.339977    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dwjw" event={"ID":"7141d5ac-9352-4406-aa90-066517b1a114","Type":"ContainerStarted","Data":"8d37ec3ae141d936205802c902fb49059e8df6678e5161a7ab89f1389602299d"}
Sep 09 15:29:31.341934 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:31.341900    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl" event={"ID":"e533e691-ba83-43f9-8092-86660bf6be8c","Type":"ContainerDied","Data":"6e8a401079181c7e31174c4abbe842a5859e9fef756dd39c7c4d8b0e84a0cced"}
Sep 09 15:29:31.342032 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:31.341954    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e8a401079181c7e31174c4abbe842a5859e9fef756dd39c7c4d8b0e84a0cced"
Sep 09 15:29:31.342032 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:31.341954    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff74vl"
Sep 09 15:29:31.356356 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:31.356308    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dwjw" podStartSLOduration=1.356292804 podStartE2EDuration="1.356292804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:29:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:29:31.354977722 +0000 UTC m=+555.545180498" watchObservedRunningTime="2026-09-09 15:29:31.356292804 +0000 UTC m=+555.546495547"
Sep 09 15:29:32.320347 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:32.320316    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sv52m"
Sep 09 15:29:33.396619 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.396585    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tqccx"]
Sep 09 15:29:33.396988 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.396973    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e533e691-ba83-43f9-8092-86660bf6be8c" containerName="util"
Sep 09 15:29:33.396988 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.396988    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e533e691-ba83-43f9-8092-86660bf6be8c" containerName="util"
Sep 09 15:29:33.397051 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.397001    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e533e691-ba83-43f9-8092-86660bf6be8c" containerName="extract"
Sep 09 15:29:33.397051 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.397007    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e533e691-ba83-43f9-8092-86660bf6be8c" containerName="extract"
Sep 09 15:29:33.397051 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.397016    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e533e691-ba83-43f9-8092-86660bf6be8c" containerName="pull"
Sep 09 15:29:33.397051 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.397021    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e533e691-ba83-43f9-8092-86660bf6be8c" containerName="pull"
Sep 09 15:29:33.397186 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.397069    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e533e691-ba83-43f9-8092-86660bf6be8c" containerName="extract"
Sep 09 15:29:33.400590 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.400570    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tqccx"
Sep 09 15:29:33.403240 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.403222    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-phqgz\""
Sep 09 15:29:33.410042 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.410020    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tqccx"]
Sep 09 15:29:33.591737 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.591695    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k8sh\" (UniqueName: \"kubernetes.io/projected/cacf6629-d9b4-4933-8699-1d5479dd034a-kube-api-access-2k8sh\") pod \"cert-manager-55b4d954d5-tqccx\" (UID: \"cacf6629-d9b4-4933-8699-1d5479dd034a\") " pod="cert-manager/cert-manager-55b4d954d5-tqccx"
Sep 09 15:29:33.591960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.591828    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cacf6629-d9b4-4933-8699-1d5479dd034a-bound-sa-token\") pod \"cert-manager-55b4d954d5-tqccx\" (UID: \"cacf6629-d9b4-4933-8699-1d5479dd034a\") " pod="cert-manager/cert-manager-55b4d954d5-tqccx"
Sep 09 15:29:33.692796 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.692760    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cacf6629-d9b4-4933-8699-1d5479dd034a-bound-sa-token\") pod \"cert-manager-55b4d954d5-tqccx\" (UID: \"cacf6629-d9b4-4933-8699-1d5479dd034a\") " pod="cert-manager/cert-manager-55b4d954d5-tqccx"
Sep 09 15:29:33.693028 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.692825    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k8sh\" (UniqueName: \"kubernetes.io/projected/cacf6629-d9b4-4933-8699-1d5479dd034a-kube-api-access-2k8sh\") pod \"cert-manager-55b4d954d5-tqccx\" (UID: \"cacf6629-d9b4-4933-8699-1d5479dd034a\") " pod="cert-manager/cert-manager-55b4d954d5-tqccx"
Sep 09 15:29:33.702033 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.702002    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cacf6629-d9b4-4933-8699-1d5479dd034a-bound-sa-token\") pod \"cert-manager-55b4d954d5-tqccx\" (UID: \"cacf6629-d9b4-4933-8699-1d5479dd034a\") " pod="cert-manager/cert-manager-55b4d954d5-tqccx"
Sep 09 15:29:33.702165 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.702002    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k8sh\" (UniqueName: \"kubernetes.io/projected/cacf6629-d9b4-4933-8699-1d5479dd034a-kube-api-access-2k8sh\") pod \"cert-manager-55b4d954d5-tqccx\" (UID: \"cacf6629-d9b4-4933-8699-1d5479dd034a\") " pod="cert-manager/cert-manager-55b4d954d5-tqccx"
Sep 09 15:29:33.710063 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.710038    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tqccx"
Sep 09 15:29:33.988454 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:33.985414    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tqccx"]
Sep 09 15:29:34.356344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:34.356249    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tqccx" event={"ID":"cacf6629-d9b4-4933-8699-1d5479dd034a","Type":"ContainerStarted","Data":"05c09638161d7e30e240dc676bea98c20f6e0c2e7e131f48aa550d72b7a1946b"}
Sep 09 15:29:34.356344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:34.356296    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tqccx" event={"ID":"cacf6629-d9b4-4933-8699-1d5479dd034a","Type":"ContainerStarted","Data":"003a59188c84937b3a3dbd1e4bb326cc5a4654f65a5b486da6f307b942f702e2"}
Sep 09 15:29:34.372931 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:34.372875    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-tqccx" podStartSLOduration=1.372859134 podStartE2EDuration="1.372859134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:29:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:29:34.371687621 +0000 UTC m=+558.561890382" watchObservedRunningTime="2026-09-09 15:29:34.372859134 +0000 UTC m=+558.563061874"
Sep 09 15:29:42.808302 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:42.808262    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98"]
Sep 09 15:29:42.811806 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:42.811784    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98"
Sep 09 15:29:42.814588 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:42.814557    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 15:29:42.814588 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:42.814577    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vln6l\""
Sep 09 15:29:42.814775 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:42.814557    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 15:29:42.819923 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:42.819897    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98"]
Sep 09 15:29:42.868136 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:42.868092    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49smj\" (UniqueName: \"kubernetes.io/projected/f96935b6-53c7-4fb0-aa25-9463d41413f2-kube-api-access-49smj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98\" (UID: \"f96935b6-53c7-4fb0-aa25-9463d41413f2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98"
Sep 09 15:29:42.868279 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:42.868167    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f96935b6-53c7-4fb0-aa25-9463d41413f2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98\" (UID: \"f96935b6-53c7-4fb0-aa25-9463d41413f2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98"
Sep 09 15:29:42.868279 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:42.868258    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f96935b6-53c7-4fb0-aa25-9463d41413f2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98\" (UID: \"f96935b6-53c7-4fb0-aa25-9463d41413f2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98"
Sep 09 15:29:42.969195 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:42.969158    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49smj\" (UniqueName: \"kubernetes.io/projected/f96935b6-53c7-4fb0-aa25-9463d41413f2-kube-api-access-49smj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98\" (UID: \"f96935b6-53c7-4fb0-aa25-9463d41413f2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98"
Sep 09 15:29:42.969377 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:42.969225    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f96935b6-53c7-4fb0-aa25-9463d41413f2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98\" (UID: \"f96935b6-53c7-4fb0-aa25-9463d41413f2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98"
Sep 09 15:29:42.969377 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:42.969282    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f96935b6-53c7-4fb0-aa25-9463d41413f2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98\" (UID: \"f96935b6-53c7-4fb0-aa25-9463d41413f2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98"
Sep 09 15:29:42.969674 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:42.969643    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f96935b6-53c7-4fb0-aa25-9463d41413f2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98\" (UID: \"f96935b6-53c7-4fb0-aa25-9463d41413f2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98"
Sep 09 15:29:42.969717 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:42.969674    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f96935b6-53c7-4fb0-aa25-9463d41413f2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98\" (UID: \"f96935b6-53c7-4fb0-aa25-9463d41413f2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98"
Sep 09 15:29:42.977816 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:42.977792    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49smj\" (UniqueName: \"kubernetes.io/projected/f96935b6-53c7-4fb0-aa25-9463d41413f2-kube-api-access-49smj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98\" (UID: \"f96935b6-53c7-4fb0-aa25-9463d41413f2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98"
Sep 09 15:29:43.122607 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:43.122531    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98"
Sep 09 15:29:43.403339 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:43.403234    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98"]
Sep 09 15:29:43.405863 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:29:43.405822    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf96935b6_53c7_4fb0_aa25_9463d41413f2.slice/crio-fe55adbcaabe7f22d219cc75d596325933db1647e4d037adc2bff66329528cc2 WatchSource:0}: Error finding container fe55adbcaabe7f22d219cc75d596325933db1647e4d037adc2bff66329528cc2: Status 404 returned error can't find the container with id fe55adbcaabe7f22d219cc75d596325933db1647e4d037adc2bff66329528cc2
Sep 09 15:29:44.407916 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:44.407791    2574 generic.go:356] "Generic (PLEG): container finished" podID="f96935b6-53c7-4fb0-aa25-9463d41413f2" containerID="14671584d1f5ac67e9f92f85c6b9d4289d0b5077852ea39d9070cc6b68207b23" exitCode=0
Sep 09 15:29:44.407916 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:44.407879    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98" event={"ID":"f96935b6-53c7-4fb0-aa25-9463d41413f2","Type":"ContainerDied","Data":"14671584d1f5ac67e9f92f85c6b9d4289d0b5077852ea39d9070cc6b68207b23"}
Sep 09 15:29:44.408367 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:44.407932    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98" event={"ID":"f96935b6-53c7-4fb0-aa25-9463d41413f2","Type":"ContainerStarted","Data":"fe55adbcaabe7f22d219cc75d596325933db1647e4d037adc2bff66329528cc2"}
Sep 09 15:29:45.414395 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:45.414294    2574 generic.go:356] "Generic (PLEG): container finished" podID="f96935b6-53c7-4fb0-aa25-9463d41413f2" containerID="e05c77184b73e92688f79edac36d71bd880470788dbd9ba4e0207553ea8383e3" exitCode=0
Sep 09 15:29:45.414751 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:45.414393    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98" event={"ID":"f96935b6-53c7-4fb0-aa25-9463d41413f2","Type":"ContainerDied","Data":"e05c77184b73e92688f79edac36d71bd880470788dbd9ba4e0207553ea8383e3"}
Sep 09 15:29:46.421285 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:46.421251    2574 generic.go:356] "Generic (PLEG): container finished" podID="f96935b6-53c7-4fb0-aa25-9463d41413f2" containerID="5c33c610f19b764d6cb473afcc92eb9be3c01079a9356e37c602e30aed18f32c" exitCode=0
Sep 09 15:29:46.421285 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:46.421282    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98" event={"ID":"f96935b6-53c7-4fb0-aa25-9463d41413f2","Type":"ContainerDied","Data":"5c33c610f19b764d6cb473afcc92eb9be3c01079a9356e37c602e30aed18f32c"}
Sep 09 15:29:47.549568 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:47.549543    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98"
Sep 09 15:29:47.606343 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:47.605923    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f96935b6-53c7-4fb0-aa25-9463d41413f2-util\") pod \"f96935b6-53c7-4fb0-aa25-9463d41413f2\" (UID: \"f96935b6-53c7-4fb0-aa25-9463d41413f2\") "
Sep 09 15:29:47.606343 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:47.606028    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f96935b6-53c7-4fb0-aa25-9463d41413f2-bundle\") pod \"f96935b6-53c7-4fb0-aa25-9463d41413f2\" (UID: \"f96935b6-53c7-4fb0-aa25-9463d41413f2\") "
Sep 09 15:29:47.606343 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:47.606060    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49smj\" (UniqueName: \"kubernetes.io/projected/f96935b6-53c7-4fb0-aa25-9463d41413f2-kube-api-access-49smj\") pod \"f96935b6-53c7-4fb0-aa25-9463d41413f2\" (UID: \"f96935b6-53c7-4fb0-aa25-9463d41413f2\") "
Sep 09 15:29:47.607106 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:47.607081    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f96935b6-53c7-4fb0-aa25-9463d41413f2-bundle" (OuterVolumeSpecName: "bundle") pod "f96935b6-53c7-4fb0-aa25-9463d41413f2" (UID: "f96935b6-53c7-4fb0-aa25-9463d41413f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:29:47.608509 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:47.608484    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f96935b6-53c7-4fb0-aa25-9463d41413f2-kube-api-access-49smj" (OuterVolumeSpecName: "kube-api-access-49smj") pod "f96935b6-53c7-4fb0-aa25-9463d41413f2" (UID: "f96935b6-53c7-4fb0-aa25-9463d41413f2"). InnerVolumeSpecName "kube-api-access-49smj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:29:47.612345 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:47.612314    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f96935b6-53c7-4fb0-aa25-9463d41413f2-util" (OuterVolumeSpecName: "util") pod "f96935b6-53c7-4fb0-aa25-9463d41413f2" (UID: "f96935b6-53c7-4fb0-aa25-9463d41413f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:29:47.706740 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:47.706698    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f96935b6-53c7-4fb0-aa25-9463d41413f2-util\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:29:47.706740 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:47.706734    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f96935b6-53c7-4fb0-aa25-9463d41413f2-bundle\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:29:47.706740 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:47.706743    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49smj\" (UniqueName: \"kubernetes.io/projected/f96935b6-53c7-4fb0-aa25-9463d41413f2-kube-api-access-49smj\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:29:48.431914 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:48.431880    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98"
Sep 09 15:29:48.432053 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:48.431879    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfm98" event={"ID":"f96935b6-53c7-4fb0-aa25-9463d41413f2","Type":"ContainerDied","Data":"fe55adbcaabe7f22d219cc75d596325933db1647e4d037adc2bff66329528cc2"}
Sep 09 15:29:48.432053 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:48.432001    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe55adbcaabe7f22d219cc75d596325933db1647e4d037adc2bff66329528cc2"
Sep 09 15:29:59.026764 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.026728    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx"]
Sep 09 15:29:59.027253 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.027054    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f96935b6-53c7-4fb0-aa25-9463d41413f2" containerName="extract"
Sep 09 15:29:59.027253 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.027066    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f96935b6-53c7-4fb0-aa25-9463d41413f2" containerName="extract"
Sep 09 15:29:59.027253 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.027079    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f96935b6-53c7-4fb0-aa25-9463d41413f2" containerName="pull"
Sep 09 15:29:59.027253 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.027084    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f96935b6-53c7-4fb0-aa25-9463d41413f2" containerName="pull"
Sep 09 15:29:59.027253 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.027101    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f96935b6-53c7-4fb0-aa25-9463d41413f2" containerName="util"
Sep 09 15:29:59.027253 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.027106    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f96935b6-53c7-4fb0-aa25-9463d41413f2" containerName="util"
Sep 09 15:29:59.027253 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.027169    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f96935b6-53c7-4fb0-aa25-9463d41413f2" containerName="extract"
Sep 09 15:29:59.033314 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.033292    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx"
Sep 09 15:29:59.035920 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.035899    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 15:29:59.036989 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.036968    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 15:29:59.037065 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.036968    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vln6l\""
Sep 09 15:29:59.040057 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.040035    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx"]
Sep 09 15:29:59.099639 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.099606    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc859\" (UniqueName: \"kubernetes.io/projected/f26ccd11-9258-4208-980d-318bbe8aeaeb-kube-api-access-qc859\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx\" (UID: \"f26ccd11-9258-4208-980d-318bbe8aeaeb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx"
Sep 09 15:29:59.099826 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.099667    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f26ccd11-9258-4208-980d-318bbe8aeaeb-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx\" (UID: \"f26ccd11-9258-4208-980d-318bbe8aeaeb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx"
Sep 09 15:29:59.099826 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.099708    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f26ccd11-9258-4208-980d-318bbe8aeaeb-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx\" (UID: \"f26ccd11-9258-4208-980d-318bbe8aeaeb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx"
Sep 09 15:29:59.200738 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.200700    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f26ccd11-9258-4208-980d-318bbe8aeaeb-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx\" (UID: \"f26ccd11-9258-4208-980d-318bbe8aeaeb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx"
Sep 09 15:29:59.200738 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.200744    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f26ccd11-9258-4208-980d-318bbe8aeaeb-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx\" (UID: \"f26ccd11-9258-4208-980d-318bbe8aeaeb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx"
Sep 09 15:29:59.201034 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.200783    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc859\" (UniqueName: \"kubernetes.io/projected/f26ccd11-9258-4208-980d-318bbe8aeaeb-kube-api-access-qc859\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx\" (UID: \"f26ccd11-9258-4208-980d-318bbe8aeaeb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx"
Sep 09 15:29:59.201245 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.201210    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f26ccd11-9258-4208-980d-318bbe8aeaeb-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx\" (UID: \"f26ccd11-9258-4208-980d-318bbe8aeaeb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx"
Sep 09 15:29:59.201245 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.201230    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f26ccd11-9258-4208-980d-318bbe8aeaeb-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx\" (UID: \"f26ccd11-9258-4208-980d-318bbe8aeaeb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx"
Sep 09 15:29:59.211273 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.211248    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc859\" (UniqueName: \"kubernetes.io/projected/f26ccd11-9258-4208-980d-318bbe8aeaeb-kube-api-access-qc859\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx\" (UID: \"f26ccd11-9258-4208-980d-318bbe8aeaeb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx"
Sep 09 15:29:59.343059 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.342969    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx"
Sep 09 15:29:59.616672 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:29:59.616648    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx"]
Sep 09 15:29:59.619084 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:29:59.619056    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26ccd11_9258_4208_980d_318bbe8aeaeb.slice/crio-b621f96a23910c9c3063864cd64e312beffc460f7fe80c6100446c5ac408a780 WatchSource:0}: Error finding container b621f96a23910c9c3063864cd64e312beffc460f7fe80c6100446c5ac408a780: Status 404 returned error can't find the container with id b621f96a23910c9c3063864cd64e312beffc460f7fe80c6100446c5ac408a780
Sep 09 15:30:00.138188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.138149    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"]
Sep 09 15:30:00.141529 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.141511    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.144880 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.144837    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 15:30:00.145026 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.144907    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 15:30:00.145026 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.144912    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 15:30:00.145172 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.145159    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hpnwk\""
Sep 09 15:30:00.145328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.145317    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 15:30:00.155648 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.155622    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"]
Sep 09 15:30:00.208964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.208928    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35240fa2-cbec-4735-a4f4-9b804ff6cfb6-webhook-cert\") pod \"opendatahub-operator-controller-manager-74fc54996-9d727\" (UID: \"35240fa2-cbec-4735-a4f4-9b804ff6cfb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.208964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.208971    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/35240fa2-cbec-4735-a4f4-9b804ff6cfb6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74fc54996-9d727\" (UID: \"35240fa2-cbec-4735-a4f4-9b804ff6cfb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.209190 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.209002    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9hb4\" (UniqueName: \"kubernetes.io/projected/35240fa2-cbec-4735-a4f4-9b804ff6cfb6-kube-api-access-m9hb4\") pod \"opendatahub-operator-controller-manager-74fc54996-9d727\" (UID: \"35240fa2-cbec-4735-a4f4-9b804ff6cfb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.209190 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.209040    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/35240fa2-cbec-4735-a4f4-9b804ff6cfb6-manifests\") pod \"opendatahub-operator-controller-manager-74fc54996-9d727\" (UID: \"35240fa2-cbec-4735-a4f4-9b804ff6cfb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.209190 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.209069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35240fa2-cbec-4735-a4f4-9b804ff6cfb6-tmp\") pod \"opendatahub-operator-controller-manager-74fc54996-9d727\" (UID: \"35240fa2-cbec-4735-a4f4-9b804ff6cfb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.309664 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.309619    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35240fa2-cbec-4735-a4f4-9b804ff6cfb6-tmp\") pod \"opendatahub-operator-controller-manager-74fc54996-9d727\" (UID: \"35240fa2-cbec-4735-a4f4-9b804ff6cfb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.309895 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.309688    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35240fa2-cbec-4735-a4f4-9b804ff6cfb6-webhook-cert\") pod \"opendatahub-operator-controller-manager-74fc54996-9d727\" (UID: \"35240fa2-cbec-4735-a4f4-9b804ff6cfb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.309895 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.309710    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/35240fa2-cbec-4735-a4f4-9b804ff6cfb6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74fc54996-9d727\" (UID: \"35240fa2-cbec-4735-a4f4-9b804ff6cfb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.309895 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.309738    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9hb4\" (UniqueName: \"kubernetes.io/projected/35240fa2-cbec-4735-a4f4-9b804ff6cfb6-kube-api-access-m9hb4\") pod \"opendatahub-operator-controller-manager-74fc54996-9d727\" (UID: \"35240fa2-cbec-4735-a4f4-9b804ff6cfb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.309895 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.309757    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/35240fa2-cbec-4735-a4f4-9b804ff6cfb6-manifests\") pod \"opendatahub-operator-controller-manager-74fc54996-9d727\" (UID: \"35240fa2-cbec-4735-a4f4-9b804ff6cfb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.310215 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.310185    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/35240fa2-cbec-4735-a4f4-9b804ff6cfb6-manifests\") pod \"opendatahub-operator-controller-manager-74fc54996-9d727\" (UID: \"35240fa2-cbec-4735-a4f4-9b804ff6cfb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.312251 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.312229    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35240fa2-cbec-4735-a4f4-9b804ff6cfb6-tmp\") pod \"opendatahub-operator-controller-manager-74fc54996-9d727\" (UID: \"35240fa2-cbec-4735-a4f4-9b804ff6cfb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.312459 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.312444    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35240fa2-cbec-4735-a4f4-9b804ff6cfb6-webhook-cert\") pod \"opendatahub-operator-controller-manager-74fc54996-9d727\" (UID: \"35240fa2-cbec-4735-a4f4-9b804ff6cfb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.312501 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.312464    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/35240fa2-cbec-4735-a4f4-9b804ff6cfb6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74fc54996-9d727\" (UID: \"35240fa2-cbec-4735-a4f4-9b804ff6cfb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.326962 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.326939    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9hb4\" (UniqueName: \"kubernetes.io/projected/35240fa2-cbec-4735-a4f4-9b804ff6cfb6-kube-api-access-m9hb4\") pod \"opendatahub-operator-controller-manager-74fc54996-9d727\" (UID: \"35240fa2-cbec-4735-a4f4-9b804ff6cfb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.452425 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.452388    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:00.488803 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.488769    2574 generic.go:356] "Generic (PLEG): container finished" podID="f26ccd11-9258-4208-980d-318bbe8aeaeb" containerID="efe6d6654081bbaa7a19d0613a312b0efba3c67ac12033ebd7ee32b2f5b867aa" exitCode=0
Sep 09 15:30:00.488951 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.488888    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx" event={"ID":"f26ccd11-9258-4208-980d-318bbe8aeaeb","Type":"ContainerDied","Data":"efe6d6654081bbaa7a19d0613a312b0efba3c67ac12033ebd7ee32b2f5b867aa"}
Sep 09 15:30:00.489006 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.488956    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx" event={"ID":"f26ccd11-9258-4208-980d-318bbe8aeaeb","Type":"ContainerStarted","Data":"b621f96a23910c9c3063864cd64e312beffc460f7fe80c6100446c5ac408a780"}
Sep 09 15:30:00.730808 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:00.730783    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"]
Sep 09 15:30:00.733085 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:30:00.733062    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35240fa2_cbec_4735_a4f4_9b804ff6cfb6.slice/crio-a6b282c2850a753225aca2c3a6f870781bdcdb842876ebbe201e9f72bf2c4e1e WatchSource:0}: Error finding container a6b282c2850a753225aca2c3a6f870781bdcdb842876ebbe201e9f72bf2c4e1e: Status 404 returned error can't find the container with id a6b282c2850a753225aca2c3a6f870781bdcdb842876ebbe201e9f72bf2c4e1e
Sep 09 15:30:01.512538 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:01.512386    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727" event={"ID":"35240fa2-cbec-4735-a4f4-9b804ff6cfb6","Type":"ContainerStarted","Data":"a6b282c2850a753225aca2c3a6f870781bdcdb842876ebbe201e9f72bf2c4e1e"}
Sep 09 15:30:04.530159 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:04.530128    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727" event={"ID":"35240fa2-cbec-4735-a4f4-9b804ff6cfb6","Type":"ContainerStarted","Data":"5320beefefcc8e3c6d5404ba25e82bb3118ae1527feb82d99708ab4871e45e9a"}
Sep 09 15:30:05.536341 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:05.536308    2574 generic.go:356] "Generic (PLEG): container finished" podID="f26ccd11-9258-4208-980d-318bbe8aeaeb" containerID="c2a0b38eb6c013de81be312611163da91ead324e99e949d1dec69f2e102d17b0" exitCode=0
Sep 09 15:30:05.536737 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:05.536389    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx" event={"ID":"f26ccd11-9258-4208-980d-318bbe8aeaeb","Type":"ContainerDied","Data":"c2a0b38eb6c013de81be312611163da91ead324e99e949d1dec69f2e102d17b0"}
Sep 09 15:30:05.538213 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:05.538189    2574 generic.go:356] "Generic (PLEG): container finished" podID="35240fa2-cbec-4735-a4f4-9b804ff6cfb6" containerID="5320beefefcc8e3c6d5404ba25e82bb3118ae1527feb82d99708ab4871e45e9a" exitCode=0
Sep 09 15:30:05.538303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:05.538231    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727" event={"ID":"35240fa2-cbec-4735-a4f4-9b804ff6cfb6","Type":"ContainerDied","Data":"5320beefefcc8e3c6d5404ba25e82bb3118ae1527feb82d99708ab4871e45e9a"}
Sep 09 15:30:06.111073 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.111040    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85f94786df-d9gg7"]
Sep 09 15:30:06.114653 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.114632    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.157595 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.157569    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f94786df-d9gg7"]
Sep 09 15:30:06.268760 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.268714    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9c522b5-58e3-498d-9f0c-58c459ff6002-console-oauth-config\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.268760 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.268763    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9c522b5-58e3-498d-9f0c-58c459ff6002-console-serving-cert\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.269049 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.268788    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9c522b5-58e3-498d-9f0c-58c459ff6002-oauth-serving-cert\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.269049 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.268815    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9c522b5-58e3-498d-9f0c-58c459ff6002-console-config\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.269049 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.268943    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9c522b5-58e3-498d-9f0c-58c459ff6002-trusted-ca-bundle\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.269049 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.268986    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b8dk\" (UniqueName: \"kubernetes.io/projected/a9c522b5-58e3-498d-9f0c-58c459ff6002-kube-api-access-7b8dk\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.269206 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.269045    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9c522b5-58e3-498d-9f0c-58c459ff6002-service-ca\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.370241 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.370153    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9c522b5-58e3-498d-9f0c-58c459ff6002-trusted-ca-bundle\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.370241 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.370194    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b8dk\" (UniqueName: \"kubernetes.io/projected/a9c522b5-58e3-498d-9f0c-58c459ff6002-kube-api-access-7b8dk\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.370241 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.370223    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9c522b5-58e3-498d-9f0c-58c459ff6002-service-ca\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.370493 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.370283    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9c522b5-58e3-498d-9f0c-58c459ff6002-console-oauth-config\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.370493 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.370324    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9c522b5-58e3-498d-9f0c-58c459ff6002-console-serving-cert\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.370493 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.370361    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9c522b5-58e3-498d-9f0c-58c459ff6002-oauth-serving-cert\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.370493 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.370400    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9c522b5-58e3-498d-9f0c-58c459ff6002-console-config\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.371175 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.371097    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9c522b5-58e3-498d-9f0c-58c459ff6002-service-ca\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.371175 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.371096    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9c522b5-58e3-498d-9f0c-58c459ff6002-oauth-serving-cert\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.371175 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.371157    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9c522b5-58e3-498d-9f0c-58c459ff6002-trusted-ca-bundle\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.371175 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.371180    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9c522b5-58e3-498d-9f0c-58c459ff6002-console-config\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.372857 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.372808    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9c522b5-58e3-498d-9f0c-58c459ff6002-console-oauth-config\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.373125 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.373103    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9c522b5-58e3-498d-9f0c-58c459ff6002-console-serving-cert\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.378496 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.378474    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b8dk\" (UniqueName: \"kubernetes.io/projected/a9c522b5-58e3-498d-9f0c-58c459ff6002-kube-api-access-7b8dk\") pod \"console-85f94786df-d9gg7\" (UID: \"a9c522b5-58e3-498d-9f0c-58c459ff6002\") " pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.423287 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.423258    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:06.544666 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.544629    2574 generic.go:356] "Generic (PLEG): container finished" podID="f26ccd11-9258-4208-980d-318bbe8aeaeb" containerID="b405ea1b27b606524d05aeb7bb943bb6b28d70392e79ad51c4e1596f805333e4" exitCode=0
Sep 09 15:30:06.545072 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.544708    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx" event={"ID":"f26ccd11-9258-4208-980d-318bbe8aeaeb","Type":"ContainerDied","Data":"b405ea1b27b606524d05aeb7bb943bb6b28d70392e79ad51c4e1596f805333e4"}
Sep 09 15:30:06.696739 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:06.696703    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f94786df-d9gg7"]
Sep 09 15:30:06.700212 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:30:06.700179    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c522b5_58e3_498d_9f0c_58c459ff6002.slice/crio-69795634130e1012f6d43d85ea523c61d4fe761bd478645b75e0f25bf13840b2 WatchSource:0}: Error finding container 69795634130e1012f6d43d85ea523c61d4fe761bd478645b75e0f25bf13840b2: Status 404 returned error can't find the container with id 69795634130e1012f6d43d85ea523c61d4fe761bd478645b75e0f25bf13840b2
Sep 09 15:30:07.550827 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:07.550793    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f94786df-d9gg7" event={"ID":"a9c522b5-58e3-498d-9f0c-58c459ff6002","Type":"ContainerStarted","Data":"1c33bf4f63fcf00c442e43d6d944d1012d0b79f532e307d0728db32cf44c0085"}
Sep 09 15:30:07.551224 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:07.550854    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f94786df-d9gg7" event={"ID":"a9c522b5-58e3-498d-9f0c-58c459ff6002","Type":"ContainerStarted","Data":"69795634130e1012f6d43d85ea523c61d4fe761bd478645b75e0f25bf13840b2"}
Sep 09 15:30:07.583885 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:07.583813    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85f94786df-d9gg7" podStartSLOduration=1.583792122 podStartE2EDuration="1.583792122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:30:07.582321714 +0000 UTC m=+591.772524509" watchObservedRunningTime="2026-09-09 15:30:07.583792122 +0000 UTC m=+591.773994870"
Sep 09 15:30:07.679012 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:07.678982    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx"
Sep 09 15:30:07.783691 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:07.783645    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f26ccd11-9258-4208-980d-318bbe8aeaeb-bundle\") pod \"f26ccd11-9258-4208-980d-318bbe8aeaeb\" (UID: \"f26ccd11-9258-4208-980d-318bbe8aeaeb\") "
Sep 09 15:30:07.783691 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:07.783696    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f26ccd11-9258-4208-980d-318bbe8aeaeb-util\") pod \"f26ccd11-9258-4208-980d-318bbe8aeaeb\" (UID: \"f26ccd11-9258-4208-980d-318bbe8aeaeb\") "
Sep 09 15:30:07.783975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:07.783727    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc859\" (UniqueName: \"kubernetes.io/projected/f26ccd11-9258-4208-980d-318bbe8aeaeb-kube-api-access-qc859\") pod \"f26ccd11-9258-4208-980d-318bbe8aeaeb\" (UID: \"f26ccd11-9258-4208-980d-318bbe8aeaeb\") "
Sep 09 15:30:07.784389 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:07.784357    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f26ccd11-9258-4208-980d-318bbe8aeaeb-bundle" (OuterVolumeSpecName: "bundle") pod "f26ccd11-9258-4208-980d-318bbe8aeaeb" (UID: "f26ccd11-9258-4208-980d-318bbe8aeaeb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:30:07.786021 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:07.785986    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f26ccd11-9258-4208-980d-318bbe8aeaeb-kube-api-access-qc859" (OuterVolumeSpecName: "kube-api-access-qc859") pod "f26ccd11-9258-4208-980d-318bbe8aeaeb" (UID: "f26ccd11-9258-4208-980d-318bbe8aeaeb"). InnerVolumeSpecName "kube-api-access-qc859". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:30:07.788215 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:07.788180    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f26ccd11-9258-4208-980d-318bbe8aeaeb-util" (OuterVolumeSpecName: "util") pod "f26ccd11-9258-4208-980d-318bbe8aeaeb" (UID: "f26ccd11-9258-4208-980d-318bbe8aeaeb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:30:07.885226 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:07.885140    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f26ccd11-9258-4208-980d-318bbe8aeaeb-bundle\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:07.885226 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:07.885168    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f26ccd11-9258-4208-980d-318bbe8aeaeb-util\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:07.885226 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:07.885177    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc859\" (UniqueName: \"kubernetes.io/projected/f26ccd11-9258-4208-980d-318bbe8aeaeb-kube-api-access-qc859\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:08.557699 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:08.557666    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx"
Sep 09 15:30:08.557699 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:08.557677    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077ggx" event={"ID":"f26ccd11-9258-4208-980d-318bbe8aeaeb","Type":"ContainerDied","Data":"b621f96a23910c9c3063864cd64e312beffc460f7fe80c6100446c5ac408a780"}
Sep 09 15:30:08.558155 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:08.557728    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b621f96a23910c9c3063864cd64e312beffc460f7fe80c6100446c5ac408a780"
Sep 09 15:30:09.564382 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:09.564341    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727" event={"ID":"35240fa2-cbec-4735-a4f4-9b804ff6cfb6","Type":"ContainerStarted","Data":"5dfd6565736d065523bac4a2c6033142d67ec93b4875828bd034be8232cd236c"}
Sep 09 15:30:09.564874 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:09.564442    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:09.589279 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:09.589226    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727" podStartSLOduration=1.431228517 podStartE2EDuration="9.589211009s" totalImagesPullingTime="7.036671453s" totalInitContainerRuntime="1.121311039s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:30:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:30:09.587947436 +0000 UTC m=+593.778150186" watchObservedRunningTime="2026-09-09 15:30:09.589211009 +0000 UTC m=+593.779413757"
Sep 09 15:30:16.423409 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:16.423377    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:16.423977 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:16.423445    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:16.428611 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:16.428589    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:16.602065 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:16.602035    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85f94786df-d9gg7"
Sep 09 15:30:16.650109 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:16.650078    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687d5c7cc8-r22tf"]
Sep 09 15:30:20.571914 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:20.571878    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74fc54996-9d727"
Sep 09 15:30:31.469601 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.469567    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59598c6787-jdwjg"]
Sep 09 15:30:31.470074 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.469920    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f26ccd11-9258-4208-980d-318bbe8aeaeb" containerName="util"
Sep 09 15:30:31.470074 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.469933    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f26ccd11-9258-4208-980d-318bbe8aeaeb" containerName="util"
Sep 09 15:30:31.470074 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.469942    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f26ccd11-9258-4208-980d-318bbe8aeaeb" containerName="pull"
Sep 09 15:30:31.470074 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.469948    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f26ccd11-9258-4208-980d-318bbe8aeaeb" containerName="pull"
Sep 09 15:30:31.470074 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.469972    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f26ccd11-9258-4208-980d-318bbe8aeaeb" containerName="extract"
Sep 09 15:30:31.470074 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.469977    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f26ccd11-9258-4208-980d-318bbe8aeaeb" containerName="extract"
Sep 09 15:30:31.470074 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.470031    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f26ccd11-9258-4208-980d-318bbe8aeaeb" containerName="extract"
Sep 09 15:30:31.472896 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.472873    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59598c6787-jdwjg"
Sep 09 15:30:31.475343 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.475323    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 09 15:30:31.475450 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.475357    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 15:30:31.475450 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.475380    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fn29g\""
Sep 09 15:30:31.483119 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.483095    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59598c6787-jdwjg"]
Sep 09 15:30:31.497409 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.497384    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/764d1d35-45d5-4589-8432-9cd88a8ee39e-tls-certs\") pod \"kube-auth-proxy-59598c6787-jdwjg\" (UID: \"764d1d35-45d5-4589-8432-9cd88a8ee39e\") " pod="openshift-ingress/kube-auth-proxy-59598c6787-jdwjg"
Sep 09 15:30:31.497560 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.497434    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/764d1d35-45d5-4589-8432-9cd88a8ee39e-tmp\") pod \"kube-auth-proxy-59598c6787-jdwjg\" (UID: \"764d1d35-45d5-4589-8432-9cd88a8ee39e\") " pod="openshift-ingress/kube-auth-proxy-59598c6787-jdwjg"
Sep 09 15:30:31.497626 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.497568    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvzgp\" (UniqueName: \"kubernetes.io/projected/764d1d35-45d5-4589-8432-9cd88a8ee39e-kube-api-access-wvzgp\") pod \"kube-auth-proxy-59598c6787-jdwjg\" (UID: \"764d1d35-45d5-4589-8432-9cd88a8ee39e\") " pod="openshift-ingress/kube-auth-proxy-59598c6787-jdwjg"
Sep 09 15:30:31.598200 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.598163    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/764d1d35-45d5-4589-8432-9cd88a8ee39e-tmp\") pod \"kube-auth-proxy-59598c6787-jdwjg\" (UID: \"764d1d35-45d5-4589-8432-9cd88a8ee39e\") " pod="openshift-ingress/kube-auth-proxy-59598c6787-jdwjg"
Sep 09 15:30:31.598371 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.598246    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvzgp\" (UniqueName: \"kubernetes.io/projected/764d1d35-45d5-4589-8432-9cd88a8ee39e-kube-api-access-wvzgp\") pod \"kube-auth-proxy-59598c6787-jdwjg\" (UID: \"764d1d35-45d5-4589-8432-9cd88a8ee39e\") " pod="openshift-ingress/kube-auth-proxy-59598c6787-jdwjg"
Sep 09 15:30:31.598371 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.598279    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/764d1d35-45d5-4589-8432-9cd88a8ee39e-tls-certs\") pod \"kube-auth-proxy-59598c6787-jdwjg\" (UID: \"764d1d35-45d5-4589-8432-9cd88a8ee39e\") " pod="openshift-ingress/kube-auth-proxy-59598c6787-jdwjg"
Sep 09 15:30:31.600520 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.600486    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/764d1d35-45d5-4589-8432-9cd88a8ee39e-tmp\") pod \"kube-auth-proxy-59598c6787-jdwjg\" (UID: \"764d1d35-45d5-4589-8432-9cd88a8ee39e\") " pod="openshift-ingress/kube-auth-proxy-59598c6787-jdwjg"
Sep 09 15:30:31.600817 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.600796    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/764d1d35-45d5-4589-8432-9cd88a8ee39e-tls-certs\") pod \"kube-auth-proxy-59598c6787-jdwjg\" (UID: \"764d1d35-45d5-4589-8432-9cd88a8ee39e\") " pod="openshift-ingress/kube-auth-proxy-59598c6787-jdwjg"
Sep 09 15:30:31.606041 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.606024    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvzgp\" (UniqueName: \"kubernetes.io/projected/764d1d35-45d5-4589-8432-9cd88a8ee39e-kube-api-access-wvzgp\") pod \"kube-auth-proxy-59598c6787-jdwjg\" (UID: \"764d1d35-45d5-4589-8432-9cd88a8ee39e\") " pod="openshift-ingress/kube-auth-proxy-59598c6787-jdwjg"
Sep 09 15:30:31.783519 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:31.783406    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59598c6787-jdwjg"
Sep 09 15:30:32.058890 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.058861    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59598c6787-jdwjg"]
Sep 09 15:30:32.060745 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:30:32.060714    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764d1d35_45d5_4589_8432_9cd88a8ee39e.slice/crio-b5a8a5cd087cf7d56e8bbc069f2db1df16643ef1e76fafbc6ad0c81931a41b8e WatchSource:0}: Error finding container b5a8a5cd087cf7d56e8bbc069f2db1df16643ef1e76fafbc6ad0c81931a41b8e: Status 404 returned error can't find the container with id b5a8a5cd087cf7d56e8bbc069f2db1df16643ef1e76fafbc6ad0c81931a41b8e
Sep 09 15:30:32.483813 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.483779    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"]
Sep 09 15:30:32.488312 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.488290    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.490679 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.490653    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 09 15:30:32.490858 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.490827    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 09 15:30:32.491001 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.490983    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 09 15:30:32.491055 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.490997    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-svdkd\""
Sep 09 15:30:32.491055 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.491049    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 15:30:32.497699 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.497680    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"]
Sep 09 15:30:32.506111 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.506088    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb1a981d-446a-4108-851c-96aa4953b80a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.506208 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.506128    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb1a981d-446a-4108-851c-96aa4953b80a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.506208 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.506154    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.506323 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.506223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cb1a981d-446a-4108-851c-96aa4953b80a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.506323 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.506261    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmpw5\" (UniqueName: \"kubernetes.io/projected/cb1a981d-446a-4108-851c-96aa4953b80a-kube-api-access-bmpw5\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.506424 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.506379    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.506506 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.506491    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.607915 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.607871    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb1a981d-446a-4108-851c-96aa4953b80a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.608117 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.607927    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb1a981d-446a-4108-851c-96aa4953b80a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.608117 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.607946    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.608117 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.607971    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cb1a981d-446a-4108-851c-96aa4953b80a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.608117 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.608009    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmpw5\" (UniqueName: \"kubernetes.io/projected/cb1a981d-446a-4108-851c-96aa4953b80a-kube-api-access-bmpw5\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.608117 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.608082    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.608376 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.608117    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.609052 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.608891    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cb1a981d-446a-4108-851c-96aa4953b80a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.610514 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.610495    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb1a981d-446a-4108-851c-96aa4953b80a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.610717 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.610696    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.610759 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.610699    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.610759 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.610703    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.616165 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.616139    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb1a981d-446a-4108-851c-96aa4953b80a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.616263 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.616150    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmpw5\" (UniqueName: \"kubernetes.io/projected/cb1a981d-446a-4108-851c-96aa4953b80a-kube-api-access-bmpw5\") pod \"istiod-openshift-gateway-7b7995d5cd-w4vlg\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:32.683014 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.682967    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59598c6787-jdwjg" event={"ID":"764d1d35-45d5-4589-8432-9cd88a8ee39e","Type":"ContainerStarted","Data":"b5a8a5cd087cf7d56e8bbc069f2db1df16643ef1e76fafbc6ad0c81931a41b8e"}
Sep 09 15:30:32.799344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:32.799249    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:33.081801 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:33.081673    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"]
Sep 09 15:30:33.084974 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:30:33.084943    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1a981d_446a_4108_851c_96aa4953b80a.slice/crio-ffd829bae22628efc6b3727f764b44b1242cf2a75c06a8284983ef1d917d644c WatchSource:0}: Error finding container ffd829bae22628efc6b3727f764b44b1242cf2a75c06a8284983ef1d917d644c: Status 404 returned error can't find the container with id ffd829bae22628efc6b3727f764b44b1242cf2a75c06a8284983ef1d917d644c
Sep 09 15:30:33.689054 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:33.689016    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg" event={"ID":"cb1a981d-446a-4108-851c-96aa4953b80a","Type":"ContainerStarted","Data":"ffd829bae22628efc6b3727f764b44b1242cf2a75c06a8284983ef1d917d644c"}
Sep 09 15:30:37.165832 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:37.165783    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:30:37.166271 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:37.165889    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:30:37.725262 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:37.725213    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59598c6787-jdwjg" event={"ID":"764d1d35-45d5-4589-8432-9cd88a8ee39e","Type":"ContainerStarted","Data":"780b54a71cd579f62e8af2cb10cab66172daf9abf1db60ba676cd3dba2cbbf0c"}
Sep 09 15:30:37.728537 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:37.728504    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg" event={"ID":"cb1a981d-446a-4108-851c-96aa4953b80a","Type":"ContainerStarted","Data":"2e614d023227c8e6f68335b1208232cc880f0f078485ba3b1618bd5bdf525106"}
Sep 09 15:30:37.728921 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:37.728901    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:37.744353 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:37.744293    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59598c6787-jdwjg" podStartSLOduration=1.584947628 podStartE2EDuration="6.744271831s" totalImagesPullingTime="5.159324203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:30:37.740954177 +0000 UTC m=+621.931156950" watchObservedRunningTime="2026-09-09 15:30:37.744271831 +0000 UTC m=+621.934474582"
Sep 09 15:30:37.763866 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:37.763446    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg" podStartSLOduration=1.685242878 podStartE2EDuration="5.763427349s" totalImagesPullingTime="4.078184471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:30:37.763108601 +0000 UTC m=+621.953311350" watchObservedRunningTime="2026-09-09 15:30:37.763427349 +0000 UTC m=+621.953630100"
Sep 09 15:30:38.736695 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:38.736662    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:41.673909 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:41.673864    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-687d5c7cc8-r22tf" podUID="29d36da0-dc1d-4140-9c3c-9dfc904e50af" containerName="console" containerID="cri-o://cb0f199c337cbf365ffdb33022ae73d8c8e4b74f713643de996a34f632dd90ba" gracePeriod=15
Sep 09 15:30:41.921694 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:41.921665    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:30:42.001860 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.001816    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-trusted-ca-bundle\") pod \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") "
Sep 09 15:30:42.002066 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.001912    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-config\") pod \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") "
Sep 09 15:30:42.002066 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.002008    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-oauth-serving-cert\") pod \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") "
Sep 09 15:30:42.002066 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.002064    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7mbg\" (UniqueName: \"kubernetes.io/projected/29d36da0-dc1d-4140-9c3c-9dfc904e50af-kube-api-access-q7mbg\") pod \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") "
Sep 09 15:30:42.002303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.002110    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-service-ca\") pod \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") "
Sep 09 15:30:42.002303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.002150    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-oauth-config\") pod \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") "
Sep 09 15:30:42.002303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.002198    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-serving-cert\") pod \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\" (UID: \"29d36da0-dc1d-4140-9c3c-9dfc904e50af\") "
Sep 09 15:30:42.002455 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.002311    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "29d36da0-dc1d-4140-9c3c-9dfc904e50af" (UID: "29d36da0-dc1d-4140-9c3c-9dfc904e50af"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:30:42.002455 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.002320    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-config" (OuterVolumeSpecName: "console-config") pod "29d36da0-dc1d-4140-9c3c-9dfc904e50af" (UID: "29d36da0-dc1d-4140-9c3c-9dfc904e50af"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:30:42.002455 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.002336    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "29d36da0-dc1d-4140-9c3c-9dfc904e50af" (UID: "29d36da0-dc1d-4140-9c3c-9dfc904e50af"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:30:42.002687 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.002664    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-config\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:42.002759 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.002696    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-oauth-serving-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:42.002759 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.002712    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-trusted-ca-bundle\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:42.002759 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.002721    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-service-ca" (OuterVolumeSpecName: "service-ca") pod "29d36da0-dc1d-4140-9c3c-9dfc904e50af" (UID: "29d36da0-dc1d-4140-9c3c-9dfc904e50af"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:30:42.004629 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.004600    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "29d36da0-dc1d-4140-9c3c-9dfc904e50af" (UID: "29d36da0-dc1d-4140-9c3c-9dfc904e50af"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:30:42.004889 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.004837    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "29d36da0-dc1d-4140-9c3c-9dfc904e50af" (UID: "29d36da0-dc1d-4140-9c3c-9dfc904e50af"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:30:42.004963 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.004939    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29d36da0-dc1d-4140-9c3c-9dfc904e50af-kube-api-access-q7mbg" (OuterVolumeSpecName: "kube-api-access-q7mbg") pod "29d36da0-dc1d-4140-9c3c-9dfc904e50af" (UID: "29d36da0-dc1d-4140-9c3c-9dfc904e50af"). InnerVolumeSpecName "kube-api-access-q7mbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:30:42.103497 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.103457    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-oauth-config\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:42.103497 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.103490    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29d36da0-dc1d-4140-9c3c-9dfc904e50af-console-serving-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:42.103497 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.103500    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7mbg\" (UniqueName: \"kubernetes.io/projected/29d36da0-dc1d-4140-9c3c-9dfc904e50af-kube-api-access-q7mbg\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:42.103743 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.103510    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29d36da0-dc1d-4140-9c3c-9dfc904e50af-service-ca\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:42.758023 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.757992    2574 generic.go:356] "Generic (PLEG): container finished" podID="29d36da0-dc1d-4140-9c3c-9dfc904e50af" containerID="cb0f199c337cbf365ffdb33022ae73d8c8e4b74f713643de996a34f632dd90ba" exitCode=0
Sep 09 15:30:42.758432 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.758088    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687d5c7cc8-r22tf" event={"ID":"29d36da0-dc1d-4140-9c3c-9dfc904e50af","Type":"ContainerDied","Data":"cb0f199c337cbf365ffdb33022ae73d8c8e4b74f713643de996a34f632dd90ba"}
Sep 09 15:30:42.758432 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.758126    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687d5c7cc8-r22tf" event={"ID":"29d36da0-dc1d-4140-9c3c-9dfc904e50af","Type":"ContainerDied","Data":"87c2a5f484f401ead658a144732dc90936d89a6baa2639e9c58d121a776e8620"}
Sep 09 15:30:42.758432 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.758125    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687d5c7cc8-r22tf"
Sep 09 15:30:42.758432 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.758140    2574 scope.go:117] "RemoveContainer" containerID="cb0f199c337cbf365ffdb33022ae73d8c8e4b74f713643de996a34f632dd90ba"
Sep 09 15:30:42.767468 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.767440    2574 scope.go:117] "RemoveContainer" containerID="cb0f199c337cbf365ffdb33022ae73d8c8e4b74f713643de996a34f632dd90ba"
Sep 09 15:30:42.767875 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:30:42.767809    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb0f199c337cbf365ffdb33022ae73d8c8e4b74f713643de996a34f632dd90ba\": container with ID starting with cb0f199c337cbf365ffdb33022ae73d8c8e4b74f713643de996a34f632dd90ba not found: ID does not exist" containerID="cb0f199c337cbf365ffdb33022ae73d8c8e4b74f713643de996a34f632dd90ba"
Sep 09 15:30:42.767947 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.767880    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0f199c337cbf365ffdb33022ae73d8c8e4b74f713643de996a34f632dd90ba"} err="failed to get container status \"cb0f199c337cbf365ffdb33022ae73d8c8e4b74f713643de996a34f632dd90ba\": rpc error: code = NotFound desc = could not find container \"cb0f199c337cbf365ffdb33022ae73d8c8e4b74f713643de996a34f632dd90ba\": container with ID starting with cb0f199c337cbf365ffdb33022ae73d8c8e4b74f713643de996a34f632dd90ba not found: ID does not exist"
Sep 09 15:30:42.776946 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.776924    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687d5c7cc8-r22tf"]
Sep 09 15:30:42.784929 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:42.784902    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-687d5c7cc8-r22tf"]
Sep 09 15:30:43.990808 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:43.990774    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"]
Sep 09 15:30:43.991223 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:43.991194    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29d36da0-dc1d-4140-9c3c-9dfc904e50af" containerName="console"
Sep 09 15:30:43.991223 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:43.991207    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="29d36da0-dc1d-4140-9c3c-9dfc904e50af" containerName="console"
Sep 09 15:30:43.991428 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:43.991295    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="29d36da0-dc1d-4140-9c3c-9dfc904e50af" containerName="console"
Sep 09 15:30:43.994417 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:43.994394    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.013067 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.013039    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"]
Sep 09 15:30:44.122623 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.122578    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91090671-ce16-4d89-9f82-8076060899b9-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.122623 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.122616    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/91090671-ce16-4d89-9f82-8076060899b9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.122863 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.122640    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqvdq\" (UniqueName: \"kubernetes.io/projected/91090671-ce16-4d89-9f82-8076060899b9-kube-api-access-sqvdq\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.122863 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.122737    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/91090671-ce16-4d89-9f82-8076060899b9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.122863 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.122781    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/91090671-ce16-4d89-9f82-8076060899b9-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.122863 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.122801    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/91090671-ce16-4d89-9f82-8076060899b9-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.123024 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.122881    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91090671-ce16-4d89-9f82-8076060899b9-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.224255 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.224213    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91090671-ce16-4d89-9f82-8076060899b9-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.224464 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.224268    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91090671-ce16-4d89-9f82-8076060899b9-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.224464 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.224288    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/91090671-ce16-4d89-9f82-8076060899b9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.224464 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.224309    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqvdq\" (UniqueName: \"kubernetes.io/projected/91090671-ce16-4d89-9f82-8076060899b9-kube-api-access-sqvdq\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.224464 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.224352    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/91090671-ce16-4d89-9f82-8076060899b9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.224464 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.224375    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/91090671-ce16-4d89-9f82-8076060899b9-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.224464 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.224391    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/91090671-ce16-4d89-9f82-8076060899b9-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.225275 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.225245    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/91090671-ce16-4d89-9f82-8076060899b9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.227206 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.227176    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/91090671-ce16-4d89-9f82-8076060899b9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.227402 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.227373    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/91090671-ce16-4d89-9f82-8076060899b9-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.227602 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.227582    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/91090671-ce16-4d89-9f82-8076060899b9-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.227644 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.227590    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91090671-ce16-4d89-9f82-8076060899b9-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.232541 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.232518    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91090671-ce16-4d89-9f82-8076060899b9-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.233104 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.233087    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqvdq\" (UniqueName: \"kubernetes.io/projected/91090671-ce16-4d89-9f82-8076060899b9-kube-api-access-sqvdq\") pod \"istiod-openshift-gateway-5677ccb49b-sg26s\" (UID: \"91090671-ce16-4d89-9f82-8076060899b9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.309296 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.309213    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.320121 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.320094    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29d36da0-dc1d-4140-9c3c-9dfc904e50af" path="/var/lib/kubelet/pods/29d36da0-dc1d-4140-9c3c-9dfc904e50af/volumes"
Sep 09 15:30:44.597010 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.596941    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"]
Sep 09 15:30:44.599403 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:30:44.599375    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91090671_ce16_4d89_9f82_8076060899b9.slice/crio-48ae04617b56d80ef355da0c8229019724eaeb33784d2919862318c1e2d84b0c WatchSource:0}: Error finding container 48ae04617b56d80ef355da0c8229019724eaeb33784d2919862318c1e2d84b0c: Status 404 returned error can't find the container with id 48ae04617b56d80ef355da0c8229019724eaeb33784d2919862318c1e2d84b0c
Sep 09 15:30:44.603412 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.603373    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:30:44.603531 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.603440    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:30:44.771917 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.771874    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s" event={"ID":"91090671-ce16-4d89-9f82-8076060899b9","Type":"ContainerStarted","Data":"a412a39051d045ba106b56e7ae2830051b9dfaf0e01b2c4a68b0d195f75e0410"}
Sep 09 15:30:44.772099 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.771931    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s" event={"ID":"91090671-ce16-4d89-9f82-8076060899b9","Type":"ContainerStarted","Data":"48ae04617b56d80ef355da0c8229019724eaeb33784d2919862318c1e2d84b0c"}
Sep 09 15:30:44.772099 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.771995    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:44.795932 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:44.795882    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s" podStartSLOduration=1.795865437 podStartE2EDuration="1.795865437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:30:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:30:44.792991106 +0000 UTC m=+628.983193870" watchObservedRunningTime="2026-09-09 15:30:44.795865437 +0000 UTC m=+628.986068183"
Sep 09 15:30:45.778903 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:45.778875    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sg26s"
Sep 09 15:30:45.851415 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:45.851382    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"]
Sep 09 15:30:45.851694 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:45.851661    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg" podUID="cb1a981d-446a-4108-851c-96aa4953b80a" containerName="discovery" containerID="cri-o://2e614d023227c8e6f68335b1208232cc880f0f078485ba3b1618bd5bdf525106" gracePeriod=30
Sep 09 15:30:46.121743 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.121713    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:46.241637 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.241602    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb1a981d-446a-4108-851c-96aa4953b80a-istio-token\") pod \"cb1a981d-446a-4108-851c-96aa4953b80a\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") "
Sep 09 15:30:46.241859 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.241655    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-istio-kubeconfig\") pod \"cb1a981d-446a-4108-851c-96aa4953b80a\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") "
Sep 09 15:30:46.241859 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.241694    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb1a981d-446a-4108-851c-96aa4953b80a-local-certs\") pod \"cb1a981d-446a-4108-851c-96aa4953b80a\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") "
Sep 09 15:30:46.241859 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.241767    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-cacerts\") pod \"cb1a981d-446a-4108-851c-96aa4953b80a\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") "
Sep 09 15:30:46.241859 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.241797    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cb1a981d-446a-4108-851c-96aa4953b80a-istio-csr-ca-configmap\") pod \"cb1a981d-446a-4108-851c-96aa4953b80a\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") "
Sep 09 15:30:46.242074 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.241859    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-istio-csr-dns-cert\") pod \"cb1a981d-446a-4108-851c-96aa4953b80a\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") "
Sep 09 15:30:46.242074 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.241892    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmpw5\" (UniqueName: \"kubernetes.io/projected/cb1a981d-446a-4108-851c-96aa4953b80a-kube-api-access-bmpw5\") pod \"cb1a981d-446a-4108-851c-96aa4953b80a\" (UID: \"cb1a981d-446a-4108-851c-96aa4953b80a\") "
Sep 09 15:30:46.242498 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.242248    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb1a981d-446a-4108-851c-96aa4953b80a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "cb1a981d-446a-4108-851c-96aa4953b80a" (UID: "cb1a981d-446a-4108-851c-96aa4953b80a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:30:46.244664 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.244619    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb1a981d-446a-4108-851c-96aa4953b80a-local-certs" (OuterVolumeSpecName: "local-certs") pod "cb1a981d-446a-4108-851c-96aa4953b80a" (UID: "cb1a981d-446a-4108-851c-96aa4953b80a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:30:46.244776 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.244721    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "cb1a981d-446a-4108-851c-96aa4953b80a" (UID: "cb1a981d-446a-4108-851c-96aa4953b80a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:30:46.244776 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.244719    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb1a981d-446a-4108-851c-96aa4953b80a-kube-api-access-bmpw5" (OuterVolumeSpecName: "kube-api-access-bmpw5") pod "cb1a981d-446a-4108-851c-96aa4953b80a" (UID: "cb1a981d-446a-4108-851c-96aa4953b80a"). InnerVolumeSpecName "kube-api-access-bmpw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:30:46.245160 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.245134    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-cacerts" (OuterVolumeSpecName: "cacerts") pod "cb1a981d-446a-4108-851c-96aa4953b80a" (UID: "cb1a981d-446a-4108-851c-96aa4953b80a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:30:46.245263 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.245193    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "cb1a981d-446a-4108-851c-96aa4953b80a" (UID: "cb1a981d-446a-4108-851c-96aa4953b80a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:30:46.245263 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.245201    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb1a981d-446a-4108-851c-96aa4953b80a-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb1a981d-446a-4108-851c-96aa4953b80a" (UID: "cb1a981d-446a-4108-851c-96aa4953b80a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:30:46.342573 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.342543    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb1a981d-446a-4108-851c-96aa4953b80a-istio-token\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:46.342573 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.342571    2574 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-istio-kubeconfig\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:46.342573 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.342580    2574 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb1a981d-446a-4108-851c-96aa4953b80a-local-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:46.342785 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.342588    2574 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-cacerts\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:46.342785 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.342596    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cb1a981d-446a-4108-851c-96aa4953b80a-istio-csr-ca-configmap\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:46.342785 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.342604    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cb1a981d-446a-4108-851c-96aa4953b80a-istio-csr-dns-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:46.342785 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.342612    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmpw5\" (UniqueName: \"kubernetes.io/projected/cb1a981d-446a-4108-851c-96aa4953b80a-kube-api-access-bmpw5\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:30:46.795465 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.795422    2574 generic.go:356] "Generic (PLEG): container finished" podID="cb1a981d-446a-4108-851c-96aa4953b80a" containerID="2e614d023227c8e6f68335b1208232cc880f0f078485ba3b1618bd5bdf525106" exitCode=0
Sep 09 15:30:46.795949 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.795524    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"
Sep 09 15:30:46.795949 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.795559    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg" event={"ID":"cb1a981d-446a-4108-851c-96aa4953b80a","Type":"ContainerDied","Data":"2e614d023227c8e6f68335b1208232cc880f0f078485ba3b1618bd5bdf525106"}
Sep 09 15:30:46.795949 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.795651    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg" event={"ID":"cb1a981d-446a-4108-851c-96aa4953b80a","Type":"ContainerDied","Data":"ffd829bae22628efc6b3727f764b44b1242cf2a75c06a8284983ef1d917d644c"}
Sep 09 15:30:46.795949 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.795680    2574 scope.go:117] "RemoveContainer" containerID="2e614d023227c8e6f68335b1208232cc880f0f078485ba3b1618bd5bdf525106"
Sep 09 15:30:46.805245 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.805225    2574 scope.go:117] "RemoveContainer" containerID="2e614d023227c8e6f68335b1208232cc880f0f078485ba3b1618bd5bdf525106"
Sep 09 15:30:46.805572 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:30:46.805554    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e614d023227c8e6f68335b1208232cc880f0f078485ba3b1618bd5bdf525106\": container with ID starting with 2e614d023227c8e6f68335b1208232cc880f0f078485ba3b1618bd5bdf525106 not found: ID does not exist" containerID="2e614d023227c8e6f68335b1208232cc880f0f078485ba3b1618bd5bdf525106"
Sep 09 15:30:46.805672 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.805584    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e614d023227c8e6f68335b1208232cc880f0f078485ba3b1618bd5bdf525106"} err="failed to get container status \"2e614d023227c8e6f68335b1208232cc880f0f078485ba3b1618bd5bdf525106\": rpc error: code = NotFound desc = could not find container \"2e614d023227c8e6f68335b1208232cc880f0f078485ba3b1618bd5bdf525106\": container with ID starting with 2e614d023227c8e6f68335b1208232cc880f0f078485ba3b1618bd5bdf525106 not found: ID does not exist"
Sep 09 15:30:46.823335 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.823310    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"]
Sep 09 15:30:46.832066 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.832031    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w4vlg"]
Sep 09 15:30:46.848702 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.848675    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6"]
Sep 09 15:30:46.849023 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.849010    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb1a981d-446a-4108-851c-96aa4953b80a" containerName="discovery"
Sep 09 15:30:46.849069 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.849025    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb1a981d-446a-4108-851c-96aa4953b80a" containerName="discovery"
Sep 09 15:30:46.849122 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.849091    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb1a981d-446a-4108-851c-96aa4953b80a" containerName="discovery"
Sep 09 15:30:46.853628 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.853604    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6"
Sep 09 15:30:46.859576 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.859549    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 09 15:30:46.859696 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.859605    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tdqz8\""
Sep 09 15:30:46.872102 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.872072    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6"]
Sep 09 15:30:46.873807 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.873788    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qdzzn"]
Sep 09 15:30:46.877174 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.877151    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qdzzn"
Sep 09 15:30:46.880092 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.880074    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 09 15:30:46.880549 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.880533    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vsz72\""
Sep 09 15:30:46.904777 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.904750    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qdzzn"]
Sep 09 15:30:46.947779 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.947745    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95a7ba5d-3264-4ef3-be20-6f04e40c1cb0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qdzzn\" (UID: \"95a7ba5d-3264-4ef3-be20-6f04e40c1cb0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qdzzn"
Sep 09 15:30:46.947968 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.947800    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm2w4\" (UniqueName: \"kubernetes.io/projected/95a7ba5d-3264-4ef3-be20-6f04e40c1cb0-kube-api-access-dm2w4\") pod \"llmisvc-controller-manager-777c6bd7d5-qdzzn\" (UID: \"95a7ba5d-3264-4ef3-be20-6f04e40c1cb0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qdzzn"
Sep 09 15:30:46.947968 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.947939    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/417d518b-8c18-4c1e-bf46-79ab0ef90c60-cert\") pod \"kserve-controller-manager-d6f4b65b8-5tsw6\" (UID: \"417d518b-8c18-4c1e-bf46-79ab0ef90c60\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6"
Sep 09 15:30:46.947968 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:46.947957    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6wcw\" (UniqueName: \"kubernetes.io/projected/417d518b-8c18-4c1e-bf46-79ab0ef90c60-kube-api-access-h6wcw\") pod \"kserve-controller-manager-d6f4b65b8-5tsw6\" (UID: \"417d518b-8c18-4c1e-bf46-79ab0ef90c60\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6"
Sep 09 15:30:47.048506 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:47.048409    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm2w4\" (UniqueName: \"kubernetes.io/projected/95a7ba5d-3264-4ef3-be20-6f04e40c1cb0-kube-api-access-dm2w4\") pod \"llmisvc-controller-manager-777c6bd7d5-qdzzn\" (UID: \"95a7ba5d-3264-4ef3-be20-6f04e40c1cb0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qdzzn"
Sep 09 15:30:47.048659 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:47.048532    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/417d518b-8c18-4c1e-bf46-79ab0ef90c60-cert\") pod \"kserve-controller-manager-d6f4b65b8-5tsw6\" (UID: \"417d518b-8c18-4c1e-bf46-79ab0ef90c60\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6"
Sep 09 15:30:47.048659 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:47.048556    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6wcw\" (UniqueName: \"kubernetes.io/projected/417d518b-8c18-4c1e-bf46-79ab0ef90c60-kube-api-access-h6wcw\") pod \"kserve-controller-manager-d6f4b65b8-5tsw6\" (UID: \"417d518b-8c18-4c1e-bf46-79ab0ef90c60\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6"
Sep 09 15:30:47.048659 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:47.048584    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95a7ba5d-3264-4ef3-be20-6f04e40c1cb0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qdzzn\" (UID: \"95a7ba5d-3264-4ef3-be20-6f04e40c1cb0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qdzzn"
Sep 09 15:30:47.048773 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:30:47.048693    2574 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 09 15:30:47.048818 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:30:47.048778    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/417d518b-8c18-4c1e-bf46-79ab0ef90c60-cert podName:417d518b-8c18-4c1e-bf46-79ab0ef90c60 nodeName:}" failed. No retries permitted until 2026-09-09 15:30:47.54875725 +0000 UTC m=+631.738959977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/417d518b-8c18-4c1e-bf46-79ab0ef90c60-cert") pod "kserve-controller-manager-d6f4b65b8-5tsw6" (UID: "417d518b-8c18-4c1e-bf46-79ab0ef90c60") : secret "kserve-webhook-server-cert" not found
Sep 09 15:30:47.051505 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:47.051481    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95a7ba5d-3264-4ef3-be20-6f04e40c1cb0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qdzzn\" (UID: \"95a7ba5d-3264-4ef3-be20-6f04e40c1cb0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qdzzn"
Sep 09 15:30:47.067728 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:47.067697    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6wcw\" (UniqueName: \"kubernetes.io/projected/417d518b-8c18-4c1e-bf46-79ab0ef90c60-kube-api-access-h6wcw\") pod \"kserve-controller-manager-d6f4b65b8-5tsw6\" (UID: \"417d518b-8c18-4c1e-bf46-79ab0ef90c60\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6"
Sep 09 15:30:47.068581 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:47.068552    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm2w4\" (UniqueName: \"kubernetes.io/projected/95a7ba5d-3264-4ef3-be20-6f04e40c1cb0-kube-api-access-dm2w4\") pod \"llmisvc-controller-manager-777c6bd7d5-qdzzn\" (UID: \"95a7ba5d-3264-4ef3-be20-6f04e40c1cb0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qdzzn"
Sep 09 15:30:47.188413 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:47.188380    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qdzzn"
Sep 09 15:30:47.466804 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:47.466780    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qdzzn"]
Sep 09 15:30:47.468710 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:30:47.468684    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod95a7ba5d_3264_4ef3_be20_6f04e40c1cb0.slice/crio-06ab48da497ecc2b30ccb0675d74eb2e547e383a44ddaf2b3b6fb0bffb491588 WatchSource:0}: Error finding container 06ab48da497ecc2b30ccb0675d74eb2e547e383a44ddaf2b3b6fb0bffb491588: Status 404 returned error can't find the container with id 06ab48da497ecc2b30ccb0675d74eb2e547e383a44ddaf2b3b6fb0bffb491588
Sep 09 15:30:47.559330 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:47.559296    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/417d518b-8c18-4c1e-bf46-79ab0ef90c60-cert\") pod \"kserve-controller-manager-d6f4b65b8-5tsw6\" (UID: \"417d518b-8c18-4c1e-bf46-79ab0ef90c60\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6"
Sep 09 15:30:47.561982 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:47.561959    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/417d518b-8c18-4c1e-bf46-79ab0ef90c60-cert\") pod \"kserve-controller-manager-d6f4b65b8-5tsw6\" (UID: \"417d518b-8c18-4c1e-bf46-79ab0ef90c60\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6"
Sep 09 15:30:47.763297 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:47.763206    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6"
Sep 09 15:30:47.803402 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:47.803372    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qdzzn" event={"ID":"95a7ba5d-3264-4ef3-be20-6f04e40c1cb0","Type":"ContainerStarted","Data":"06ab48da497ecc2b30ccb0675d74eb2e547e383a44ddaf2b3b6fb0bffb491588"}
Sep 09 15:30:48.040997 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:48.040965    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6"]
Sep 09 15:30:48.043067 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:30:48.043041    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod417d518b_8c18_4c1e_bf46_79ab0ef90c60.slice/crio-16809bafad8484d2583f4d23a466e3532f0a0b7deca3554e1cbb558baa9f1734 WatchSource:0}: Error finding container 16809bafad8484d2583f4d23a466e3532f0a0b7deca3554e1cbb558baa9f1734: Status 404 returned error can't find the container with id 16809bafad8484d2583f4d23a466e3532f0a0b7deca3554e1cbb558baa9f1734
Sep 09 15:30:48.320445 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:48.320380    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb1a981d-446a-4108-851c-96aa4953b80a" path="/var/lib/kubelet/pods/cb1a981d-446a-4108-851c-96aa4953b80a/volumes"
Sep 09 15:30:48.809438 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:48.809406    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6" event={"ID":"417d518b-8c18-4c1e-bf46-79ab0ef90c60","Type":"ContainerStarted","Data":"16809bafad8484d2583f4d23a466e3532f0a0b7deca3554e1cbb558baa9f1734"}
Sep 09 15:30:51.828079 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:51.828034    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qdzzn" event={"ID":"95a7ba5d-3264-4ef3-be20-6f04e40c1cb0","Type":"ContainerStarted","Data":"da9a1a9b69c34d7946cd434a14974c1152bede8407b42b394022384fc11ef239"}
Sep 09 15:30:51.828507 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:51.828148    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qdzzn"
Sep 09 15:30:51.829793 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:51.829768    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6" event={"ID":"417d518b-8c18-4c1e-bf46-79ab0ef90c60","Type":"ContainerStarted","Data":"b27bd7ce3561bf9a5ac36c1294f7bcbda6e26a8d1bc9adab278ecf16b62dcf3f"}
Sep 09 15:30:51.829910 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:51.829896    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6"
Sep 09 15:30:51.846194 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:51.846147    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qdzzn" podStartSLOduration=2.525600507 podStartE2EDuration="5.846130928s" totalImagesPullingTime="3.320530421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:30:51.844750204 +0000 UTC m=+636.034952975" watchObservedRunningTime="2026-09-09 15:30:51.846130928 +0000 UTC m=+636.036333679"
Sep 09 15:30:51.883637 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:30:51.883579    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6" podStartSLOduration=3.135161353 podStartE2EDuration="5.883559907s" totalImagesPullingTime="2.748398554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:30:51.881861882 +0000 UTC m=+636.072064654" watchObservedRunningTime="2026-09-09 15:30:51.883559907 +0000 UTC m=+636.073762655"
Sep 09 15:31:22.837340 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:22.837305    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qdzzn"
Sep 09 15:31:22.840360 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:22.840339    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5tsw6"
Sep 09 15:31:41.399324 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.399287    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94"]
Sep 09 15:31:41.402918 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.402900    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94"
Sep 09 15:31:41.405419 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.405386    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 15:31:41.405569 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.405396    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 15:31:41.407041 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.407013    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vln6l\""
Sep 09 15:31:41.409528 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.409503    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94"]
Sep 09 15:31:41.498687 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.498654    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494"]
Sep 09 15:31:41.502550 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.502526    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494"
Sep 09 15:31:41.510757 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.510728    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494"]
Sep 09 15:31:41.541648 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.541611    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dae2cc06-9416-4d43-9265-dd22de81ad67-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94\" (UID: \"dae2cc06-9416-4d43-9265-dd22de81ad67\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94"
Sep 09 15:31:41.541833 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.541694    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dae2cc06-9416-4d43-9265-dd22de81ad67-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94\" (UID: \"dae2cc06-9416-4d43-9265-dd22de81ad67\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94"
Sep 09 15:31:41.541833 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.541724    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtk8p\" (UniqueName: \"kubernetes.io/projected/dae2cc06-9416-4d43-9265-dd22de81ad67-kube-api-access-gtk8p\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94\" (UID: \"dae2cc06-9416-4d43-9265-dd22de81ad67\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94"
Sep 09 15:31:41.603555 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.603524    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m"]
Sep 09 15:31:41.607188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.607164    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m"
Sep 09 15:31:41.614407 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.614374    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m"]
Sep 09 15:31:41.642288 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.642257    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dae2cc06-9416-4d43-9265-dd22de81ad67-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94\" (UID: \"dae2cc06-9416-4d43-9265-dd22de81ad67\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94"
Sep 09 15:31:41.642483 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.642298    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtk8p\" (UniqueName: \"kubernetes.io/projected/dae2cc06-9416-4d43-9265-dd22de81ad67-kube-api-access-gtk8p\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94\" (UID: \"dae2cc06-9416-4d43-9265-dd22de81ad67\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94"
Sep 09 15:31:41.642483 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.642319    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b569592-799f-46aa-8c65-a90905b7c1b5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494\" (UID: \"4b569592-799f-46aa-8c65-a90905b7c1b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494"
Sep 09 15:31:41.642483 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.642347    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b569592-799f-46aa-8c65-a90905b7c1b5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494\" (UID: \"4b569592-799f-46aa-8c65-a90905b7c1b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494"
Sep 09 15:31:41.642483 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.642445    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dae2cc06-9416-4d43-9265-dd22de81ad67-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94\" (UID: \"dae2cc06-9416-4d43-9265-dd22de81ad67\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94"
Sep 09 15:31:41.642675 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.642534    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhwkr\" (UniqueName: \"kubernetes.io/projected/4b569592-799f-46aa-8c65-a90905b7c1b5-kube-api-access-fhwkr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494\" (UID: \"4b569592-799f-46aa-8c65-a90905b7c1b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494"
Sep 09 15:31:41.642712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.642674    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dae2cc06-9416-4d43-9265-dd22de81ad67-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94\" (UID: \"dae2cc06-9416-4d43-9265-dd22de81ad67\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94"
Sep 09 15:31:41.642778 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.642762    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dae2cc06-9416-4d43-9265-dd22de81ad67-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94\" (UID: \"dae2cc06-9416-4d43-9265-dd22de81ad67\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94"
Sep 09 15:31:41.652895 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.652814    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtk8p\" (UniqueName: \"kubernetes.io/projected/dae2cc06-9416-4d43-9265-dd22de81ad67-kube-api-access-gtk8p\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94\" (UID: \"dae2cc06-9416-4d43-9265-dd22de81ad67\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94"
Sep 09 15:31:41.702438 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.702399    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d"]
Sep 09 15:31:41.706399 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.706374    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d"
Sep 09 15:31:41.713278 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.713249    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94"
Sep 09 15:31:41.713947 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.713921    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d"]
Sep 09 15:31:41.743680 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.743637    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b569592-799f-46aa-8c65-a90905b7c1b5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494\" (UID: \"4b569592-799f-46aa-8c65-a90905b7c1b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494"
Sep 09 15:31:41.743680 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.743684    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl2cb\" (UniqueName: \"kubernetes.io/projected/862fbd8d-0e94-426a-9791-3be5fb3ca107-kube-api-access-cl2cb\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m\" (UID: \"862fbd8d-0e94-426a-9791-3be5fb3ca107\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m"
Sep 09 15:31:41.743967 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.743731    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/862fbd8d-0e94-426a-9791-3be5fb3ca107-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m\" (UID: \"862fbd8d-0e94-426a-9791-3be5fb3ca107\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m"
Sep 09 15:31:41.743967 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.743789    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhwkr\" (UniqueName: \"kubernetes.io/projected/4b569592-799f-46aa-8c65-a90905b7c1b5-kube-api-access-fhwkr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494\" (UID: \"4b569592-799f-46aa-8c65-a90905b7c1b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494"
Sep 09 15:31:41.743967 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.743821    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/862fbd8d-0e94-426a-9791-3be5fb3ca107-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m\" (UID: \"862fbd8d-0e94-426a-9791-3be5fb3ca107\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m"
Sep 09 15:31:41.743967 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.743888    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b569592-799f-46aa-8c65-a90905b7c1b5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494\" (UID: \"4b569592-799f-46aa-8c65-a90905b7c1b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494"
Sep 09 15:31:41.744172 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.744104    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b569592-799f-46aa-8c65-a90905b7c1b5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494\" (UID: \"4b569592-799f-46aa-8c65-a90905b7c1b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494"
Sep 09 15:31:41.744172 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.744156    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b569592-799f-46aa-8c65-a90905b7c1b5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494\" (UID: \"4b569592-799f-46aa-8c65-a90905b7c1b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494"
Sep 09 15:31:41.755416 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.754921    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhwkr\" (UniqueName: \"kubernetes.io/projected/4b569592-799f-46aa-8c65-a90905b7c1b5-kube-api-access-fhwkr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494\" (UID: \"4b569592-799f-46aa-8c65-a90905b7c1b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494"
Sep 09 15:31:41.813194 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.813163    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494"
Sep 09 15:31:41.844798 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.844760    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d\" (UID: \"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d"
Sep 09 15:31:41.844974 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.844828    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d\" (UID: \"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d"
Sep 09 15:31:41.844974 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.844945    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/862fbd8d-0e94-426a-9791-3be5fb3ca107-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m\" (UID: \"862fbd8d-0e94-426a-9791-3be5fb3ca107\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m"
Sep 09 15:31:41.845097 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.845040    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl2cb\" (UniqueName: \"kubernetes.io/projected/862fbd8d-0e94-426a-9791-3be5fb3ca107-kube-api-access-cl2cb\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m\" (UID: \"862fbd8d-0e94-426a-9791-3be5fb3ca107\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m"
Sep 09 15:31:41.845097 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.845086    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqqdc\" (UniqueName: \"kubernetes.io/projected/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-kube-api-access-cqqdc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d\" (UID: \"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d"
Sep 09 15:31:41.845197 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.845144    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/862fbd8d-0e94-426a-9791-3be5fb3ca107-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m\" (UID: \"862fbd8d-0e94-426a-9791-3be5fb3ca107\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m"
Sep 09 15:31:41.845355 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.845323    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/862fbd8d-0e94-426a-9791-3be5fb3ca107-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m\" (UID: \"862fbd8d-0e94-426a-9791-3be5fb3ca107\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m"
Sep 09 15:31:41.845486 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.845470    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/862fbd8d-0e94-426a-9791-3be5fb3ca107-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m\" (UID: \"862fbd8d-0e94-426a-9791-3be5fb3ca107\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m"
Sep 09 15:31:41.856675 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.856644    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl2cb\" (UniqueName: \"kubernetes.io/projected/862fbd8d-0e94-426a-9791-3be5fb3ca107-kube-api-access-cl2cb\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m\" (UID: \"862fbd8d-0e94-426a-9791-3be5fb3ca107\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m"
Sep 09 15:31:41.917862 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.917765    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m"
Sep 09 15:31:41.946694 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.946653    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqqdc\" (UniqueName: \"kubernetes.io/projected/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-kube-api-access-cqqdc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d\" (UID: \"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d"
Sep 09 15:31:41.946894 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.946745    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d\" (UID: \"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d"
Sep 09 15:31:41.946894 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.946792    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d\" (UID: \"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d"
Sep 09 15:31:41.947225 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.947203    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d\" (UID: \"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d"
Sep 09 15:31:41.947332 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.947310    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d\" (UID: \"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d"
Sep 09 15:31:41.956167 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.956135    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqqdc\" (UniqueName: \"kubernetes.io/projected/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-kube-api-access-cqqdc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d\" (UID: \"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d"
Sep 09 15:31:41.990449 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:41.990420    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94"]
Sep 09 15:31:41.992635 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:31:41.992607    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae2cc06_9416_4d43_9265_dd22de81ad67.slice/crio-45083f75228a45dbd673af768c357e74468d02c5e8cbc83a8c2cf27d94bd3992 WatchSource:0}: Error finding container 45083f75228a45dbd673af768c357e74468d02c5e8cbc83a8c2cf27d94bd3992: Status 404 returned error can't find the container with id 45083f75228a45dbd673af768c357e74468d02c5e8cbc83a8c2cf27d94bd3992
Sep 09 15:31:42.017967 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:42.017942    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d"
Sep 09 15:31:42.085790 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:42.085758    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94" event={"ID":"dae2cc06-9416-4d43-9265-dd22de81ad67","Type":"ContainerStarted","Data":"b6e039793dd0c6e4bd88b4dc9c582da694db966fe62225d20a1cc79128088680"}
Sep 09 15:31:42.085950 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:42.085814    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94" event={"ID":"dae2cc06-9416-4d43-9265-dd22de81ad67","Type":"ContainerStarted","Data":"45083f75228a45dbd673af768c357e74468d02c5e8cbc83a8c2cf27d94bd3992"}
Sep 09 15:31:42.097136 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:42.096069    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494"]
Sep 09 15:31:42.101494 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:31:42.101459    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b569592_799f_46aa_8c65_a90905b7c1b5.slice/crio-a22b74a837a8d441e050a0412ea82cbe950df56807d3229bc13f803e1eed2552 WatchSource:0}: Error finding container a22b74a837a8d441e050a0412ea82cbe950df56807d3229bc13f803e1eed2552: Status 404 returned error can't find the container with id a22b74a837a8d441e050a0412ea82cbe950df56807d3229bc13f803e1eed2552
Sep 09 15:31:42.190462 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:42.190437    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m"]
Sep 09 15:31:42.192156 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:31:42.192128    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod862fbd8d_0e94_426a_9791_3be5fb3ca107.slice/crio-2a2273bd35419438ba8db15202bb0a4210cc834d9367defb63ade1af4ea9cb64 WatchSource:0}: Error finding container 2a2273bd35419438ba8db15202bb0a4210cc834d9367defb63ade1af4ea9cb64: Status 404 returned error can't find the container with id 2a2273bd35419438ba8db15202bb0a4210cc834d9367defb63ade1af4ea9cb64
Sep 09 15:31:42.291452 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:42.291422    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d"]
Sep 09 15:31:42.292877 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:31:42.292836    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0ac181_39ee_4981_a9c8_8a15a6fb1b92.slice/crio-94c9a1e4cc0ec8039235ddbcf617eb841ed26c03aed926bbaa1a6dd9e0efd781 WatchSource:0}: Error finding container 94c9a1e4cc0ec8039235ddbcf617eb841ed26c03aed926bbaa1a6dd9e0efd781: Status 404 returned error can't find the container with id 94c9a1e4cc0ec8039235ddbcf617eb841ed26c03aed926bbaa1a6dd9e0efd781
Sep 09 15:31:43.092929 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:43.092889    2574 generic.go:356] "Generic (PLEG): container finished" podID="dae2cc06-9416-4d43-9265-dd22de81ad67" containerID="b6e039793dd0c6e4bd88b4dc9c582da694db966fe62225d20a1cc79128088680" exitCode=0
Sep 09 15:31:43.093340 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:43.092970    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94" event={"ID":"dae2cc06-9416-4d43-9265-dd22de81ad67","Type":"ContainerDied","Data":"b6e039793dd0c6e4bd88b4dc9c582da694db966fe62225d20a1cc79128088680"}
Sep 09 15:31:43.094112 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:43.094090    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 15:31:43.094677 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:43.094655    2574 generic.go:356] "Generic (PLEG): container finished" podID="4c0ac181-39ee-4981-a9c8-8a15a6fb1b92" containerID="3083347d0d11dbea7e68568869804e38bffdfe0858d589a965988d25b4d0fdfb" exitCode=0
Sep 09 15:31:43.094752 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:43.094695    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d" event={"ID":"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92","Type":"ContainerDied","Data":"3083347d0d11dbea7e68568869804e38bffdfe0858d589a965988d25b4d0fdfb"}
Sep 09 15:31:43.094752 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:43.094736    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d" event={"ID":"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92","Type":"ContainerStarted","Data":"94c9a1e4cc0ec8039235ddbcf617eb841ed26c03aed926bbaa1a6dd9e0efd781"}
Sep 09 15:31:43.096555 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:43.096534    2574 generic.go:356] "Generic (PLEG): container finished" podID="4b569592-799f-46aa-8c65-a90905b7c1b5" containerID="bcf89f411c38329d7568c9dbaa8b21111949517feca520e80509030e80d3f85d" exitCode=0
Sep 09 15:31:43.096660 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:43.096636    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494" event={"ID":"4b569592-799f-46aa-8c65-a90905b7c1b5","Type":"ContainerDied","Data":"bcf89f411c38329d7568c9dbaa8b21111949517feca520e80509030e80d3f85d"}
Sep 09 15:31:43.096721 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:43.096688    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494" event={"ID":"4b569592-799f-46aa-8c65-a90905b7c1b5","Type":"ContainerStarted","Data":"a22b74a837a8d441e050a0412ea82cbe950df56807d3229bc13f803e1eed2552"}
Sep 09 15:31:43.098603 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:43.098584    2574 generic.go:356] "Generic (PLEG): container finished" podID="862fbd8d-0e94-426a-9791-3be5fb3ca107" containerID="4b51a4da663537d2ddfa329e0b576f1cdef4dbd14e82538d0c8608c36e9833b1" exitCode=0
Sep 09 15:31:43.098671 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:43.098630    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m" event={"ID":"862fbd8d-0e94-426a-9791-3be5fb3ca107","Type":"ContainerDied","Data":"4b51a4da663537d2ddfa329e0b576f1cdef4dbd14e82538d0c8608c36e9833b1"}
Sep 09 15:31:43.098671 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:43.098659    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m" event={"ID":"862fbd8d-0e94-426a-9791-3be5fb3ca107","Type":"ContainerStarted","Data":"2a2273bd35419438ba8db15202bb0a4210cc834d9367defb63ade1af4ea9cb64"}
Sep 09 15:31:45.112797 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:45.112762    2574 generic.go:356] "Generic (PLEG): container finished" podID="862fbd8d-0e94-426a-9791-3be5fb3ca107" containerID="7de70880d92d05be1376e83ebd11e28d3280d357e224a76447a398a2208ca97d" exitCode=0
Sep 09 15:31:45.113278 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:45.112867    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m" event={"ID":"862fbd8d-0e94-426a-9791-3be5fb3ca107","Type":"ContainerDied","Data":"7de70880d92d05be1376e83ebd11e28d3280d357e224a76447a398a2208ca97d"}
Sep 09 15:31:45.114834 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:45.114806    2574 generic.go:356] "Generic (PLEG): container finished" podID="dae2cc06-9416-4d43-9265-dd22de81ad67" containerID="6cfcc9a3cc29570d15bf2a3572760debb2de96ddd0f835e8f4c7e3157682c059" exitCode=0
Sep 09 15:31:45.114973 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:45.114836    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94" event={"ID":"dae2cc06-9416-4d43-9265-dd22de81ad67","Type":"ContainerDied","Data":"6cfcc9a3cc29570d15bf2a3572760debb2de96ddd0f835e8f4c7e3157682c059"}
Sep 09 15:31:45.116814 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:45.116793    2574 generic.go:356] "Generic (PLEG): container finished" podID="4c0ac181-39ee-4981-a9c8-8a15a6fb1b92" containerID="eeea12c85aa3573dc1d3fd82251005154e94e8b72dcd053790814da0f9279d53" exitCode=0
Sep 09 15:31:45.116909 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:45.116886    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d" event={"ID":"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92","Type":"ContainerDied","Data":"eeea12c85aa3573dc1d3fd82251005154e94e8b72dcd053790814da0f9279d53"}
Sep 09 15:31:46.124202 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:46.124175    2574 generic.go:356] "Generic (PLEG): container finished" podID="862fbd8d-0e94-426a-9791-3be5fb3ca107" containerID="d0e555c99ce0bec254499f27dbce619054f717af9e6c589f814a39543dcba75a" exitCode=0
Sep 09 15:31:46.124533 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:46.124214    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m" event={"ID":"862fbd8d-0e94-426a-9791-3be5fb3ca107","Type":"ContainerDied","Data":"d0e555c99ce0bec254499f27dbce619054f717af9e6c589f814a39543dcba75a"}
Sep 09 15:31:46.126825 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:46.126799    2574 generic.go:356] "Generic (PLEG): container finished" podID="dae2cc06-9416-4d43-9265-dd22de81ad67" containerID="caed022eacaf07a1f0af212774f75b9b45d268d2fb3f01957402454b97dcbf2f" exitCode=0
Sep 09 15:31:46.126950 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:46.126876    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94" event={"ID":"dae2cc06-9416-4d43-9265-dd22de81ad67","Type":"ContainerDied","Data":"caed022eacaf07a1f0af212774f75b9b45d268d2fb3f01957402454b97dcbf2f"}
Sep 09 15:31:46.129487 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:46.129464    2574 generic.go:356] "Generic (PLEG): container finished" podID="4c0ac181-39ee-4981-a9c8-8a15a6fb1b92" containerID="551423ff48eb6997ad57760da736b6db880a9ea2d3e31876858dd896a07bbe62" exitCode=0
Sep 09 15:31:46.129602 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:46.129512    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d" event={"ID":"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92","Type":"ContainerDied","Data":"551423ff48eb6997ad57760da736b6db880a9ea2d3e31876858dd896a07bbe62"}
Sep 09 15:31:47.136901 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.136862    2574 generic.go:356] "Generic (PLEG): container finished" podID="4b569592-799f-46aa-8c65-a90905b7c1b5" containerID="66837ad8f475092cb155133d1dadb0591d97612fa83d74f42137ff379c058f3a" exitCode=0
Sep 09 15:31:47.137470 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.136955    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494" event={"ID":"4b569592-799f-46aa-8c65-a90905b7c1b5","Type":"ContainerDied","Data":"66837ad8f475092cb155133d1dadb0591d97612fa83d74f42137ff379c058f3a"}
Sep 09 15:31:47.360856 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.360811    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d"
Sep 09 15:31:47.363005 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.362986    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94"
Sep 09 15:31:47.366039 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.366020    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m"
Sep 09 15:31:47.501531 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.501499    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqqdc\" (UniqueName: \"kubernetes.io/projected/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-kube-api-access-cqqdc\") pod \"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92\" (UID: \"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92\") "
Sep 09 15:31:47.501725 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.501543    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dae2cc06-9416-4d43-9265-dd22de81ad67-bundle\") pod \"dae2cc06-9416-4d43-9265-dd22de81ad67\" (UID: \"dae2cc06-9416-4d43-9265-dd22de81ad67\") "
Sep 09 15:31:47.501725 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.501564    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-bundle\") pod \"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92\" (UID: \"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92\") "
Sep 09 15:31:47.501725 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.501604    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl2cb\" (UniqueName: \"kubernetes.io/projected/862fbd8d-0e94-426a-9791-3be5fb3ca107-kube-api-access-cl2cb\") pod \"862fbd8d-0e94-426a-9791-3be5fb3ca107\" (UID: \"862fbd8d-0e94-426a-9791-3be5fb3ca107\") "
Sep 09 15:31:47.501725 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.501657    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-util\") pod \"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92\" (UID: \"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92\") "
Sep 09 15:31:47.501725 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.501676    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtk8p\" (UniqueName: \"kubernetes.io/projected/dae2cc06-9416-4d43-9265-dd22de81ad67-kube-api-access-gtk8p\") pod \"dae2cc06-9416-4d43-9265-dd22de81ad67\" (UID: \"dae2cc06-9416-4d43-9265-dd22de81ad67\") "
Sep 09 15:31:47.501725 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.501710    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/862fbd8d-0e94-426a-9791-3be5fb3ca107-util\") pod \"862fbd8d-0e94-426a-9791-3be5fb3ca107\" (UID: \"862fbd8d-0e94-426a-9791-3be5fb3ca107\") "
Sep 09 15:31:47.502060 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.501747    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/862fbd8d-0e94-426a-9791-3be5fb3ca107-bundle\") pod \"862fbd8d-0e94-426a-9791-3be5fb3ca107\" (UID: \"862fbd8d-0e94-426a-9791-3be5fb3ca107\") "
Sep 09 15:31:47.502060 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.501777    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dae2cc06-9416-4d43-9265-dd22de81ad67-util\") pod \"dae2cc06-9416-4d43-9265-dd22de81ad67\" (UID: \"dae2cc06-9416-4d43-9265-dd22de81ad67\") "
Sep 09 15:31:47.502764 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.502518    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-bundle" (OuterVolumeSpecName: "bundle") pod "4c0ac181-39ee-4981-a9c8-8a15a6fb1b92" (UID: "4c0ac181-39ee-4981-a9c8-8a15a6fb1b92"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:31:47.503209 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.503183    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/862fbd8d-0e94-426a-9791-3be5fb3ca107-bundle" (OuterVolumeSpecName: "bundle") pod "862fbd8d-0e94-426a-9791-3be5fb3ca107" (UID: "862fbd8d-0e94-426a-9791-3be5fb3ca107"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:31:47.503209 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.503198    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae2cc06-9416-4d43-9265-dd22de81ad67-bundle" (OuterVolumeSpecName: "bundle") pod "dae2cc06-9416-4d43-9265-dd22de81ad67" (UID: "dae2cc06-9416-4d43-9265-dd22de81ad67"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:31:47.504264 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.504237    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-kube-api-access-cqqdc" (OuterVolumeSpecName: "kube-api-access-cqqdc") pod "4c0ac181-39ee-4981-a9c8-8a15a6fb1b92" (UID: "4c0ac181-39ee-4981-a9c8-8a15a6fb1b92"). InnerVolumeSpecName "kube-api-access-cqqdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:31:47.504380 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.504356    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/862fbd8d-0e94-426a-9791-3be5fb3ca107-kube-api-access-cl2cb" (OuterVolumeSpecName: "kube-api-access-cl2cb") pod "862fbd8d-0e94-426a-9791-3be5fb3ca107" (UID: "862fbd8d-0e94-426a-9791-3be5fb3ca107"). InnerVolumeSpecName "kube-api-access-cl2cb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:31:47.504493 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.504480    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dae2cc06-9416-4d43-9265-dd22de81ad67-kube-api-access-gtk8p" (OuterVolumeSpecName: "kube-api-access-gtk8p") pod "dae2cc06-9416-4d43-9265-dd22de81ad67" (UID: "dae2cc06-9416-4d43-9265-dd22de81ad67"). InnerVolumeSpecName "kube-api-access-gtk8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:31:47.508282 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.508246    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/862fbd8d-0e94-426a-9791-3be5fb3ca107-util" (OuterVolumeSpecName: "util") pod "862fbd8d-0e94-426a-9791-3be5fb3ca107" (UID: "862fbd8d-0e94-426a-9791-3be5fb3ca107"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:31:47.508878 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.508833    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae2cc06-9416-4d43-9265-dd22de81ad67-util" (OuterVolumeSpecName: "util") pod "dae2cc06-9416-4d43-9265-dd22de81ad67" (UID: "dae2cc06-9416-4d43-9265-dd22de81ad67"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:31:47.510149 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.510119    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-util" (OuterVolumeSpecName: "util") pod "4c0ac181-39ee-4981-a9c8-8a15a6fb1b92" (UID: "4c0ac181-39ee-4981-a9c8-8a15a6fb1b92"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:31:47.602600 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.602559    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl2cb\" (UniqueName: \"kubernetes.io/projected/862fbd8d-0e94-426a-9791-3be5fb3ca107-kube-api-access-cl2cb\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:31:47.602600 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.602594    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-util\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:31:47.602600 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.602606    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtk8p\" (UniqueName: \"kubernetes.io/projected/dae2cc06-9416-4d43-9265-dd22de81ad67-kube-api-access-gtk8p\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:31:47.602823 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.602615    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/862fbd8d-0e94-426a-9791-3be5fb3ca107-util\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:31:47.602823 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.602625    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/862fbd8d-0e94-426a-9791-3be5fb3ca107-bundle\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:31:47.602823 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.602633    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dae2cc06-9416-4d43-9265-dd22de81ad67-util\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:31:47.602823 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.602641    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqqdc\" (UniqueName: \"kubernetes.io/projected/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-kube-api-access-cqqdc\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:31:47.602823 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.602648    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dae2cc06-9416-4d43-9265-dd22de81ad67-bundle\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:31:47.602823 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:47.602657    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c0ac181-39ee-4981-a9c8-8a15a6fb1b92-bundle\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:31:48.144719 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:48.144682    2574 generic.go:356] "Generic (PLEG): container finished" podID="4b569592-799f-46aa-8c65-a90905b7c1b5" containerID="8beb076d7d8e8a3d0ece1df930e90decb740f7f8128311232ad6955d36591d73" exitCode=0
Sep 09 15:31:48.145183 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:48.144772    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494" event={"ID":"4b569592-799f-46aa-8c65-a90905b7c1b5","Type":"ContainerDied","Data":"8beb076d7d8e8a3d0ece1df930e90decb740f7f8128311232ad6955d36591d73"}
Sep 09 15:31:48.146643 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:48.146624    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m"
Sep 09 15:31:48.146764 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:48.146640    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmcb4m" event={"ID":"862fbd8d-0e94-426a-9791-3be5fb3ca107","Type":"ContainerDied","Data":"2a2273bd35419438ba8db15202bb0a4210cc834d9367defb63ade1af4ea9cb64"}
Sep 09 15:31:48.146764 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:48.146676    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a2273bd35419438ba8db15202bb0a4210cc834d9367defb63ade1af4ea9cb64"
Sep 09 15:31:48.148772 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:48.148754    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94"
Sep 09 15:31:48.148772 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:48.148762    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a26m94" event={"ID":"dae2cc06-9416-4d43-9265-dd22de81ad67","Type":"ContainerDied","Data":"45083f75228a45dbd673af768c357e74468d02c5e8cbc83a8c2cf27d94bd3992"}
Sep 09 15:31:48.148949 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:48.148791    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45083f75228a45dbd673af768c357e74468d02c5e8cbc83a8c2cf27d94bd3992"
Sep 09 15:31:48.150856 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:48.150817    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d" event={"ID":"4c0ac181-39ee-4981-a9c8-8a15a6fb1b92","Type":"ContainerDied","Data":"94c9a1e4cc0ec8039235ddbcf617eb841ed26c03aed926bbaa1a6dd9e0efd781"}
Sep 09 15:31:48.150935 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:48.150868    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94c9a1e4cc0ec8039235ddbcf617eb841ed26c03aed926bbaa1a6dd9e0efd781"
Sep 09 15:31:48.150935 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:48.150891    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78mf9d"
Sep 09 15:31:49.284514 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:49.284487    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494"
Sep 09 15:31:49.419203 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:49.419114    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b569592-799f-46aa-8c65-a90905b7c1b5-util\") pod \"4b569592-799f-46aa-8c65-a90905b7c1b5\" (UID: \"4b569592-799f-46aa-8c65-a90905b7c1b5\") "
Sep 09 15:31:49.419203 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:49.419190    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b569592-799f-46aa-8c65-a90905b7c1b5-bundle\") pod \"4b569592-799f-46aa-8c65-a90905b7c1b5\" (UID: \"4b569592-799f-46aa-8c65-a90905b7c1b5\") "
Sep 09 15:31:49.419421 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:49.419215    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhwkr\" (UniqueName: \"kubernetes.io/projected/4b569592-799f-46aa-8c65-a90905b7c1b5-kube-api-access-fhwkr\") pod \"4b569592-799f-46aa-8c65-a90905b7c1b5\" (UID: \"4b569592-799f-46aa-8c65-a90905b7c1b5\") "
Sep 09 15:31:49.419624 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:49.419594    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b569592-799f-46aa-8c65-a90905b7c1b5-bundle" (OuterVolumeSpecName: "bundle") pod "4b569592-799f-46aa-8c65-a90905b7c1b5" (UID: "4b569592-799f-46aa-8c65-a90905b7c1b5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:31:49.421649 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:49.421621    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b569592-799f-46aa-8c65-a90905b7c1b5-kube-api-access-fhwkr" (OuterVolumeSpecName: "kube-api-access-fhwkr") pod "4b569592-799f-46aa-8c65-a90905b7c1b5" (UID: "4b569592-799f-46aa-8c65-a90905b7c1b5"). InnerVolumeSpecName "kube-api-access-fhwkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:31:49.424199 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:49.424175    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b569592-799f-46aa-8c65-a90905b7c1b5-util" (OuterVolumeSpecName: "util") pod "4b569592-799f-46aa-8c65-a90905b7c1b5" (UID: "4b569592-799f-46aa-8c65-a90905b7c1b5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:31:49.520257 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:49.520217    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b569592-799f-46aa-8c65-a90905b7c1b5-util\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:31:49.520257 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:49.520250    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b569592-799f-46aa-8c65-a90905b7c1b5-bundle\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:31:49.520257 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:49.520259    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhwkr\" (UniqueName: \"kubernetes.io/projected/4b569592-799f-46aa-8c65-a90905b7c1b5-kube-api-access-fhwkr\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:31:50.164443 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:50.164406    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494" event={"ID":"4b569592-799f-46aa-8c65-a90905b7c1b5","Type":"ContainerDied","Data":"a22b74a837a8d441e050a0412ea82cbe950df56807d3229bc13f803e1eed2552"}
Sep 09 15:31:50.164443 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:50.164425    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68c494"
Sep 09 15:31:50.164666 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:31:50.164457    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a22b74a837a8d441e050a0412ea82cbe950df56807d3229bc13f803e1eed2552"
Sep 09 15:32:00.989826 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.989790    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-xxxt6"]
Sep 09 15:32:00.990222 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990149    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dae2cc06-9416-4d43-9265-dd22de81ad67" containerName="pull"
Sep 09 15:32:00.990222 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990160    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dae2cc06-9416-4d43-9265-dd22de81ad67" containerName="pull"
Sep 09 15:32:00.990222 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990171    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="862fbd8d-0e94-426a-9791-3be5fb3ca107" containerName="util"
Sep 09 15:32:00.990222 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990177    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="862fbd8d-0e94-426a-9791-3be5fb3ca107" containerName="util"
Sep 09 15:32:00.990222 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990185    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dae2cc06-9416-4d43-9265-dd22de81ad67" containerName="util"
Sep 09 15:32:00.990222 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990190    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dae2cc06-9416-4d43-9265-dd22de81ad67" containerName="util"
Sep 09 15:32:00.990222 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990198    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c0ac181-39ee-4981-a9c8-8a15a6fb1b92" containerName="util"
Sep 09 15:32:00.990222 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990204    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c0ac181-39ee-4981-a9c8-8a15a6fb1b92" containerName="util"
Sep 09 15:32:00.990222 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990209    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="862fbd8d-0e94-426a-9791-3be5fb3ca107" containerName="extract"
Sep 09 15:32:00.990222 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990214    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="862fbd8d-0e94-426a-9791-3be5fb3ca107" containerName="extract"
Sep 09 15:32:00.990222 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990224    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dae2cc06-9416-4d43-9265-dd22de81ad67" containerName="extract"
Sep 09 15:32:00.990222 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990229    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dae2cc06-9416-4d43-9265-dd22de81ad67" containerName="extract"
Sep 09 15:32:00.990712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990236    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="862fbd8d-0e94-426a-9791-3be5fb3ca107" containerName="pull"
Sep 09 15:32:00.990712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990241    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="862fbd8d-0e94-426a-9791-3be5fb3ca107" containerName="pull"
Sep 09 15:32:00.990712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990254    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b569592-799f-46aa-8c65-a90905b7c1b5" containerName="extract"
Sep 09 15:32:00.990712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990259    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b569592-799f-46aa-8c65-a90905b7c1b5" containerName="extract"
Sep 09 15:32:00.990712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990265    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b569592-799f-46aa-8c65-a90905b7c1b5" containerName="util"
Sep 09 15:32:00.990712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990269    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b569592-799f-46aa-8c65-a90905b7c1b5" containerName="util"
Sep 09 15:32:00.990712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990275    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c0ac181-39ee-4981-a9c8-8a15a6fb1b92" containerName="pull"
Sep 09 15:32:00.990712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990280    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c0ac181-39ee-4981-a9c8-8a15a6fb1b92" containerName="pull"
Sep 09 15:32:00.990712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990285    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c0ac181-39ee-4981-a9c8-8a15a6fb1b92" containerName="extract"
Sep 09 15:32:00.990712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990290    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c0ac181-39ee-4981-a9c8-8a15a6fb1b92" containerName="extract"
Sep 09 15:32:00.990712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990295    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b569592-799f-46aa-8c65-a90905b7c1b5" containerName="pull"
Sep 09 15:32:00.990712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990299    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b569592-799f-46aa-8c65-a90905b7c1b5" containerName="pull"
Sep 09 15:32:00.990712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990350    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dae2cc06-9416-4d43-9265-dd22de81ad67" containerName="extract"
Sep 09 15:32:00.990712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990358    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="862fbd8d-0e94-426a-9791-3be5fb3ca107" containerName="extract"
Sep 09 15:32:00.990712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990363    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c0ac181-39ee-4981-a9c8-8a15a6fb1b92" containerName="extract"
Sep 09 15:32:00.990712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.990370    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b569592-799f-46aa-8c65-a90905b7c1b5" containerName="extract"
Sep 09 15:32:00.994212 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.994194    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-xxxt6"
Sep 09 15:32:00.996822 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.996788    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 15:32:00.996822 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.996803    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 15:32:00.996993 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:00.996920    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mwbp5\""
Sep 09 15:32:01.002321 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:01.002295    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-xxxt6"]
Sep 09 15:32:01.021638 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:01.021608    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmjf5\" (UniqueName: \"kubernetes.io/projected/b12236f1-640f-4e4b-ad58-f1323dd879dc-kube-api-access-dmjf5\") pod \"authorino-operator-76b478bd78-xxxt6\" (UID: \"b12236f1-640f-4e4b-ad58-f1323dd879dc\") " pod="kuadrant-system/authorino-operator-76b478bd78-xxxt6"
Sep 09 15:32:01.122061 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:01.122027    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmjf5\" (UniqueName: \"kubernetes.io/projected/b12236f1-640f-4e4b-ad58-f1323dd879dc-kube-api-access-dmjf5\") pod \"authorino-operator-76b478bd78-xxxt6\" (UID: \"b12236f1-640f-4e4b-ad58-f1323dd879dc\") " pod="kuadrant-system/authorino-operator-76b478bd78-xxxt6"
Sep 09 15:32:01.130556 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:01.130529    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmjf5\" (UniqueName: \"kubernetes.io/projected/b12236f1-640f-4e4b-ad58-f1323dd879dc-kube-api-access-dmjf5\") pod \"authorino-operator-76b478bd78-xxxt6\" (UID: \"b12236f1-640f-4e4b-ad58-f1323dd879dc\") " pod="kuadrant-system/authorino-operator-76b478bd78-xxxt6"
Sep 09 15:32:01.305506 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:01.305420    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-xxxt6"
Sep 09 15:32:01.593238 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:01.584256    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-xxxt6"]
Sep 09 15:32:01.593930 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:32:01.593892    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12236f1_640f_4e4b_ad58_f1323dd879dc.slice/crio-5740e23cdd7825ffccb81cdbf80fa97880facc63e5e1cb0242e78263bae90970 WatchSource:0}: Error finding container 5740e23cdd7825ffccb81cdbf80fa97880facc63e5e1cb0242e78263bae90970: Status 404 returned error can't find the container with id 5740e23cdd7825ffccb81cdbf80fa97880facc63e5e1cb0242e78263bae90970
Sep 09 15:32:02.226708 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:02.226667    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-xxxt6" event={"ID":"b12236f1-640f-4e4b-ad58-f1323dd879dc","Type":"ContainerStarted","Data":"5740e23cdd7825ffccb81cdbf80fa97880facc63e5e1cb0242e78263bae90970"}
Sep 09 15:32:05.247057 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:05.247011    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-xxxt6" event={"ID":"b12236f1-640f-4e4b-ad58-f1323dd879dc","Type":"ContainerStarted","Data":"2981860e8b53478901384f4fe12e47eb3354cd00ee6a89b925a54f501a88a900"}
Sep 09 15:32:05.247569 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:05.247213    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-xxxt6"
Sep 09 15:32:05.272405 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:05.272334    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-xxxt6" podStartSLOduration=2.612193836 podStartE2EDuration="5.272311052s" totalImagesPullingTime="2.660117216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:32:05.270621899 +0000 UTC m=+709.460824671" watchObservedRunningTime="2026-09-09 15:32:05.272311052 +0000 UTC m=+709.462513801"
Sep 09 15:32:16.254142 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:16.254109    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-xxxt6"
Sep 09 15:32:28.704794 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:28.704761    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"]
Sep 09 15:32:28.709548 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:28.709531    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"
Sep 09 15:32:28.713160 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:28.713138    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4zwbk\""
Sep 09 15:32:28.724292 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:28.724263    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"]
Sep 09 15:32:28.864749 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:28.864713    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clx2s\" (UniqueName: \"kubernetes.io/projected/32808fcf-857a-4bdd-a54b-76eaf4792305-kube-api-access-clx2s\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-dvdcb\" (UID: \"32808fcf-857a-4bdd-a54b-76eaf4792305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"
Sep 09 15:32:28.864958 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:28.864766    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32808fcf-857a-4bdd-a54b-76eaf4792305-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-dvdcb\" (UID: \"32808fcf-857a-4bdd-a54b-76eaf4792305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"
Sep 09 15:32:28.965745 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:28.965641    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clx2s\" (UniqueName: \"kubernetes.io/projected/32808fcf-857a-4bdd-a54b-76eaf4792305-kube-api-access-clx2s\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-dvdcb\" (UID: \"32808fcf-857a-4bdd-a54b-76eaf4792305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"
Sep 09 15:32:28.965745 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:28.965703    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32808fcf-857a-4bdd-a54b-76eaf4792305-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-dvdcb\" (UID: \"32808fcf-857a-4bdd-a54b-76eaf4792305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"
Sep 09 15:32:28.966178 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:28.966158    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32808fcf-857a-4bdd-a54b-76eaf4792305-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-dvdcb\" (UID: \"32808fcf-857a-4bdd-a54b-76eaf4792305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"
Sep 09 15:32:28.979615 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:28.979574    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clx2s\" (UniqueName: \"kubernetes.io/projected/32808fcf-857a-4bdd-a54b-76eaf4792305-kube-api-access-clx2s\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-dvdcb\" (UID: \"32808fcf-857a-4bdd-a54b-76eaf4792305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"
Sep 09 15:32:29.020205 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:29.020177    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"
Sep 09 15:32:29.321632 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:29.321604    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"]
Sep 09 15:32:29.323635 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:32:29.323605    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32808fcf_857a_4bdd_a54b_76eaf4792305.slice/crio-5993fc947c13d52c483b105c60cf4286b3bbef8e63fc1ae8bf17b12a453bbbfc WatchSource:0}: Error finding container 5993fc947c13d52c483b105c60cf4286b3bbef8e63fc1ae8bf17b12a453bbbfc: Status 404 returned error can't find the container with id 5993fc947c13d52c483b105c60cf4286b3bbef8e63fc1ae8bf17b12a453bbbfc
Sep 09 15:32:29.374592 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:29.374538    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb" event={"ID":"32808fcf-857a-4bdd-a54b-76eaf4792305","Type":"ContainerStarted","Data":"5993fc947c13d52c483b105c60cf4286b3bbef8e63fc1ae8bf17b12a453bbbfc"}
Sep 09 15:32:29.782609 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:29.782510    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"]
Sep 09 15:32:29.785491 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:29.785465    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"]
Sep 09 15:32:29.802454 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:29.802422    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"]
Sep 09 15:32:29.813474 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:29.813450    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"
Sep 09 15:32:29.824659 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:29.824631    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"]
Sep 09 15:32:29.974983 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:29.974937    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcd5m\" (UniqueName: \"kubernetes.io/projected/f33d61e4-7d2e-49cb-83d4-c2a42420f6a8-kube-api-access-gcd5m\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-jq9m8\" (UID: \"f33d61e4-7d2e-49cb-83d4-c2a42420f6a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"
Sep 09 15:32:29.975175 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:29.975093    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f33d61e4-7d2e-49cb-83d4-c2a42420f6a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-jq9m8\" (UID: \"f33d61e4-7d2e-49cb-83d4-c2a42420f6a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"
Sep 09 15:32:30.075935 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:30.075835    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f33d61e4-7d2e-49cb-83d4-c2a42420f6a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-jq9m8\" (UID: \"f33d61e4-7d2e-49cb-83d4-c2a42420f6a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"
Sep 09 15:32:30.076105 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:30.075956    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcd5m\" (UniqueName: \"kubernetes.io/projected/f33d61e4-7d2e-49cb-83d4-c2a42420f6a8-kube-api-access-gcd5m\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-jq9m8\" (UID: \"f33d61e4-7d2e-49cb-83d4-c2a42420f6a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"
Sep 09 15:32:30.076260 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:30.076240    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f33d61e4-7d2e-49cb-83d4-c2a42420f6a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-jq9m8\" (UID: \"f33d61e4-7d2e-49cb-83d4-c2a42420f6a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"
Sep 09 15:32:30.085957 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:30.085924    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcd5m\" (UniqueName: \"kubernetes.io/projected/f33d61e4-7d2e-49cb-83d4-c2a42420f6a8-kube-api-access-gcd5m\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-jq9m8\" (UID: \"f33d61e4-7d2e-49cb-83d4-c2a42420f6a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"
Sep 09 15:32:30.128453 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:30.128418    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"
Sep 09 15:32:30.431188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:30.431157    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"]
Sep 09 15:32:30.432459 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:32:30.432428    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf33d61e4_7d2e_49cb_83d4_c2a42420f6a8.slice/crio-85fa9aed81e73ad8590fb86e96d2e7c9254808fb56144c27ade0354f2d639f21 WatchSource:0}: Error finding container 85fa9aed81e73ad8590fb86e96d2e7c9254808fb56144c27ade0354f2d639f21: Status 404 returned error can't find the container with id 85fa9aed81e73ad8590fb86e96d2e7c9254808fb56144c27ade0354f2d639f21
Sep 09 15:32:31.395771 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:31.395709    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8" event={"ID":"f33d61e4-7d2e-49cb-83d4-c2a42420f6a8","Type":"ContainerStarted","Data":"85fa9aed81e73ad8590fb86e96d2e7c9254808fb56144c27ade0354f2d639f21"}
Sep 09 15:32:34.417097 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:34.417055    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8" event={"ID":"f33d61e4-7d2e-49cb-83d4-c2a42420f6a8","Type":"ContainerStarted","Data":"18e6386b2847d61eb57f3fa6962595ff55f2f0dfa5d61bb947ff0872a6682c55"}
Sep 09 15:32:34.417586 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:34.417121    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"
Sep 09 15:32:34.418944 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:34.418915    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb" podUID="32808fcf-857a-4bdd-a54b-76eaf4792305" containerName="manager" containerID="cri-o://b2e8800dd5c9f83ac5ea61b8984ee0fac97c032c21cebc836d1a38aabdf5847c" gracePeriod=2
Sep 09 15:32:34.437752 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:34.437660    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8" podStartSLOduration=2.50609483 podStartE2EDuration="5.437642507s" totalImagesPullingTime="2.931547677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:32:34.436096236 +0000 UTC m=+738.626298984" watchObservedRunningTime="2026-09-09 15:32:34.437642507 +0000 UTC m=+738.627845257"
Sep 09 15:32:34.661239 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:34.661210    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"
Sep 09 15:32:34.663569 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:32:34.663538    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-dvdcb\" is forbidden: User \"system:node:ip-10-0-140-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-68.ec2.internal' and this object" podUID="32808fcf-857a-4bdd-a54b-76eaf4792305" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"
Sep 09 15:32:34.819314 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:34.819273    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clx2s\" (UniqueName: \"kubernetes.io/projected/32808fcf-857a-4bdd-a54b-76eaf4792305-kube-api-access-clx2s\") pod \"32808fcf-857a-4bdd-a54b-76eaf4792305\" (UID: \"32808fcf-857a-4bdd-a54b-76eaf4792305\") "
Sep 09 15:32:34.819314 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:34.819319    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32808fcf-857a-4bdd-a54b-76eaf4792305-extensions-socket-volume\") pod \"32808fcf-857a-4bdd-a54b-76eaf4792305\" (UID: \"32808fcf-857a-4bdd-a54b-76eaf4792305\") "
Sep 09 15:32:34.819630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:34.819602    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32808fcf-857a-4bdd-a54b-76eaf4792305-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "32808fcf-857a-4bdd-a54b-76eaf4792305" (UID: "32808fcf-857a-4bdd-a54b-76eaf4792305"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:32:34.821773 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:34.821749    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32808fcf-857a-4bdd-a54b-76eaf4792305-kube-api-access-clx2s" (OuterVolumeSpecName: "kube-api-access-clx2s") pod "32808fcf-857a-4bdd-a54b-76eaf4792305" (UID: "32808fcf-857a-4bdd-a54b-76eaf4792305"). InnerVolumeSpecName "kube-api-access-clx2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:32:34.920384 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:34.920333    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clx2s\" (UniqueName: \"kubernetes.io/projected/32808fcf-857a-4bdd-a54b-76eaf4792305-kube-api-access-clx2s\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:32:34.920384 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:34.920378    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32808fcf-857a-4bdd-a54b-76eaf4792305-extensions-socket-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:32:35.426070 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:35.426036    2574 generic.go:356] "Generic (PLEG): container finished" podID="32808fcf-857a-4bdd-a54b-76eaf4792305" containerID="b2e8800dd5c9f83ac5ea61b8984ee0fac97c032c21cebc836d1a38aabdf5847c" exitCode=2
Sep 09 15:32:35.426516 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:35.426084    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"
Sep 09 15:32:35.426516 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:35.426138    2574 scope.go:117] "RemoveContainer" containerID="b2e8800dd5c9f83ac5ea61b8984ee0fac97c032c21cebc836d1a38aabdf5847c"
Sep 09 15:32:35.428689 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:32:35.428666    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-dvdcb\" is forbidden: User \"system:node:ip-10-0-140-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-68.ec2.internal' and this object" podUID="32808fcf-857a-4bdd-a54b-76eaf4792305" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"
Sep 09 15:32:35.435799 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:35.435782    2574 scope.go:117] "RemoveContainer" containerID="b2e8800dd5c9f83ac5ea61b8984ee0fac97c032c21cebc836d1a38aabdf5847c"
Sep 09 15:32:35.436149 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:32:35.436131    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2e8800dd5c9f83ac5ea61b8984ee0fac97c032c21cebc836d1a38aabdf5847c\": container with ID starting with b2e8800dd5c9f83ac5ea61b8984ee0fac97c032c21cebc836d1a38aabdf5847c not found: ID does not exist" containerID="b2e8800dd5c9f83ac5ea61b8984ee0fac97c032c21cebc836d1a38aabdf5847c"
Sep 09 15:32:35.436211 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:35.436159    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2e8800dd5c9f83ac5ea61b8984ee0fac97c032c21cebc836d1a38aabdf5847c"} err="failed to get container status \"b2e8800dd5c9f83ac5ea61b8984ee0fac97c032c21cebc836d1a38aabdf5847c\": rpc error: code = NotFound desc = could not find container \"b2e8800dd5c9f83ac5ea61b8984ee0fac97c032c21cebc836d1a38aabdf5847c\": container with ID starting with b2e8800dd5c9f83ac5ea61b8984ee0fac97c032c21cebc836d1a38aabdf5847c not found: ID does not exist"
Sep 09 15:32:35.436602 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:32:35.436578    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-dvdcb\" is forbidden: User \"system:node:ip-10-0-140-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-68.ec2.internal' and this object" podUID="32808fcf-857a-4bdd-a54b-76eaf4792305" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"
Sep 09 15:32:36.319358 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:32:36.319320    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-dvdcb\" is forbidden: User \"system:node:ip-10-0-140-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-68.ec2.internal' and this object" podUID="32808fcf-857a-4bdd-a54b-76eaf4792305" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-dvdcb"
Sep 09 15:32:36.320863 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:36.320822    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32808fcf-857a-4bdd-a54b-76eaf4792305" path="/var/lib/kubelet/pods/32808fcf-857a-4bdd-a54b-76eaf4792305/volumes"
Sep 09 15:32:45.429120 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:32:45.429091    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"
Sep 09 15:33:01.580424 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:01.580388    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"]
Sep 09 15:33:01.581002 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:01.580621    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8" podUID="f33d61e4-7d2e-49cb-83d4-c2a42420f6a8" containerName="manager" containerID="cri-o://18e6386b2847d61eb57f3fa6962595ff55f2f0dfa5d61bb947ff0872a6682c55" gracePeriod=10
Sep 09 15:33:01.834821 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:01.834755    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"
Sep 09 15:33:01.957271 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:01.957229    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcd5m\" (UniqueName: \"kubernetes.io/projected/f33d61e4-7d2e-49cb-83d4-c2a42420f6a8-kube-api-access-gcd5m\") pod \"f33d61e4-7d2e-49cb-83d4-c2a42420f6a8\" (UID: \"f33d61e4-7d2e-49cb-83d4-c2a42420f6a8\") "
Sep 09 15:33:01.957474 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:01.957350    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f33d61e4-7d2e-49cb-83d4-c2a42420f6a8-extensions-socket-volume\") pod \"f33d61e4-7d2e-49cb-83d4-c2a42420f6a8\" (UID: \"f33d61e4-7d2e-49cb-83d4-c2a42420f6a8\") "
Sep 09 15:33:01.957880 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:01.957810    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f33d61e4-7d2e-49cb-83d4-c2a42420f6a8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f33d61e4-7d2e-49cb-83d4-c2a42420f6a8" (UID: "f33d61e4-7d2e-49cb-83d4-c2a42420f6a8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:33:01.959637 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:01.959608    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f33d61e4-7d2e-49cb-83d4-c2a42420f6a8-kube-api-access-gcd5m" (OuterVolumeSpecName: "kube-api-access-gcd5m") pod "f33d61e4-7d2e-49cb-83d4-c2a42420f6a8" (UID: "f33d61e4-7d2e-49cb-83d4-c2a42420f6a8"). InnerVolumeSpecName "kube-api-access-gcd5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:33:02.058854 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:02.058815    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcd5m\" (UniqueName: \"kubernetes.io/projected/f33d61e4-7d2e-49cb-83d4-c2a42420f6a8-kube-api-access-gcd5m\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:33:02.058854 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:02.058862    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f33d61e4-7d2e-49cb-83d4-c2a42420f6a8-extensions-socket-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:33:02.580336 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:02.580245    2574 generic.go:356] "Generic (PLEG): container finished" podID="f33d61e4-7d2e-49cb-83d4-c2a42420f6a8" containerID="18e6386b2847d61eb57f3fa6962595ff55f2f0dfa5d61bb947ff0872a6682c55" exitCode=0
Sep 09 15:33:02.580336 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:02.580294    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"
Sep 09 15:33:02.580898 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:02.580331    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8" event={"ID":"f33d61e4-7d2e-49cb-83d4-c2a42420f6a8","Type":"ContainerDied","Data":"18e6386b2847d61eb57f3fa6962595ff55f2f0dfa5d61bb947ff0872a6682c55"}
Sep 09 15:33:02.580898 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:02.580387    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8" event={"ID":"f33d61e4-7d2e-49cb-83d4-c2a42420f6a8","Type":"ContainerDied","Data":"85fa9aed81e73ad8590fb86e96d2e7c9254808fb56144c27ade0354f2d639f21"}
Sep 09 15:33:02.580898 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:02.580412    2574 scope.go:117] "RemoveContainer" containerID="18e6386b2847d61eb57f3fa6962595ff55f2f0dfa5d61bb947ff0872a6682c55"
Sep 09 15:33:02.590036 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:02.590015    2574 scope.go:117] "RemoveContainer" containerID="18e6386b2847d61eb57f3fa6962595ff55f2f0dfa5d61bb947ff0872a6682c55"
Sep 09 15:33:02.590358 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:33:02.590339    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18e6386b2847d61eb57f3fa6962595ff55f2f0dfa5d61bb947ff0872a6682c55\": container with ID starting with 18e6386b2847d61eb57f3fa6962595ff55f2f0dfa5d61bb947ff0872a6682c55 not found: ID does not exist" containerID="18e6386b2847d61eb57f3fa6962595ff55f2f0dfa5d61bb947ff0872a6682c55"
Sep 09 15:33:02.590407 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:02.590369    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e6386b2847d61eb57f3fa6962595ff55f2f0dfa5d61bb947ff0872a6682c55"} err="failed to get container status \"18e6386b2847d61eb57f3fa6962595ff55f2f0dfa5d61bb947ff0872a6682c55\": rpc error: code = NotFound desc = could not find container \"18e6386b2847d61eb57f3fa6962595ff55f2f0dfa5d61bb947ff0872a6682c55\": container with ID starting with 18e6386b2847d61eb57f3fa6962595ff55f2f0dfa5d61bb947ff0872a6682c55 not found: ID does not exist"
Sep 09 15:33:02.603754 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:02.603721    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"]
Sep 09 15:33:02.607684 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:02.607660    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-jq9m8"]
Sep 09 15:33:04.320286 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:04.320247    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f33d61e4-7d2e-49cb-83d4-c2a42420f6a8" path="/var/lib/kubelet/pods/f33d61e4-7d2e-49cb-83d4-c2a42420f6a8/volumes"
Sep 09 15:33:21.538523 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.538492    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:33:21.538944 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.538872    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32808fcf-857a-4bdd-a54b-76eaf4792305" containerName="manager"
Sep 09 15:33:21.538944 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.538883    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="32808fcf-857a-4bdd-a54b-76eaf4792305" containerName="manager"
Sep 09 15:33:21.538944 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.538906    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f33d61e4-7d2e-49cb-83d4-c2a42420f6a8" containerName="manager"
Sep 09 15:33:21.538944 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.538912    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f33d61e4-7d2e-49cb-83d4-c2a42420f6a8" containerName="manager"
Sep 09 15:33:21.539086 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.538972    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="32808fcf-857a-4bdd-a54b-76eaf4792305" containerName="manager"
Sep 09 15:33:21.539086 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.538980    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f33d61e4-7d2e-49cb-83d4-c2a42420f6a8" containerName="manager"
Sep 09 15:33:21.543405 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.543388    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"
Sep 09 15:33:21.546200 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.546023    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6768q\""
Sep 09 15:33:21.546200 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.546067    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 15:33:21.550685 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.550634    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:33:21.576837 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.576802    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:33:21.633453 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.633416    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wh6q\" (UniqueName: \"kubernetes.io/projected/2b71acde-b02e-4f4a-8b00-8f533bfd74fc-kube-api-access-9wh6q\") pod \"limitador-limitador-84994f7ffc-2ktvv\" (UID: \"2b71acde-b02e-4f4a-8b00-8f533bfd74fc\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"
Sep 09 15:33:21.633620 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.633459    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b71acde-b02e-4f4a-8b00-8f533bfd74fc-config-file\") pod \"limitador-limitador-84994f7ffc-2ktvv\" (UID: \"2b71acde-b02e-4f4a-8b00-8f533bfd74fc\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"
Sep 09 15:33:21.734527 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.734486    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b71acde-b02e-4f4a-8b00-8f533bfd74fc-config-file\") pod \"limitador-limitador-84994f7ffc-2ktvv\" (UID: \"2b71acde-b02e-4f4a-8b00-8f533bfd74fc\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"
Sep 09 15:33:21.734700 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.734621    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wh6q\" (UniqueName: \"kubernetes.io/projected/2b71acde-b02e-4f4a-8b00-8f533bfd74fc-kube-api-access-9wh6q\") pod \"limitador-limitador-84994f7ffc-2ktvv\" (UID: \"2b71acde-b02e-4f4a-8b00-8f533bfd74fc\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"
Sep 09 15:33:21.735231 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.735213    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b71acde-b02e-4f4a-8b00-8f533bfd74fc-config-file\") pod \"limitador-limitador-84994f7ffc-2ktvv\" (UID: \"2b71acde-b02e-4f4a-8b00-8f533bfd74fc\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"
Sep 09 15:33:21.742464 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.742431    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wh6q\" (UniqueName: \"kubernetes.io/projected/2b71acde-b02e-4f4a-8b00-8f533bfd74fc-kube-api-access-9wh6q\") pod \"limitador-limitador-84994f7ffc-2ktvv\" (UID: \"2b71acde-b02e-4f4a-8b00-8f533bfd74fc\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"
Sep 09 15:33:21.855055 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:21.854965    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"
Sep 09 15:33:22.126533 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:22.126501    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:33:22.128212 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:33:22.128184    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b71acde_b02e_4f4a_8b00_8f533bfd74fc.slice/crio-ad0d2aacca495212b3a3e466da96e0e660d16fbe15bff871e85b71f800d4dec8 WatchSource:0}: Error finding container ad0d2aacca495212b3a3e466da96e0e660d16fbe15bff871e85b71f800d4dec8: Status 404 returned error can't find the container with id ad0d2aacca495212b3a3e466da96e0e660d16fbe15bff871e85b71f800d4dec8
Sep 09 15:33:22.690065 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:22.690030    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-2ktvv" event={"ID":"2b71acde-b02e-4f4a-8b00-8f533bfd74fc","Type":"ContainerStarted","Data":"ad0d2aacca495212b3a3e466da96e0e660d16fbe15bff871e85b71f800d4dec8"}
Sep 09 15:33:24.703551 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:24.703517    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-2ktvv" event={"ID":"2b71acde-b02e-4f4a-8b00-8f533bfd74fc","Type":"ContainerStarted","Data":"2373856bc64cb334be414be60cbb2222e5b3494bb5152e8c4960b226cddb39c0"}
Sep 09 15:33:24.703967 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:24.703654    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"
Sep 09 15:33:24.721905 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:24.721837    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-2ktvv" podStartSLOduration=1.943265689 podStartE2EDuration="3.721820194s" totalImagesPullingTime="1.778554505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:33:24.719497738 +0000 UTC m=+788.909700509" watchObservedRunningTime="2026-09-09 15:33:24.721820194 +0000 UTC m=+788.912022943"
Sep 09 15:33:35.710518 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:33:35.710483    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"
Sep 09 15:34:41.296761 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:34:41.296723    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:35:07.961549 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:07.961469    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"]
Sep 09 15:35:07.965141 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:07.965123    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:07.967770 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:07.967746    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 09 15:35:07.967887 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:07.967785    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dz98x\""
Sep 09 15:35:07.968817 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:07.968795    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 15:35:07.968911 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:07.968829    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 15:35:07.976987 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:07.976963    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"]
Sep 09 15:35:08.080754 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.080719    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.080954 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.080762    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br6bx\" (UniqueName: \"kubernetes.io/projected/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-kube-api-access-br6bx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.080954 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.080853    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.081053 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.080952    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.081053 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.081007    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.081156 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.081062    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.181512 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.181470    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.181512 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.181516    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.181768 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.181542    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.181768 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.181584    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.181768 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.181616    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br6bx\" (UniqueName: \"kubernetes.io/projected/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-kube-api-access-br6bx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.181768 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.181670    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.182045 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.182020    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.182045 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.182038    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.182155 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.182103    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.184008 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.183984    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.184406 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.184385    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.189910 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.189889    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br6bx\" (UniqueName: \"kubernetes.io/projected/b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a-kube-api-access-br6bx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs\" (UID: \"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.276442 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.276338    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:08.490705 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.490668    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:35:08.553940 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:08.553911    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"]
Sep 09 15:35:08.555929 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:35:08.555895    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f7f288_6da2_4c49_9bf9_3285c0e0ae2a.slice/crio-87d500e12a1d3f6f2dbcd5446fd9f2d8ccbe3ae3f26413718f922777629260d1 WatchSource:0}: Error finding container 87d500e12a1d3f6f2dbcd5446fd9f2d8ccbe3ae3f26413718f922777629260d1: Status 404 returned error can't find the container with id 87d500e12a1d3f6f2dbcd5446fd9f2d8ccbe3ae3f26413718f922777629260d1
Sep 09 15:35:09.277028 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:09.276988    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs" event={"ID":"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a","Type":"ContainerStarted","Data":"87d500e12a1d3f6f2dbcd5446fd9f2d8ccbe3ae3f26413718f922777629260d1"}
Sep 09 15:35:10.284106 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:10.284070    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs" event={"ID":"b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a","Type":"ContainerStarted","Data":"ba8fa20af6750012fb23133eca32212baf15087b0c359555aaa590a7b43e68f4"}
Sep 09 15:35:10.305401 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:10.305335    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs" podStartSLOduration=2.137940256 podStartE2EDuration="3.305319004s" totalImagesPullingTime="1.167378748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:35:10.303240936 +0000 UTC m=+894.493443715" watchObservedRunningTime="2026-09-09 15:35:10.305319004 +0000 UTC m=+894.495521752"
Sep 09 15:35:15.599744 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:15.599705    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:35:18.277541 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:18.277494    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:18.277982 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:18.277588    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:18.290311 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:18.290282    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:18.340434 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:18.340396    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs"
Sep 09 15:35:26.653073 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.653036    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"]
Sep 09 15:35:26.657029 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.657007    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.659668 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.659642    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 09 15:35:26.667930 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.667903    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"]
Sep 09 15:35:26.745630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.745593    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2w24\" (UniqueName: \"kubernetes.io/projected/f7e33ed2-8c19-4561-8eaa-a31487be46ff-kube-api-access-j2w24\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.745807 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.745643    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7e33ed2-8c19-4561-8eaa-a31487be46ff-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.745807 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.745725    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7e33ed2-8c19-4561-8eaa-a31487be46ff-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.745807 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.745779    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7e33ed2-8c19-4561-8eaa-a31487be46ff-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.745997 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.745824    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7e33ed2-8c19-4561-8eaa-a31487be46ff-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.745997 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.745864    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7e33ed2-8c19-4561-8eaa-a31487be46ff-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.846636 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.846598    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7e33ed2-8c19-4561-8eaa-a31487be46ff-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.846828 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.846658    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7e33ed2-8c19-4561-8eaa-a31487be46ff-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.846828 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.846691    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7e33ed2-8c19-4561-8eaa-a31487be46ff-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.846828 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.846716    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7e33ed2-8c19-4561-8eaa-a31487be46ff-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.846828 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.846736    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7e33ed2-8c19-4561-8eaa-a31487be46ff-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.846828 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.846771    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2w24\" (UniqueName: \"kubernetes.io/projected/f7e33ed2-8c19-4561-8eaa-a31487be46ff-kube-api-access-j2w24\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.847163 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.847143    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7e33ed2-8c19-4561-8eaa-a31487be46ff-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.847231 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.847208    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7e33ed2-8c19-4561-8eaa-a31487be46ff-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.847291 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.847258    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7e33ed2-8c19-4561-8eaa-a31487be46ff-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.849092 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.849076    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7e33ed2-8c19-4561-8eaa-a31487be46ff-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.849416 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.849401    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7e33ed2-8c19-4561-8eaa-a31487be46ff-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.855777 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.855755    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2w24\" (UniqueName: \"kubernetes.io/projected/f7e33ed2-8c19-4561-8eaa-a31487be46ff-kube-api-access-j2w24\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn\" (UID: \"f7e33ed2-8c19-4561-8eaa-a31487be46ff\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:26.969206 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:26.969173    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:27.246919 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:27.246896    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"]
Sep 09 15:35:27.249245 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:35:27.249221    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e33ed2_8c19_4561_8eaa_a31487be46ff.slice/crio-e1d35d45ed55be059134f526755dfd6d4dab1fbf1414852ad336f723c5cf1120 WatchSource:0}: Error finding container e1d35d45ed55be059134f526755dfd6d4dab1fbf1414852ad336f723c5cf1120: Status 404 returned error can't find the container with id e1d35d45ed55be059134f526755dfd6d4dab1fbf1414852ad336f723c5cf1120
Sep 09 15:35:27.377037 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:27.376999    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn" event={"ID":"f7e33ed2-8c19-4561-8eaa-a31487be46ff","Type":"ContainerStarted","Data":"e1d35d45ed55be059134f526755dfd6d4dab1fbf1414852ad336f723c5cf1120"}
Sep 09 15:35:27.502651 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:27.502572    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:35:28.383705 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:28.383664    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn" event={"ID":"f7e33ed2-8c19-4561-8eaa-a31487be46ff","Type":"ContainerStarted","Data":"d795b5908af4642ba4fb812cb50ece421567435095377741ef4c7206c5750fa5"}
Sep 09 15:35:28.410149 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:28.410095    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn" podStartSLOduration=2.080429891 podStartE2EDuration="2.410076863s" totalImagesPullingTime="329.646972ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:35:28.40765562 +0000 UTC m=+912.597858403" watchObservedRunningTime="2026-09-09 15:35:28.410076863 +0000 UTC m=+912.600279605"
Sep 09 15:35:34.905581 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:34.905540    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:35:36.970323 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:36.970286    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:36.970806 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:36.970360    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:36.982826 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:36.982801    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:37.447508 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:37.447482    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn"
Sep 09 15:35:47.150837 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.150798    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"]
Sep 09 15:35:47.154350 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.154327    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.156876 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.156834    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 09 15:35:47.167612 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.167575    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"]
Sep 09 15:35:47.232922 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.232884    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b372f44-daac-4181-aa13-e3f4ffe381f6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.232922 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.232926    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grz8j\" (UniqueName: \"kubernetes.io/projected/7b372f44-daac-4181-aa13-e3f4ffe381f6-kube-api-access-grz8j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.233172 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.232954    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b372f44-daac-4181-aa13-e3f4ffe381f6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.233172 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.233011    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b372f44-daac-4181-aa13-e3f4ffe381f6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.233172 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.233053    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b372f44-daac-4181-aa13-e3f4ffe381f6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.233172 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.233098    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b372f44-daac-4181-aa13-e3f4ffe381f6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.334249 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.334206    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b372f44-daac-4181-aa13-e3f4ffe381f6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.334465 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.334257    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grz8j\" (UniqueName: \"kubernetes.io/projected/7b372f44-daac-4181-aa13-e3f4ffe381f6-kube-api-access-grz8j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.334465 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.334297    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b372f44-daac-4181-aa13-e3f4ffe381f6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.334465 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.334328    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b372f44-daac-4181-aa13-e3f4ffe381f6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.334465 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.334363    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b372f44-daac-4181-aa13-e3f4ffe381f6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.334465 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.334420    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b372f44-daac-4181-aa13-e3f4ffe381f6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.334813 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.334784    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b372f44-daac-4181-aa13-e3f4ffe381f6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.334917 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.334814    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b372f44-daac-4181-aa13-e3f4ffe381f6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.334917 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.334895    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b372f44-daac-4181-aa13-e3f4ffe381f6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.336784 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.336761    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b372f44-daac-4181-aa13-e3f4ffe381f6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.336988 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.336972    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b372f44-daac-4181-aa13-e3f4ffe381f6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.344036 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.344008    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grz8j\" (UniqueName: \"kubernetes.io/projected/7b372f44-daac-4181-aa13-e3f4ffe381f6-kube-api-access-grz8j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt\" (UID: \"7b372f44-daac-4181-aa13-e3f4ffe381f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.468548 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.468510    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:47.749617 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:47.749589    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"]
Sep 09 15:35:47.751315 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:35:47.751291    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b372f44_daac_4181_aa13_e3f4ffe381f6.slice/crio-87e696b364a90014cb3ffebbd740d8d0e0c3a144ab4143f8fe6734a1a5d9face WatchSource:0}: Error finding container 87e696b364a90014cb3ffebbd740d8d0e0c3a144ab4143f8fe6734a1a5d9face: Status 404 returned error can't find the container with id 87e696b364a90014cb3ffebbd740d8d0e0c3a144ab4143f8fe6734a1a5d9face
Sep 09 15:35:48.498866 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:48.498808    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt" event={"ID":"7b372f44-daac-4181-aa13-e3f4ffe381f6","Type":"ContainerStarted","Data":"65c9c01f12bce0d22f77cf8a3122b33008e96810d9b1a027072b8a33c99e0f71"}
Sep 09 15:35:48.499344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:48.498891    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt" event={"ID":"7b372f44-daac-4181-aa13-e3f4ffe381f6","Type":"ContainerStarted","Data":"87e696b364a90014cb3ffebbd740d8d0e0c3a144ab4143f8fe6734a1a5d9face"}
Sep 09 15:35:48.521570 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:48.521516    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt" podStartSLOduration=1.240601212 podStartE2EDuration="1.521499172s" totalImagesPullingTime="280.89796ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:35:48.519721565 +0000 UTC m=+932.709924314" watchObservedRunningTime="2026-09-09 15:35:48.521499172 +0000 UTC m=+932.711701920"
Sep 09 15:35:48.610030 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:48.609988    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:35:57.468703 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:57.468655    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:57.469134 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:57.468732    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:57.481224 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:57.481198    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:57.556774 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:57.556746    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt"
Sep 09 15:35:59.097598 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:35:59.097557    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:36:17.896204 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:36:17.896173    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:37:50.414933 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:50.414898    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:37:53.895545 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:53.895506    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"]
Sep 09 15:37:53.899207 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:53.899182    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"
Sep 09 15:37:53.901686 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:53.901660    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-df30be\""
Sep 09 15:37:53.901686 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:53.901662    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-df30be-dockercfg-jq7nd\""
Sep 09 15:37:53.909302 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:53.909278    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"]
Sep 09 15:37:53.986108 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:53.986068    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9610f1c2-2449-416e-bda8-3879c3722a05-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg\" (UID: \"9610f1c2-2449-416e-bda8-3879c3722a05\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"
Sep 09 15:37:53.986271 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:53.986178    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbcbb\" (UniqueName: \"kubernetes.io/projected/9610f1c2-2449-416e-bda8-3879c3722a05-kube-api-access-dbcbb\") pod \"payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg\" (UID: \"9610f1c2-2449-416e-bda8-3879c3722a05\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"
Sep 09 15:37:54.087196 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:54.087160    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbcbb\" (UniqueName: \"kubernetes.io/projected/9610f1c2-2449-416e-bda8-3879c3722a05-kube-api-access-dbcbb\") pod \"payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg\" (UID: \"9610f1c2-2449-416e-bda8-3879c3722a05\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"
Sep 09 15:37:54.087380 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:54.087266    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9610f1c2-2449-416e-bda8-3879c3722a05-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg\" (UID: \"9610f1c2-2449-416e-bda8-3879c3722a05\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"
Sep 09 15:37:54.088001 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:54.087981    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9610f1c2-2449-416e-bda8-3879c3722a05-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg\" (UID: \"9610f1c2-2449-416e-bda8-3879c3722a05\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"
Sep 09 15:37:54.095122 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:54.095098    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbcbb\" (UniqueName: \"kubernetes.io/projected/9610f1c2-2449-416e-bda8-3879c3722a05-kube-api-access-dbcbb\") pod \"payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg\" (UID: \"9610f1c2-2449-416e-bda8-3879c3722a05\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"
Sep 09 15:37:54.210967 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:54.210928    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"
Sep 09 15:37:54.490895 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:54.490862    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"]
Sep 09 15:37:54.492061 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:37:54.492027    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9610f1c2_2449_416e_bda8_3879c3722a05.slice/crio-5fda2743ee8fb3dc1632ac76bf7dd27575978bd988f1e2d9afbc1dc42b584e5f WatchSource:0}: Error finding container 5fda2743ee8fb3dc1632ac76bf7dd27575978bd988f1e2d9afbc1dc42b584e5f: Status 404 returned error can't find the container with id 5fda2743ee8fb3dc1632ac76bf7dd27575978bd988f1e2d9afbc1dc42b584e5f
Sep 09 15:37:54.494054 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:54.494040    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 15:37:55.202946 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.202913    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg" event={"ID":"9610f1c2-2449-416e-bda8-3879c3722a05","Type":"ContainerStarted","Data":"5fda2743ee8fb3dc1632ac76bf7dd27575978bd988f1e2d9afbc1dc42b584e5f"}
Sep 09 15:37:55.273716 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.273682    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"]
Sep 09 15:37:55.278672 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.278646    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:37:55.281109 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.281081    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-57b579-serving-cert\""
Sep 09 15:37:55.282109 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.282083    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 15:37:55.282233 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.282104    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 15:37:55.282233 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.282104    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 15:37:55.282233 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.282200    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lw9zj\""
Sep 09 15:37:55.289519 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.289176    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"]
Sep 09 15:37:55.404115 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.404068    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-openshift-service-ca\") pod \"maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:37:55.404298 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.404123    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-metrics-certs\") pod \"maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:37:55.404298 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.404207    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztphc\" (UniqueName: \"kubernetes.io/projected/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-kube-api-access-ztphc\") pod \"maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:37:55.404416 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.404306    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-maas-api-tls\") pod \"maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:37:55.506043 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.505944    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-openshift-service-ca\") pod \"maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:37:55.506043 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.506014    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-metrics-certs\") pod \"maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:37:55.506297 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.506046    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztphc\" (UniqueName: \"kubernetes.io/projected/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-kube-api-access-ztphc\") pod \"maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:37:55.506297 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.506101    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-maas-api-tls\") pod \"maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:37:55.506297 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:37:55.506273    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-serving-cert: secret "maas-api-e2e-inf-a-57b579-serving-cert" not found
Sep 09 15:37:55.506535 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:37:55.506355    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-maas-api-tls podName:9dd1ffb7-d00e-416f-8a90-a9636d3bbe21 nodeName:}" failed. No retries permitted until 2026-09-09 15:37:56.006335682 +0000 UTC m=+1060.196538423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-maas-api-tls") pod "maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr" (UID: "9dd1ffb7-d00e-416f-8a90-a9636d3bbe21") : secret "maas-api-e2e-inf-a-57b579-serving-cert" not found
Sep 09 15:37:55.506677 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.506655    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-openshift-service-ca\") pod \"maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:37:55.508619 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.508596    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-metrics-certs\") pod \"maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:37:55.517022 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:55.516991    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztphc\" (UniqueName: \"kubernetes.io/projected/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-kube-api-access-ztphc\") pod \"maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:37:56.011099 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:56.011061    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-maas-api-tls\") pod \"maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:37:56.013607 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:56.013585    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-maas-api-tls\") pod \"maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:37:56.194980 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:56.194941    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:37:56.487684 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:56.487657    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"]
Sep 09 15:37:56.489512 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:37:56.489480    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dd1ffb7_d00e_416f_8a90_a9636d3bbe21.slice/crio-fb7bde8e7985f4b95c68ce791f023ec146d7e75afb8d484ea343413b6852cc47 WatchSource:0}: Error finding container fb7bde8e7985f4b95c68ce791f023ec146d7e75afb8d484ea343413b6852cc47: Status 404 returned error can't find the container with id fb7bde8e7985f4b95c68ce791f023ec146d7e75afb8d484ea343413b6852cc47
Sep 09 15:37:57.216993 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:57.216957    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr" event={"ID":"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21","Type":"ContainerStarted","Data":"fb7bde8e7985f4b95c68ce791f023ec146d7e75afb8d484ea343413b6852cc47"}
Sep 09 15:37:57.784160 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:57.784125    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"]
Sep 09 15:37:57.793813 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:57.793785    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:57.798033 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:57.797993    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1c76a304-openshift-default-dockercfg-q5bgp\""
Sep 09 15:37:57.808110 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:57.808082    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"]
Sep 09 15:37:57.930353 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:57.930310    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-envoy\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:57.930539 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:57.930366    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4wfc\" (UniqueName: \"kubernetes.io/projected/d5135d1d-80a3-424d-8ac7-519073e3cb3b-kube-api-access-d4wfc\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:57.930539 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:57.930399    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-workload-socket\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:57.930710 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:57.930562    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istiod-ca-cert\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:57.930710 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:57.930649    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-credential-socket\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:57.930710 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:57.930679    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-podinfo\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:57.930929 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:57.930708    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-token\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:57.930929 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:57.930753    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-workload-certs\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:57.930929 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:57.930886    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-data\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.031449 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.031405    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-data\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.031639 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.031505    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-envoy\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.031639 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.031532    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4wfc\" (UniqueName: \"kubernetes.io/projected/d5135d1d-80a3-424d-8ac7-519073e3cb3b-kube-api-access-d4wfc\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.031639 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.031560    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-workload-socket\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.031639 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.031607    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istiod-ca-cert\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.031639 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.031642    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-credential-socket\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.031941 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.031666    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-podinfo\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.031941 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.031692    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-token\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.031941 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.031720    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-workload-certs\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.031941 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.031778    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-data\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.032162 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.032064    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-workload-certs\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.032366 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.032341    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-workload-socket\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.032478 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.032363    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istiod-ca-cert\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.032478 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.032402    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-credential-socket\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.034712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.034652    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-envoy\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.035144 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.035124    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-podinfo\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.041037 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.041015    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-token\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.041434 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.041415    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4wfc\" (UniqueName: \"kubernetes.io/projected/d5135d1d-80a3-424d-8ac7-519073e3cb3b-kube-api-access-d4wfc\") pod \"e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") " pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.112080 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.112037    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:37:58.617977 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:58.617952    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"]
Sep 09 15:37:58.618932 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:37:58.618905    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5135d1d_80a3_424d_8ac7_519073e3cb3b.slice/crio-97ef3d6f8c3bbd20b40f6f5e9d938b66a5a91583709171ca1d79bd9ef5b0f12e WatchSource:0}: Error finding container 97ef3d6f8c3bbd20b40f6f5e9d938b66a5a91583709171ca1d79bd9ef5b0f12e: Status 404 returned error can't find the container with id 97ef3d6f8c3bbd20b40f6f5e9d938b66a5a91583709171ca1d79bd9ef5b0f12e
Sep 09 15:37:59.232918 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:59.232880    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl" event={"ID":"d5135d1d-80a3-424d-8ac7-519073e3cb3b","Type":"ContainerStarted","Data":"97ef3d6f8c3bbd20b40f6f5e9d938b66a5a91583709171ca1d79bd9ef5b0f12e"}
Sep 09 15:37:59.704937 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:37:59.704690    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:38:00.243323 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:00.243238    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg" event={"ID":"9610f1c2-2449-416e-bda8-3879c3722a05","Type":"ContainerStarted","Data":"3a1deb5aba9784d48da01cd8793caa0a76b08084f9e37177d715697588e41641"}
Sep 09 15:38:00.243776 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:00.243369    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"
Sep 09 15:38:00.274120 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:00.274059    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg" podStartSLOduration=1.881951274 podStartE2EDuration="7.274034742s" totalImagesPullingTime="5.392083468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:38:00.272262002 +0000 UTC m=+1064.462464752" watchObservedRunningTime="2026-09-09 15:38:00.274034742 +0000 UTC m=+1064.464237493"
Sep 09 15:38:01.762034 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:01.761991    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:38:01.762352 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:01.762113    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:38:01.762352 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:01.762157    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:38:02.259204 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:02.259165    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl" event={"ID":"d5135d1d-80a3-424d-8ac7-519073e3cb3b","Type":"ContainerStarted","Data":"58838445b1596d452c35881c090dd15522944163b0c7d0c3a9c4000317295ed6"}
Sep 09 15:38:02.261235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:02.261205    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr" event={"ID":"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21","Type":"ContainerStarted","Data":"6fb3481ccabee8730f4c986df66872d4d87e608b90fece35b21953a194cd1cb0"}
Sep 09 15:38:02.261396 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:02.261301    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:38:02.286899 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:02.286826    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl" podStartSLOduration=2.146439901 podStartE2EDuration="5.28680768s" totalImagesPullingTime="3.140367779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:38:02.2850407 +0000 UTC m=+1066.475243475" watchObservedRunningTime="2026-09-09 15:38:02.28680768 +0000 UTC m=+1066.477010423"
Sep 09 15:38:02.303444 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:02.303392    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr" podStartSLOduration=2.026487944 podStartE2EDuration="7.303374254s" totalImagesPullingTime="5.27688631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:38:02.302265956 +0000 UTC m=+1066.492468709" watchObservedRunningTime="2026-09-09 15:38:02.303374254 +0000 UTC m=+1066.493577001"
Sep 09 15:38:02.409473 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:02.409440    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"]
Sep 09 15:38:02.413378 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:02.413352    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"
Sep 09 15:38:02.415683 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:02.415660    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-8a43b2\""
Sep 09 15:38:02.424279 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:02.424255    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"]
Sep 09 15:38:02.482646 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:02.482616    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jfdv\" (UniqueName: \"kubernetes.io/projected/fcccb715-2e54-455c-ae1c-6a231998896b-kube-api-access-6jfdv\") pod \"payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl\" (UID: \"fcccb715-2e54-455c-ae1c-6a231998896b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"
Sep 09 15:38:02.482816 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:02.482654    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcccb715-2e54-455c-ae1c-6a231998896b-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl\" (UID: \"fcccb715-2e54-455c-ae1c-6a231998896b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"
Sep 09 15:38:02.583959 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:02.583869    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jfdv\" (UniqueName: \"kubernetes.io/projected/fcccb715-2e54-455c-ae1c-6a231998896b-kube-api-access-6jfdv\") pod \"payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl\" (UID: \"fcccb715-2e54-455c-ae1c-6a231998896b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"
Sep 09 15:38:02.583959 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:02.583918    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcccb715-2e54-455c-ae1c-6a231998896b-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl\" (UID: \"fcccb715-2e54-455c-ae1c-6a231998896b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"
Sep 09 15:38:02.584683 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:02.584655    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcccb715-2e54-455c-ae1c-6a231998896b-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl\" (UID: \"fcccb715-2e54-455c-ae1c-6a231998896b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"
Sep 09 15:38:02.592164 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:02.592134    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jfdv\" (UniqueName: \"kubernetes.io/projected/fcccb715-2e54-455c-ae1c-6a231998896b-kube-api-access-6jfdv\") pod \"payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl\" (UID: \"fcccb715-2e54-455c-ae1c-6a231998896b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"
Sep 09 15:38:02.726587 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:02.726545    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"
Sep 09 15:38:03.008944 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:03.008916    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"]
Sep 09 15:38:03.009775 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:38:03.009748    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcccb715_2e54_455c_ae1c_6a231998896b.slice/crio-f0bcfb14fe71d5fa46f479f1c5353433d7fdd25ea79b05e7470db18de3e2fc62 WatchSource:0}: Error finding container f0bcfb14fe71d5fa46f479f1c5353433d7fdd25ea79b05e7470db18de3e2fc62: Status 404 returned error can't find the container with id f0bcfb14fe71d5fa46f479f1c5353433d7fdd25ea79b05e7470db18de3e2fc62
Sep 09 15:38:03.112573 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:03.112539    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:38:03.117816 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:03.117786    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:38:03.268513 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:03.268408    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl" event={"ID":"fcccb715-2e54-455c-ae1c-6a231998896b","Type":"ContainerStarted","Data":"b5fd126051300a4511f2b009700b9fab10a5387e25d59b39ac1bc9cf0ec82796"}
Sep 09 15:38:03.268906 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:03.268878    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"
Sep 09 15:38:03.269066 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:03.268916    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:38:03.269066 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:03.268934    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl" event={"ID":"fcccb715-2e54-455c-ae1c-6a231998896b","Type":"ContainerStarted","Data":"f0bcfb14fe71d5fa46f479f1c5353433d7fdd25ea79b05e7470db18de3e2fc62"}
Sep 09 15:38:03.269743 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:03.269727    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:38:03.301400 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:03.301333    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl" podStartSLOduration=1.301313527 podStartE2EDuration="1.301313527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:38:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:38:03.283481846 +0000 UTC m=+1067.473684608" watchObservedRunningTime="2026-09-09 15:38:03.301313527 +0000 UTC m=+1067.491516277"
Sep 09 15:38:05.838587 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:05.838552    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"]
Sep 09 15:38:05.842319 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:05.842298    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"]
Sep 09 15:38:05.842465 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:05.842436    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"
Sep 09 15:38:05.845256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:05.845234    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1c76a304\""
Sep 09 15:38:05.845673 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:05.845655    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"
Sep 09 15:38:05.854604 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:05.854569    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"]
Sep 09 15:38:05.857714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:05.857685    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"]
Sep 09 15:38:05.920890 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:05.920818    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctkt4\" (UniqueName: \"kubernetes.io/projected/667b1657-c9b3-470d-9426-515d01362a30-kube-api-access-ctkt4\") pod \"payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8\" (UID: \"667b1657-c9b3-470d-9426-515d01362a30\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"
Sep 09 15:38:05.921092 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:05.921042    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/667b1657-c9b3-470d-9426-515d01362a30-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8\" (UID: \"667b1657-c9b3-470d-9426-515d01362a30\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"
Sep 09 15:38:06.022413 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:06.022358    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctkt4\" (UniqueName: \"kubernetes.io/projected/667b1657-c9b3-470d-9426-515d01362a30-kube-api-access-ctkt4\") pod \"payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8\" (UID: \"667b1657-c9b3-470d-9426-515d01362a30\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"
Sep 09 15:38:06.022413 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:06.022418    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/667b1657-c9b3-470d-9426-515d01362a30-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8\" (UID: \"667b1657-c9b3-470d-9426-515d01362a30\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"
Sep 09 15:38:06.022682 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:06.022585    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz7dq\" (UniqueName: \"kubernetes.io/projected/4bc75f4e-43ff-48bb-a5e3-f068d954e414-kube-api-access-lz7dq\") pod \"payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq\" (UID: \"4bc75f4e-43ff-48bb-a5e3-f068d954e414\") " pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"
Sep 09 15:38:06.022836 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:06.022810    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc75f4e-43ff-48bb-a5e3-f068d954e414-plugins-config-volume\") pod \"payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq\" (UID: \"4bc75f4e-43ff-48bb-a5e3-f068d954e414\") " pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"
Sep 09 15:38:06.023169 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:06.023147    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/667b1657-c9b3-470d-9426-515d01362a30-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8\" (UID: \"667b1657-c9b3-470d-9426-515d01362a30\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"
Sep 09 15:38:06.030298 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:06.030265    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctkt4\" (UniqueName: \"kubernetes.io/projected/667b1657-c9b3-470d-9426-515d01362a30-kube-api-access-ctkt4\") pod \"payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8\" (UID: \"667b1657-c9b3-470d-9426-515d01362a30\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"
Sep 09 15:38:06.123696 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:06.123592    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz7dq\" (UniqueName: \"kubernetes.io/projected/4bc75f4e-43ff-48bb-a5e3-f068d954e414-kube-api-access-lz7dq\") pod \"payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq\" (UID: \"4bc75f4e-43ff-48bb-a5e3-f068d954e414\") " pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"
Sep 09 15:38:06.123696 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:06.123692    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc75f4e-43ff-48bb-a5e3-f068d954e414-plugins-config-volume\") pod \"payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq\" (UID: \"4bc75f4e-43ff-48bb-a5e3-f068d954e414\") " pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"
Sep 09 15:38:06.124418 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:06.124399    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc75f4e-43ff-48bb-a5e3-f068d954e414-plugins-config-volume\") pod \"payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq\" (UID: \"4bc75f4e-43ff-48bb-a5e3-f068d954e414\") " pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"
Sep 09 15:38:06.131612 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:06.131587    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz7dq\" (UniqueName: \"kubernetes.io/projected/4bc75f4e-43ff-48bb-a5e3-f068d954e414-kube-api-access-lz7dq\") pod \"payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq\" (UID: \"4bc75f4e-43ff-48bb-a5e3-f068d954e414\") " pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"
Sep 09 15:38:06.156757 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:06.156726    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"
Sep 09 15:38:06.163929 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:06.163905    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"
Sep 09 15:38:06.437402 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:06.437374    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"]
Sep 09 15:38:06.438593 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:38:06.438568    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667b1657_c9b3_470d_9426_515d01362a30.slice/crio-87f4355c05f64777df5ccc931074c9baac729f61e604a585d93483a801e7186c WatchSource:0}: Error finding container 87f4355c05f64777df5ccc931074c9baac729f61e604a585d93483a801e7186c: Status 404 returned error can't find the container with id 87f4355c05f64777df5ccc931074c9baac729f61e604a585d93483a801e7186c
Sep 09 15:38:06.445105 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:06.445084    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"]
Sep 09 15:38:06.446550 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:38:06.446523    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc75f4e_43ff_48bb_a5e3_f068d954e414.slice/crio-4a282107ac6356f42980855f504c7c0594abe9cf3aa4f65c539079e9029a7018 WatchSource:0}: Error finding container 4a282107ac6356f42980855f504c7c0594abe9cf3aa4f65c539079e9029a7018: Status 404 returned error can't find the container with id 4a282107ac6356f42980855f504c7c0594abe9cf3aa4f65c539079e9029a7018
Sep 09 15:38:07.294871 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:07.294769    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq" event={"ID":"4bc75f4e-43ff-48bb-a5e3-f068d954e414","Type":"ContainerStarted","Data":"527edfff81b0f15a20e55297c183595beabee65285c784c76d99efe53379daad"}
Sep 09 15:38:07.294871 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:07.294869    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq" event={"ID":"4bc75f4e-43ff-48bb-a5e3-f068d954e414","Type":"ContainerStarted","Data":"4a282107ac6356f42980855f504c7c0594abe9cf3aa4f65c539079e9029a7018"}
Sep 09 15:38:07.295391 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:07.294900    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"
Sep 09 15:38:07.296921 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:07.296887    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8" event={"ID":"667b1657-c9b3-470d-9426-515d01362a30","Type":"ContainerStarted","Data":"a4ebafcae100fa04a283a2aecb562064348e2f8f9ac99b12854864277f8f138b"}
Sep 09 15:38:07.297068 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:07.296974    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"
Sep 09 15:38:07.297068 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:07.296999    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8" event={"ID":"667b1657-c9b3-470d-9426-515d01362a30","Type":"ContainerStarted","Data":"87f4355c05f64777df5ccc931074c9baac729f61e604a585d93483a801e7186c"}
Sep 09 15:38:07.316002 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:07.315953    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq" podStartSLOduration=2.315938021 podStartE2EDuration="2.315938021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:38:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:38:07.314771686 +0000 UTC m=+1071.504974464" watchObservedRunningTime="2026-09-09 15:38:07.315938021 +0000 UTC m=+1071.506140770"
Sep 09 15:38:07.342433 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:07.342370    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8" podStartSLOduration=2.342347381 podStartE2EDuration="2.342347381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:38:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:38:07.34070243 +0000 UTC m=+1071.530905178" watchObservedRunningTime="2026-09-09 15:38:07.342347381 +0000 UTC m=+1071.532550130"
Sep 09 15:38:08.274857 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:08.274812    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:38:11.252254 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:11.252221    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"
Sep 09 15:38:15.282933 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:15.282901    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"
Sep 09 15:38:18.306183 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:18.306141    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"
Sep 09 15:38:18.307867 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:18.307110    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"
Sep 09 15:38:23.305700 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.305601    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:38:23.416417 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.416387    2574 generic.go:356] "Generic (PLEG): container finished" podID="d5135d1d-80a3-424d-8ac7-519073e3cb3b" containerID="58838445b1596d452c35881c090dd15522944163b0c7d0c3a9c4000317295ed6" exitCode=0
Sep 09 15:38:23.416572 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.416463    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl" event={"ID":"d5135d1d-80a3-424d-8ac7-519073e3cb3b","Type":"ContainerDied","Data":"58838445b1596d452c35881c090dd15522944163b0c7d0c3a9c4000317295ed6"}
Sep 09 15:38:23.416855 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.416830    2574 scope.go:117] "RemoveContainer" containerID="58838445b1596d452c35881c090dd15522944163b0c7d0c3a9c4000317295ed6"
Sep 09 15:38:23.418025 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.417996    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:38:23.418102 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.418063    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:38:23.418102 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.418094    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:38:23.714736 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.714702    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"]
Sep 09 15:38:23.719892 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.719825    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.725977 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.725127    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-267962-openshift-default-dockercfg-cfw6p\""
Sep 09 15:38:23.743621 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.743536    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"]
Sep 09 15:38:23.806371 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.806327    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-workload-certs\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.806621 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.806381    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-token\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.806621 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.806415    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istiod-ca-cert\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.806621 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.806502    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8r5g\" (UniqueName: \"kubernetes.io/projected/954e6e86-eb23-4e4c-ba0e-1a58a139d943-kube-api-access-b8r5g\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.806621 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.806560    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-envoy\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.806621 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.806595    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-workload-socket\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.806621 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.806622    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-data\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.806974 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.806690    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-podinfo\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.806974 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.806742    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-credential-socket\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.907939 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.907899    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-workload-certs\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.907939 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.907940    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-token\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.908187 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.907965    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istiod-ca-cert\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.908187 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.908003    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8r5g\" (UniqueName: \"kubernetes.io/projected/954e6e86-eb23-4e4c-ba0e-1a58a139d943-kube-api-access-b8r5g\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.908187 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.908041    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-envoy\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.908187 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.908073    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-workload-socket\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.908400 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.908208    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-data\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.908400 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.908296    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-podinfo\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.908400 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.908350    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-credential-socket\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.908509 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.908408    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-workload-certs\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.908741 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.908716    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-workload-socket\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.908885 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.908779    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-data\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.908885 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.908784    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-credential-socket\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.909130 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.908827    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istiod-ca-cert\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.910902 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.910876    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-envoy\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.911096 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.911078    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-podinfo\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.916114 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.916088    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-token\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:23.916272 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:23.916254    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8r5g\" (UniqueName: \"kubernetes.io/projected/954e6e86-eb23-4e4c-ba0e-1a58a139d943-kube-api-access-b8r5g\") pod \"e2e-inf-b-267962-openshift-default-5575947768-cngdt\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") " pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:24.052373 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:24.052278    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:24.374036 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:24.374006    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"]
Sep 09 15:38:24.375471 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:38:24.375440    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod954e6e86_eb23_4e4c_ba0e_1a58a139d943.slice/crio-e740608590e22182c0f8cffdbe34c89e8e383f3478db7b2c674633dfa691f18d WatchSource:0}: Error finding container e740608590e22182c0f8cffdbe34c89e8e383f3478db7b2c674633dfa691f18d: Status 404 returned error can't find the container with id e740608590e22182c0f8cffdbe34c89e8e383f3478db7b2c674633dfa691f18d
Sep 09 15:38:24.378081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:24.378034    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:38:24.378165 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:24.378130    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:38:24.378213 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:24.378176    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:38:24.428920 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:24.428879    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl" event={"ID":"d5135d1d-80a3-424d-8ac7-519073e3cb3b","Type":"ContainerStarted","Data":"3578dc49a2a6185fced6a6d5ddc42d2d80d0b186386414624fbd1b272a9a7f4b"}
Sep 09 15:38:24.430558 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:24.430528    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt" event={"ID":"954e6e86-eb23-4e4c-ba0e-1a58a139d943","Type":"ContainerStarted","Data":"e740608590e22182c0f8cffdbe34c89e8e383f3478db7b2c674633dfa691f18d"}
Sep 09 15:38:25.113879 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:25.113343    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:38:25.113879 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:25.113512    2574 patch_prober.go:28] interesting pod/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 09 15:38:25.113879 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:25.113563    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl" podUID="d5135d1d-80a3-424d-8ac7-519073e3cb3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 09 15:38:25.438224 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:25.438186    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt" event={"ID":"954e6e86-eb23-4e4c-ba0e-1a58a139d943","Type":"ContainerStarted","Data":"6b74ab6cb8833900645759ca8a1b1b0a9cdee664249e26df8f4a4f413c4968ac"}
Sep 09 15:38:25.460431 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:25.460378    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt" podStartSLOduration=2.460361089 podStartE2EDuration="2.460361089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:38:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:38:25.457275552 +0000 UTC m=+1089.647478331" watchObservedRunningTime="2026-09-09 15:38:25.460361089 +0000 UTC m=+1089.650563838"
Sep 09 15:38:26.052933 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:26.052898    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:26.058092 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:26.058063    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:26.113763 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:26.113306    2574 patch_prober.go:28] interesting pod/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 09 15:38:26.113763 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:26.113385    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl" podUID="d5135d1d-80a3-424d-8ac7-519073e3cb3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 09 15:38:26.444313 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:26.444283    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:26.445348 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:26.445322    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:27.113673 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:27.113632    2574 patch_prober.go:28] interesting pod/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 09 15:38:27.114011 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:27.113976    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl" podUID="d5135d1d-80a3-424d-8ac7-519073e3cb3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 09 15:38:28.112697 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:28.112655    2574 patch_prober.go:28] interesting pod/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 09 15:38:28.113363 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:28.113315    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl" podUID="d5135d1d-80a3-424d-8ac7-519073e3cb3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 09 15:38:29.117336 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:29.117285    2574 patch_prober.go:28] interesting pod/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 09 15:38:29.117960 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:29.117926    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl" podUID="d5135d1d-80a3-424d-8ac7-519073e3cb3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 09 15:38:29.498230 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:29.498138    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"]
Sep 09 15:38:29.504419 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:29.504395    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"
Sep 09 15:38:29.507199 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:29.507170    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-267962\""
Sep 09 15:38:29.515281 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:29.515244    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"]
Sep 09 15:38:29.573902 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:29.573861    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcswf\" (UniqueName: \"kubernetes.io/projected/1c640c28-d3b6-4de8-b8e3-178ccf26329f-kube-api-access-gcswf\") pod \"payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5\" (UID: \"1c640c28-d3b6-4de8-b8e3-178ccf26329f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"
Sep 09 15:38:29.574122 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:29.574057    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c640c28-d3b6-4de8-b8e3-178ccf26329f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5\" (UID: \"1c640c28-d3b6-4de8-b8e3-178ccf26329f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"
Sep 09 15:38:29.674937 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:29.674903    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcswf\" (UniqueName: \"kubernetes.io/projected/1c640c28-d3b6-4de8-b8e3-178ccf26329f-kube-api-access-gcswf\") pod \"payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5\" (UID: \"1c640c28-d3b6-4de8-b8e3-178ccf26329f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"
Sep 09 15:38:29.675155 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:29.675004    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c640c28-d3b6-4de8-b8e3-178ccf26329f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5\" (UID: \"1c640c28-d3b6-4de8-b8e3-178ccf26329f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"
Sep 09 15:38:29.675737 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:29.675716    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c640c28-d3b6-4de8-b8e3-178ccf26329f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5\" (UID: \"1c640c28-d3b6-4de8-b8e3-178ccf26329f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"
Sep 09 15:38:29.683580 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:29.683553    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcswf\" (UniqueName: \"kubernetes.io/projected/1c640c28-d3b6-4de8-b8e3-178ccf26329f-kube-api-access-gcswf\") pod \"payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5\" (UID: \"1c640c28-d3b6-4de8-b8e3-178ccf26329f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"
Sep 09 15:38:29.818772 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:29.818669    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"
Sep 09 15:38:30.109702 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:30.109672    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"]
Sep 09 15:38:30.111553 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:38:30.111510    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c640c28_d3b6_4de8_b8e3_178ccf26329f.slice/crio-68b24777b19daccb379727e45e9169acc17a273835313f2c25cefb5a243fe742 WatchSource:0}: Error finding container 68b24777b19daccb379727e45e9169acc17a273835313f2c25cefb5a243fe742: Status 404 returned error can't find the container with id 68b24777b19daccb379727e45e9169acc17a273835313f2c25cefb5a243fe742
Sep 09 15:38:30.116982 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:30.116961    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:38:30.121081 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:30.121055    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:38:30.121830 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:30.121810    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:38:30.470692 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:30.470653    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5" event={"ID":"1c640c28-d3b6-4de8-b8e3-178ccf26329f","Type":"ContainerStarted","Data":"532f3787d2b7f80324ee24962c7b33f78907b059e0882811ac122633c1ec149d"}
Sep 09 15:38:30.470892 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:30.470718    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5" event={"ID":"1c640c28-d3b6-4de8-b8e3-178ccf26329f","Type":"ContainerStarted","Data":"68b24777b19daccb379727e45e9169acc17a273835313f2c25cefb5a243fe742"}
Sep 09 15:38:30.470986 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:30.470961    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"
Sep 09 15:38:30.489374 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:30.489313    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5" podStartSLOduration=1.489296447 podStartE2EDuration="1.489296447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:38:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:38:30.486399575 +0000 UTC m=+1094.676602345" watchObservedRunningTime="2026-09-09 15:38:30.489296447 +0000 UTC m=+1094.679499240"
Sep 09 15:38:37.207643 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:37.207608    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:38:41.478402 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:41.478370    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"
Sep 09 15:38:46.381214 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.381174    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"]
Sep 09 15:38:46.381678 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.381534    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq" podUID="4bc75f4e-43ff-48bb-a5e3-f068d954e414" containerName="payload-processing" containerID="cri-o://527edfff81b0f15a20e55297c183595beabee65285c784c76d99efe53379daad" gracePeriod=30
Sep 09 15:38:46.390445 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.389782    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"]
Sep 09 15:38:46.390445 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.390048    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8" podUID="667b1657-c9b3-470d-9426-515d01362a30" containerName="payload-pre-processing" containerID="cri-o://a4ebafcae100fa04a283a2aecb562064348e2f8f9ac99b12854864277f8f138b" gracePeriod=30
Sep 09 15:38:46.590363 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.590293    2574 generic.go:356] "Generic (PLEG): container finished" podID="4bc75f4e-43ff-48bb-a5e3-f068d954e414" containerID="527edfff81b0f15a20e55297c183595beabee65285c784c76d99efe53379daad" exitCode=0
Sep 09 15:38:46.590834 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.590337    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq" event={"ID":"4bc75f4e-43ff-48bb-a5e3-f068d954e414","Type":"ContainerDied","Data":"527edfff81b0f15a20e55297c183595beabee65285c784c76d99efe53379daad"}
Sep 09 15:38:46.592835 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.592808    2574 generic.go:356] "Generic (PLEG): container finished" podID="667b1657-c9b3-470d-9426-515d01362a30" containerID="a4ebafcae100fa04a283a2aecb562064348e2f8f9ac99b12854864277f8f138b" exitCode=0
Sep 09 15:38:46.593015 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.592996    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8" event={"ID":"667b1657-c9b3-470d-9426-515d01362a30","Type":"ContainerDied","Data":"a4ebafcae100fa04a283a2aecb562064348e2f8f9ac99b12854864277f8f138b"}
Sep 09 15:38:46.662684 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.662659    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"
Sep 09 15:38:46.693754 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.693724    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"
Sep 09 15:38:46.763103 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.763076    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc75f4e-43ff-48bb-a5e3-f068d954e414-plugins-config-volume\") pod \"4bc75f4e-43ff-48bb-a5e3-f068d954e414\" (UID: \"4bc75f4e-43ff-48bb-a5e3-f068d954e414\") "
Sep 09 15:38:46.763296 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.763171    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz7dq\" (UniqueName: \"kubernetes.io/projected/4bc75f4e-43ff-48bb-a5e3-f068d954e414-kube-api-access-lz7dq\") pod \"4bc75f4e-43ff-48bb-a5e3-f068d954e414\" (UID: \"4bc75f4e-43ff-48bb-a5e3-f068d954e414\") "
Sep 09 15:38:46.763432 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.763407    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bc75f4e-43ff-48bb-a5e3-f068d954e414-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4bc75f4e-43ff-48bb-a5e3-f068d954e414" (UID: "4bc75f4e-43ff-48bb-a5e3-f068d954e414"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:38:46.763555 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.763541    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc75f4e-43ff-48bb-a5e3-f068d954e414-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:38:46.766539 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.766510    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bc75f4e-43ff-48bb-a5e3-f068d954e414-kube-api-access-lz7dq" (OuterVolumeSpecName: "kube-api-access-lz7dq") pod "4bc75f4e-43ff-48bb-a5e3-f068d954e414" (UID: "4bc75f4e-43ff-48bb-a5e3-f068d954e414"). InnerVolumeSpecName "kube-api-access-lz7dq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:38:46.787079 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.787046    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"]
Sep 09 15:38:46.787282 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.787265    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl" podUID="d5135d1d-80a3-424d-8ac7-519073e3cb3b" containerName="istio-proxy" containerID="cri-o://3578dc49a2a6185fced6a6d5ddc42d2d80d0b186386414624fbd1b272a9a7f4b" gracePeriod=30
Sep 09 15:38:46.864320 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.864270    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctkt4\" (UniqueName: \"kubernetes.io/projected/667b1657-c9b3-470d-9426-515d01362a30-kube-api-access-ctkt4\") pod \"667b1657-c9b3-470d-9426-515d01362a30\" (UID: \"667b1657-c9b3-470d-9426-515d01362a30\") "
Sep 09 15:38:46.864492 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.864400    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/667b1657-c9b3-470d-9426-515d01362a30-plugins-config-volume\") pod \"667b1657-c9b3-470d-9426-515d01362a30\" (UID: \"667b1657-c9b3-470d-9426-515d01362a30\") "
Sep 09 15:38:46.864773 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.864743    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/667b1657-c9b3-470d-9426-515d01362a30-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "667b1657-c9b3-470d-9426-515d01362a30" (UID: "667b1657-c9b3-470d-9426-515d01362a30"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:38:46.864902 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.864773    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz7dq\" (UniqueName: \"kubernetes.io/projected/4bc75f4e-43ff-48bb-a5e3-f068d954e414-kube-api-access-lz7dq\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:38:46.867144 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.867097    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/667b1657-c9b3-470d-9426-515d01362a30-kube-api-access-ctkt4" (OuterVolumeSpecName: "kube-api-access-ctkt4") pod "667b1657-c9b3-470d-9426-515d01362a30" (UID: "667b1657-c9b3-470d-9426-515d01362a30"). InnerVolumeSpecName "kube-api-access-ctkt4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:38:46.966089 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.966045    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctkt4\" (UniqueName: \"kubernetes.io/projected/667b1657-c9b3-470d-9426-515d01362a30-kube-api-access-ctkt4\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:38:46.966089 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:46.966081    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/667b1657-c9b3-470d-9426-515d01362a30-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:38:47.601395 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.601362    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq" event={"ID":"4bc75f4e-43ff-48bb-a5e3-f068d954e414","Type":"ContainerDied","Data":"4a282107ac6356f42980855f504c7c0594abe9cf3aa4f65c539079e9029a7018"}
Sep 09 15:38:47.601926 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.601439    2574 scope.go:117] "RemoveContainer" containerID="527edfff81b0f15a20e55297c183595beabee65285c784c76d99efe53379daad"
Sep 09 15:38:47.601926 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.601369    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"
Sep 09 15:38:47.603567 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.603543    2574 generic.go:356] "Generic (PLEG): container finished" podID="954e6e86-eb23-4e4c-ba0e-1a58a139d943" containerID="6b74ab6cb8833900645759ca8a1b1b0a9cdee664249e26df8f4a4f413c4968ac" exitCode=0
Sep 09 15:38:47.603658 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.603626    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt" event={"ID":"954e6e86-eb23-4e4c-ba0e-1a58a139d943","Type":"ContainerDied","Data":"6b74ab6cb8833900645759ca8a1b1b0a9cdee664249e26df8f4a4f413c4968ac"}
Sep 09 15:38:47.604540 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.604126    2574 scope.go:117] "RemoveContainer" containerID="6b74ab6cb8833900645759ca8a1b1b0a9cdee664249e26df8f4a4f413c4968ac"
Sep 09 15:38:47.608338 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.607007    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:38:47.608338 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.607111    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:38:47.608338 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.607175    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:38:47.610003 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.609979    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"
Sep 09 15:38:47.610097 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.609983    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8" event={"ID":"667b1657-c9b3-470d-9426-515d01362a30","Type":"ContainerDied","Data":"87f4355c05f64777df5ccc931074c9baac729f61e604a585d93483a801e7186c"}
Sep 09 15:38:47.614680 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.614658    2574 scope.go:117] "RemoveContainer" containerID="a4ebafcae100fa04a283a2aecb562064348e2f8f9ac99b12854864277f8f138b"
Sep 09 15:38:47.706952 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.706899    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"]
Sep 09 15:38:47.729503 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.729466    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c76a304-99b47d6-rfws8"]
Sep 09 15:38:47.750065 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.749781    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"]
Sep 09 15:38:47.753514 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.753466    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c76a304-7c89cf67b5-4krtq"]
Sep 09 15:38:47.866857 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.866804    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"]
Sep 09 15:38:47.867508 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.867482    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bc75f4e-43ff-48bb-a5e3-f068d954e414" containerName="payload-processing"
Sep 09 15:38:47.867599 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.867512    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bc75f4e-43ff-48bb-a5e3-f068d954e414" containerName="payload-processing"
Sep 09 15:38:47.867599 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.867558    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="667b1657-c9b3-470d-9426-515d01362a30" containerName="payload-pre-processing"
Sep 09 15:38:47.867599 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.867568    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="667b1657-c9b3-470d-9426-515d01362a30" containerName="payload-pre-processing"
Sep 09 15:38:47.867714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.867682    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="667b1657-c9b3-470d-9426-515d01362a30" containerName="payload-pre-processing"
Sep 09 15:38:47.867714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.867700    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bc75f4e-43ff-48bb-a5e3-f068d954e414" containerName="payload-processing"
Sep 09 15:38:47.871705 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.871678    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:47.874788 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.874582    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-a7ffc761-gw-openshift-default-dockercfg-8rsft\""
Sep 09 15:38:47.882364 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.881916    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"]
Sep 09 15:38:47.975769 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.975719    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-workload-socket\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:47.975999 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.975779    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istiod-ca-cert\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:47.975999 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.975814    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-podinfo\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:47.975999 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.975880    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-token\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:47.975999 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.975982    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-credential-socket\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:47.976233 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.976022    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-envoy\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:47.976233 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.976077    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-workload-certs\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:47.976233 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.976147    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-data\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:47.976233 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:47.976179    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9w67\" (UniqueName: \"kubernetes.io/projected/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-kube-api-access-m9w67\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.077360 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.077312    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-data\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.077360 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.077361    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9w67\" (UniqueName: \"kubernetes.io/projected/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-kube-api-access-m9w67\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.078192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.077412    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-workload-socket\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.078192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.077475    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istiod-ca-cert\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.078192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.077509    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-podinfo\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.078192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.077537    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-token\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.078192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.077593    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-credential-socket\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.078192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.077694    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-data\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.078192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.077808    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-envoy\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.078192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.077933    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-workload-certs\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.078192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.077949    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-credential-socket\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.078192 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.077958    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-workload-socket\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.078635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.078201    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-workload-certs\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.078635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.078235    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istiod-ca-cert\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.083060 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.083032    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-envoy\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.086067 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.086042    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-podinfo\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.088996 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.088962    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9w67\" (UniqueName: \"kubernetes.io/projected/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-kube-api-access-m9w67\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.096576 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.096536    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-token\") pod \"e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") " pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.185864 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.185795    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:48.333667 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.333631    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bc75f4e-43ff-48bb-a5e3-f068d954e414" path="/var/lib/kubelet/pods/4bc75f4e-43ff-48bb-a5e3-f068d954e414/volumes"
Sep 09 15:38:48.334046 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.334032    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="667b1657-c9b3-470d-9426-515d01362a30" path="/var/lib/kubelet/pods/667b1657-c9b3-470d-9426-515d01362a30/volumes"
Sep 09 15:38:48.507255 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.504205    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"]
Sep 09 15:38:48.514027 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:38:48.513988    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d9187a3_3d98_43b2_9a15_02281bdb1c6d.slice/crio-1b2cdd679a74a81c021d2227616a12ccc4f02ada3e4269d08c57e3d3016e961f WatchSource:0}: Error finding container 1b2cdd679a74a81c021d2227616a12ccc4f02ada3e4269d08c57e3d3016e961f: Status 404 returned error can't find the container with id 1b2cdd679a74a81c021d2227616a12ccc4f02ada3e4269d08c57e3d3016e961f
Sep 09 15:38:48.516369 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.516321    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:38:48.516578 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.516557    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:38:48.516707 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.516690    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:38:48.629948 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.629910    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc" event={"ID":"2d9187a3-3d98-43b2-9a15-02281bdb1c6d","Type":"ContainerStarted","Data":"b228d6bdcf5999ad3b62af60f2d2cc54b578db9d0ea825254b32c34ffea8c1ee"}
Sep 09 15:38:48.630381 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.629971    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc" event={"ID":"2d9187a3-3d98-43b2-9a15-02281bdb1c6d","Type":"ContainerStarted","Data":"1b2cdd679a74a81c021d2227616a12ccc4f02ada3e4269d08c57e3d3016e961f"}
Sep 09 15:38:48.633641 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.633615    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt" event={"ID":"954e6e86-eb23-4e4c-ba0e-1a58a139d943","Type":"ContainerStarted","Data":"d963e3bb4cb22cc5f0aa7de196253923f49c087ee78f91c6fb4ac50704b57025"}
Sep 09 15:38:48.667540 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:48.667473    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc" podStartSLOduration=1.66745003 podStartE2EDuration="1.66745003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:38:48.666512394 +0000 UTC m=+1112.856715143" watchObservedRunningTime="2026-09-09 15:38:48.66745003 +0000 UTC m=+1112.857652782"
Sep 09 15:38:49.053521 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:49.053473    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:49.053725 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:49.053692    2574 patch_prober.go:28] interesting pod/e2e-inf-b-267962-openshift-default-5575947768-cngdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 09 15:38:49.053780 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:49.053742    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt" podUID="954e6e86-eb23-4e4c-ba0e-1a58a139d943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 09 15:38:49.186310 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:49.186276    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:49.191991 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:49.191969    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:49.642060 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:49.642024    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:49.643070 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:49.643047    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:38:50.053211 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:50.053172    2574 patch_prober.go:28] interesting pod/e2e-inf-b-267962-openshift-default-5575947768-cngdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 09 15:38:50.053399 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:50.053241    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt" podUID="954e6e86-eb23-4e4c-ba0e-1a58a139d943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 09 15:38:51.053650 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.053611    2574 patch_prober.go:28] interesting pod/e2e-inf-b-267962-openshift-default-5575947768-cngdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 09 15:38:51.054105 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.053668    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt" podUID="954e6e86-eb23-4e4c-ba0e-1a58a139d943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 09 15:38:51.221520 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.221480    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:38:51.636402 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.636372    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"]
Sep 09 15:38:51.640394 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.640370    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"
Sep 09 15:38:51.643251 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.643229    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-a7ffc761-dockercfg-sj489\""
Sep 09 15:38:51.643251 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.643242    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-a7ffc761\""
Sep 09 15:38:51.657003 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.656978    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"]
Sep 09 15:38:51.659575 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.659551    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"]
Sep 09 15:38:51.663070 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.663054    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"
Sep 09 15:38:51.728873 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.727702    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1942934c-336d-4f99-b773-bab3cb8e062d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p\" (UID: \"1942934c-336d-4f99-b773-bab3cb8e062d\") " pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"
Sep 09 15:38:51.728873 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.727754    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh76r\" (UniqueName: \"kubernetes.io/projected/33328140-c936-4ee4-84ee-bbd5d48276e2-kube-api-access-wh76r\") pod \"payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4\" (UID: \"33328140-c936-4ee4-84ee-bbd5d48276e2\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"
Sep 09 15:38:51.728873 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.727828    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vfnm\" (UniqueName: \"kubernetes.io/projected/1942934c-336d-4f99-b773-bab3cb8e062d-kube-api-access-6vfnm\") pod \"payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p\" (UID: \"1942934c-336d-4f99-b773-bab3cb8e062d\") " pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"
Sep 09 15:38:51.728873 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.728018    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33328140-c936-4ee4-84ee-bbd5d48276e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4\" (UID: \"33328140-c936-4ee4-84ee-bbd5d48276e2\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"
Sep 09 15:38:51.729813 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.729704    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"]
Sep 09 15:38:51.828942 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.828902    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33328140-c936-4ee4-84ee-bbd5d48276e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4\" (UID: \"33328140-c936-4ee4-84ee-bbd5d48276e2\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"
Sep 09 15:38:51.829068 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.829024    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1942934c-336d-4f99-b773-bab3cb8e062d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p\" (UID: \"1942934c-336d-4f99-b773-bab3cb8e062d\") " pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"
Sep 09 15:38:51.829068 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.829052    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh76r\" (UniqueName: \"kubernetes.io/projected/33328140-c936-4ee4-84ee-bbd5d48276e2-kube-api-access-wh76r\") pod \"payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4\" (UID: \"33328140-c936-4ee4-84ee-bbd5d48276e2\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"
Sep 09 15:38:51.829178 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.829076    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vfnm\" (UniqueName: \"kubernetes.io/projected/1942934c-336d-4f99-b773-bab3cb8e062d-kube-api-access-6vfnm\") pod \"payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p\" (UID: \"1942934c-336d-4f99-b773-bab3cb8e062d\") " pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"
Sep 09 15:38:51.829836 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.829809    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33328140-c936-4ee4-84ee-bbd5d48276e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4\" (UID: \"33328140-c936-4ee4-84ee-bbd5d48276e2\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"
Sep 09 15:38:51.829964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.829947    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1942934c-336d-4f99-b773-bab3cb8e062d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p\" (UID: \"1942934c-336d-4f99-b773-bab3cb8e062d\") " pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"
Sep 09 15:38:51.854465 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.854432    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vfnm\" (UniqueName: \"kubernetes.io/projected/1942934c-336d-4f99-b773-bab3cb8e062d-kube-api-access-6vfnm\") pod \"payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p\" (UID: \"1942934c-336d-4f99-b773-bab3cb8e062d\") " pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"
Sep 09 15:38:51.856402 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.856376    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh76r\" (UniqueName: \"kubernetes.io/projected/33328140-c936-4ee4-84ee-bbd5d48276e2-kube-api-access-wh76r\") pod \"payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4\" (UID: \"33328140-c936-4ee4-84ee-bbd5d48276e2\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"
Sep 09 15:38:51.951275 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.951240    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"
Sep 09 15:38:51.973368 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:51.973338    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"
Sep 09 15:38:52.053714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.053181    2574 patch_prober.go:28] interesting pod/e2e-inf-b-267962-openshift-default-5575947768-cngdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 09 15:38:52.053714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.053248    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt" podUID="954e6e86-eb23-4e4c-ba0e-1a58a139d943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 09 15:38:52.094790 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.094758    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:38:52.132362 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.131705    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-workload-certs\") pod \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") "
Sep 09 15:38:52.132362 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.131745    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-data\") pod \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") "
Sep 09 15:38:52.132362 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.131797    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-podinfo\") pod \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") "
Sep 09 15:38:52.132362 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.131832    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-workload-socket\") pod \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") "
Sep 09 15:38:52.132362 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.131902    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4wfc\" (UniqueName: \"kubernetes.io/projected/d5135d1d-80a3-424d-8ac7-519073e3cb3b-kube-api-access-d4wfc\") pod \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") "
Sep 09 15:38:52.132362 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.131957    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-credential-socket\") pod \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") "
Sep 09 15:38:52.132362 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.132005    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-token\") pod \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") "
Sep 09 15:38:52.132362 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.132035    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istiod-ca-cert\") pod \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") "
Sep 09 15:38:52.132362 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.132061    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-envoy\") pod \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\" (UID: \"d5135d1d-80a3-424d-8ac7-519073e3cb3b\") "
Sep 09 15:38:52.134622 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.134570    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d5135d1d-80a3-424d-8ac7-519073e3cb3b" (UID: "d5135d1d-80a3-424d-8ac7-519073e3cb3b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:38:52.134752 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.134660    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d5135d1d-80a3-424d-8ac7-519073e3cb3b" (UID: "d5135d1d-80a3-424d-8ac7-519073e3cb3b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:38:52.134752 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.134727    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d5135d1d-80a3-424d-8ac7-519073e3cb3b" (UID: "d5135d1d-80a3-424d-8ac7-519073e3cb3b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:38:52.134932 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.134779    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-data" (OuterVolumeSpecName: "istio-data") pod "d5135d1d-80a3-424d-8ac7-519073e3cb3b" (UID: "d5135d1d-80a3-424d-8ac7-519073e3cb3b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:38:52.135339 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.135163    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d5135d1d-80a3-424d-8ac7-519073e3cb3b" (UID: "d5135d1d-80a3-424d-8ac7-519073e3cb3b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:38:52.137591 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.137561    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d5135d1d-80a3-424d-8ac7-519073e3cb3b" (UID: "d5135d1d-80a3-424d-8ac7-519073e3cb3b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:38:52.138023 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.137996    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-token" (OuterVolumeSpecName: "istio-token") pod "d5135d1d-80a3-424d-8ac7-519073e3cb3b" (UID: "d5135d1d-80a3-424d-8ac7-519073e3cb3b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:38:52.138321 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.138271    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5135d1d-80a3-424d-8ac7-519073e3cb3b-kube-api-access-d4wfc" (OuterVolumeSpecName: "kube-api-access-d4wfc") pod "d5135d1d-80a3-424d-8ac7-519073e3cb3b" (UID: "d5135d1d-80a3-424d-8ac7-519073e3cb3b"). InnerVolumeSpecName "kube-api-access-d4wfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:38:52.138425 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.138386    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d5135d1d-80a3-424d-8ac7-519073e3cb3b" (UID: "d5135d1d-80a3-424d-8ac7-519073e3cb3b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 15:38:52.233473 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.233445    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istiod-ca-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:38:52.233473 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.233470    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-envoy\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:38:52.233473 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.233478    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-workload-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:38:52.233726 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.233486    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-data\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:38:52.233726 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.233494    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-podinfo\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:38:52.233726 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.233502    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-workload-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:38:52.233726 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.233510    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4wfc\" (UniqueName: \"kubernetes.io/projected/d5135d1d-80a3-424d-8ac7-519073e3cb3b-kube-api-access-d4wfc\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:38:52.233726 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.233518    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5135d1d-80a3-424d-8ac7-519073e3cb3b-credential-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:38:52.233726 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.233531    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5135d1d-80a3-424d-8ac7-519073e3cb3b-istio-token\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:38:52.279768 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.279740    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"]
Sep 09 15:38:52.281715 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:38:52.281685    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33328140_c936_4ee4_84ee_bbd5d48276e2.slice/crio-3c7a95d0c9978660e2496ba7e89d2203b8568af1a63bc28838d560b14016b270 WatchSource:0}: Error finding container 3c7a95d0c9978660e2496ba7e89d2203b8568af1a63bc28838d560b14016b270: Status 404 returned error can't find the container with id 3c7a95d0c9978660e2496ba7e89d2203b8568af1a63bc28838d560b14016b270
Sep 09 15:38:52.329044 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.329020    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"]
Sep 09 15:38:52.330766 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:38:52.330734    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1942934c_336d_4f99_b773_bab3cb8e062d.slice/crio-781cfb6f6a631d15297c5307bc8248c96c5c0fed96f902afb33b935b2e696aa1 WatchSource:0}: Error finding container 781cfb6f6a631d15297c5307bc8248c96c5c0fed96f902afb33b935b2e696aa1: Status 404 returned error can't find the container with id 781cfb6f6a631d15297c5307bc8248c96c5c0fed96f902afb33b935b2e696aa1
Sep 09 15:38:52.664498 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.664404    2574 generic.go:356] "Generic (PLEG): container finished" podID="d5135d1d-80a3-424d-8ac7-519073e3cb3b" containerID="3578dc49a2a6185fced6a6d5ddc42d2d80d0b186386414624fbd1b272a9a7f4b" exitCode=0
Sep 09 15:38:52.664498 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.664458    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"
Sep 09 15:38:52.664742 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.664490    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl" event={"ID":"d5135d1d-80a3-424d-8ac7-519073e3cb3b","Type":"ContainerDied","Data":"3578dc49a2a6185fced6a6d5ddc42d2d80d0b186386414624fbd1b272a9a7f4b"}
Sep 09 15:38:52.664742 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.664550    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl" event={"ID":"d5135d1d-80a3-424d-8ac7-519073e3cb3b","Type":"ContainerDied","Data":"97ef3d6f8c3bbd20b40f6f5e9d938b66a5a91583709171ca1d79bd9ef5b0f12e"}
Sep 09 15:38:52.664742 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.664582    2574 scope.go:117] "RemoveContainer" containerID="3578dc49a2a6185fced6a6d5ddc42d2d80d0b186386414624fbd1b272a9a7f4b"
Sep 09 15:38:52.666378 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.666353    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p" event={"ID":"1942934c-336d-4f99-b773-bab3cb8e062d","Type":"ContainerStarted","Data":"99f87f153ccfc80edc9eaa96ababbbadeb0ad9a9f6369edb34538bf35f11a3d4"}
Sep 09 15:38:52.666578 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.666556    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"
Sep 09 15:38:52.666701 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.666592    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p" event={"ID":"1942934c-336d-4f99-b773-bab3cb8e062d","Type":"ContainerStarted","Data":"781cfb6f6a631d15297c5307bc8248c96c5c0fed96f902afb33b935b2e696aa1"}
Sep 09 15:38:52.668309 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.668280    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4" event={"ID":"33328140-c936-4ee4-84ee-bbd5d48276e2","Type":"ContainerStarted","Data":"9c4f45514ba2d48120968dd9c126cfaeb1dc4707036ab2f0cd89f051a48c95f2"}
Sep 09 15:38:52.668428 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.668337    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4" event={"ID":"33328140-c936-4ee4-84ee-bbd5d48276e2","Type":"ContainerStarted","Data":"3c7a95d0c9978660e2496ba7e89d2203b8568af1a63bc28838d560b14016b270"}
Sep 09 15:38:52.668428 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.668403    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"
Sep 09 15:38:52.674791 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.674770    2574 scope.go:117] "RemoveContainer" containerID="58838445b1596d452c35881c090dd15522944163b0c7d0c3a9c4000317295ed6"
Sep 09 15:38:52.684184 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.684138    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p" podStartSLOduration=1.68411921 podStartE2EDuration="1.68411921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:38:52.683468108 +0000 UTC m=+1116.873670906" watchObservedRunningTime="2026-09-09 15:38:52.68411921 +0000 UTC m=+1116.874321972"
Sep 09 15:38:52.684287 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.684226    2574 scope.go:117] "RemoveContainer" containerID="3578dc49a2a6185fced6a6d5ddc42d2d80d0b186386414624fbd1b272a9a7f4b"
Sep 09 15:38:52.684593 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:38:52.684565    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3578dc49a2a6185fced6a6d5ddc42d2d80d0b186386414624fbd1b272a9a7f4b\": container with ID starting with 3578dc49a2a6185fced6a6d5ddc42d2d80d0b186386414624fbd1b272a9a7f4b not found: ID does not exist" containerID="3578dc49a2a6185fced6a6d5ddc42d2d80d0b186386414624fbd1b272a9a7f4b"
Sep 09 15:38:52.684648 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.684606    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3578dc49a2a6185fced6a6d5ddc42d2d80d0b186386414624fbd1b272a9a7f4b"} err="failed to get container status \"3578dc49a2a6185fced6a6d5ddc42d2d80d0b186386414624fbd1b272a9a7f4b\": rpc error: code = NotFound desc = could not find container \"3578dc49a2a6185fced6a6d5ddc42d2d80d0b186386414624fbd1b272a9a7f4b\": container with ID starting with 3578dc49a2a6185fced6a6d5ddc42d2d80d0b186386414624fbd1b272a9a7f4b not found: ID does not exist"
Sep 09 15:38:52.684648 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.684631    2574 scope.go:117] "RemoveContainer" containerID="58838445b1596d452c35881c090dd15522944163b0c7d0c3a9c4000317295ed6"
Sep 09 15:38:52.685001 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:38:52.684982    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58838445b1596d452c35881c090dd15522944163b0c7d0c3a9c4000317295ed6\": container with ID starting with 58838445b1596d452c35881c090dd15522944163b0c7d0c3a9c4000317295ed6 not found: ID does not exist" containerID="58838445b1596d452c35881c090dd15522944163b0c7d0c3a9c4000317295ed6"
Sep 09 15:38:52.685070 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.685006    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58838445b1596d452c35881c090dd15522944163b0c7d0c3a9c4000317295ed6"} err="failed to get container status \"58838445b1596d452c35881c090dd15522944163b0c7d0c3a9c4000317295ed6\": rpc error: code = NotFound desc = could not find container \"58838445b1596d452c35881c090dd15522944163b0c7d0c3a9c4000317295ed6\": container with ID starting with 58838445b1596d452c35881c090dd15522944163b0c7d0c3a9c4000317295ed6 not found: ID does not exist"
Sep 09 15:38:52.703113 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.703076    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"]
Sep 09 15:38:52.714062 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.714031    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1c76a304-openshift-default-7445958b94-4fmdl"]
Sep 09 15:38:52.731472 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:52.730020    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4" podStartSLOduration=1.729998497 podStartE2EDuration="1.729998497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:38:52.725805306 +0000 UTC m=+1116.916008078" watchObservedRunningTime="2026-09-09 15:38:52.729998497 +0000 UTC m=+1116.920201247"
Sep 09 15:38:53.053028 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:53.052988    2574 patch_prober.go:28] interesting pod/e2e-inf-b-267962-openshift-default-5575947768-cngdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 09 15:38:53.053285 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:53.053056    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt" podUID="954e6e86-eb23-4e4c-ba0e-1a58a139d943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 09 15:38:54.057196 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:54.057160    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:54.057613 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:54.057556    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:54.058344 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:54.058322    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:38:54.321395 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:38:54.321304    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5135d1d-80a3-424d-8ac7-519073e3cb3b" path="/var/lib/kubelet/pods/d5135d1d-80a3-424d-8ac7-519073e3cb3b/volumes"
Sep 09 15:39:03.680079 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:03.680001    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"
Sep 09 15:39:03.680571 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:03.680326    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"
Sep 09 15:39:06.602576 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:06.602532    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:39:09.783096 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:09.783061    2574 generic.go:356] "Generic (PLEG): container finished" podID="2d9187a3-3d98-43b2-9a15-02281bdb1c6d" containerID="b228d6bdcf5999ad3b62af60f2d2cc54b578db9d0ea825254b32c34ffea8c1ee" exitCode=0
Sep 09 15:39:09.783514 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:09.783095    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc" event={"ID":"2d9187a3-3d98-43b2-9a15-02281bdb1c6d","Type":"ContainerDied","Data":"b228d6bdcf5999ad3b62af60f2d2cc54b578db9d0ea825254b32c34ffea8c1ee"}
Sep 09 15:39:09.783655 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:09.783638    2574 scope.go:117] "RemoveContainer" containerID="b228d6bdcf5999ad3b62af60f2d2cc54b578db9d0ea825254b32c34ffea8c1ee"
Sep 09 15:39:09.784963 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:09.784935    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:39:09.785039 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:09.785011    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:39:09.785087 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:09.785042    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:39:10.791577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:10.791541    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc" event={"ID":"2d9187a3-3d98-43b2-9a15-02281bdb1c6d","Type":"ContainerStarted","Data":"0341dbec04c231d97f641197a9a1254695244ba95b4f17283a46e80d123da870"}
Sep 09 15:39:11.186665 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:11.186557    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:39:11.187068 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:11.187041    2574 patch_prober.go:28] interesting pod/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 09 15:39:11.187195 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:11.187099    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc" podUID="2d9187a3-3d98-43b2-9a15-02281bdb1c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 09 15:39:12.186685 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:12.186648    2574 patch_prober.go:28] interesting pod/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 09 15:39:12.187143 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:12.186716    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc" podUID="2d9187a3-3d98-43b2-9a15-02281bdb1c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 09 15:39:13.186498 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:13.186461    2574 patch_prober.go:28] interesting pod/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 09 15:39:13.186676 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:13.186556    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc" podUID="2d9187a3-3d98-43b2-9a15-02281bdb1c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 09 15:39:14.186612 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:14.186570    2574 patch_prober.go:28] interesting pod/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 09 15:39:14.187059 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:14.186629    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc" podUID="2d9187a3-3d98-43b2-9a15-02281bdb1c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 09 15:39:15.187214 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:15.187172    2574 patch_prober.go:28] interesting pod/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 09 15:39:15.187616 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:15.187246    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc" podUID="2d9187a3-3d98-43b2-9a15-02281bdb1c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 09 15:39:16.186682 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:16.186645    2574 patch_prober.go:28] interesting pod/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 09 15:39:16.186893 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:16.186703    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc" podUID="2d9187a3-3d98-43b2-9a15-02281bdb1c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 09 15:39:17.191259 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:17.191231    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:39:17.191702 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:17.191688    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:39:17.192543 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:17.192524    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:39:17.700349 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:17.700308    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:39:21.021694 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.021656    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"]
Sep 09 15:39:21.022601 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.022560    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p" podUID="1942934c-336d-4f99-b773-bab3cb8e062d" containerName="payload-processing" containerID="cri-o://99f87f153ccfc80edc9eaa96ababbbadeb0ad9a9f6369edb34538bf35f11a3d4" gracePeriod=30
Sep 09 15:39:21.029714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.029668    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"]
Sep 09 15:39:21.030569 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.030516    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4" podUID="33328140-c936-4ee4-84ee-bbd5d48276e2" containerName="payload-pre-processing" containerID="cri-o://9c4f45514ba2d48120968dd9c126cfaeb1dc4707036ab2f0cd89f051a48c95f2" gracePeriod=30
Sep 09 15:39:21.300128 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.299203    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"]
Sep 09 15:39:21.300128 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.299742    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc" podUID="2d9187a3-3d98-43b2-9a15-02281bdb1c6d" containerName="istio-proxy" containerID="cri-o://0341dbec04c231d97f641197a9a1254695244ba95b4f17283a46e80d123da870" gracePeriod=30
Sep 09 15:39:21.309212 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.309168    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"
Sep 09 15:39:21.338648 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.338621    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"
Sep 09 15:39:21.434441 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.434404    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33328140-c936-4ee4-84ee-bbd5d48276e2-plugins-config-volume\") pod \"33328140-c936-4ee4-84ee-bbd5d48276e2\" (UID: \"33328140-c936-4ee4-84ee-bbd5d48276e2\") "
Sep 09 15:39:21.434635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.434464    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1942934c-336d-4f99-b773-bab3cb8e062d-plugins-config-volume\") pod \"1942934c-336d-4f99-b773-bab3cb8e062d\" (UID: \"1942934c-336d-4f99-b773-bab3cb8e062d\") "
Sep 09 15:39:21.434635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.434537    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh76r\" (UniqueName: \"kubernetes.io/projected/33328140-c936-4ee4-84ee-bbd5d48276e2-kube-api-access-wh76r\") pod \"33328140-c936-4ee4-84ee-bbd5d48276e2\" (UID: \"33328140-c936-4ee4-84ee-bbd5d48276e2\") "
Sep 09 15:39:21.434635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.434554    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vfnm\" (UniqueName: \"kubernetes.io/projected/1942934c-336d-4f99-b773-bab3cb8e062d-kube-api-access-6vfnm\") pod \"1942934c-336d-4f99-b773-bab3cb8e062d\" (UID: \"1942934c-336d-4f99-b773-bab3cb8e062d\") "
Sep 09 15:39:21.434863 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.434798    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33328140-c936-4ee4-84ee-bbd5d48276e2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "33328140-c936-4ee4-84ee-bbd5d48276e2" (UID: "33328140-c936-4ee4-84ee-bbd5d48276e2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:39:21.434965 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.434942    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1942934c-336d-4f99-b773-bab3cb8e062d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1942934c-336d-4f99-b773-bab3cb8e062d" (UID: "1942934c-336d-4f99-b773-bab3cb8e062d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:39:21.436757 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.436735    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1942934c-336d-4f99-b773-bab3cb8e062d-kube-api-access-6vfnm" (OuterVolumeSpecName: "kube-api-access-6vfnm") pod "1942934c-336d-4f99-b773-bab3cb8e062d" (UID: "1942934c-336d-4f99-b773-bab3cb8e062d"). InnerVolumeSpecName "kube-api-access-6vfnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:39:21.436821 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.436768    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33328140-c936-4ee4-84ee-bbd5d48276e2-kube-api-access-wh76r" (OuterVolumeSpecName: "kube-api-access-wh76r") pod "33328140-c936-4ee4-84ee-bbd5d48276e2" (UID: "33328140-c936-4ee4-84ee-bbd5d48276e2"). InnerVolumeSpecName "kube-api-access-wh76r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:39:21.536136 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.536055    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33328140-c936-4ee4-84ee-bbd5d48276e2-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:21.536136 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.536083    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1942934c-336d-4f99-b773-bab3cb8e062d-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:21.536136 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.536092    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh76r\" (UniqueName: \"kubernetes.io/projected/33328140-c936-4ee4-84ee-bbd5d48276e2-kube-api-access-wh76r\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:21.536136 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.536101    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vfnm\" (UniqueName: \"kubernetes.io/projected/1942934c-336d-4f99-b773-bab3cb8e062d-kube-api-access-6vfnm\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:21.870444 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.870351    2574 generic.go:356] "Generic (PLEG): container finished" podID="33328140-c936-4ee4-84ee-bbd5d48276e2" containerID="9c4f45514ba2d48120968dd9c126cfaeb1dc4707036ab2f0cd89f051a48c95f2" exitCode=0
Sep 09 15:39:21.870444 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.870406    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"
Sep 09 15:39:21.870649 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.870438    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4" event={"ID":"33328140-c936-4ee4-84ee-bbd5d48276e2","Type":"ContainerDied","Data":"9c4f45514ba2d48120968dd9c126cfaeb1dc4707036ab2f0cd89f051a48c95f2"}
Sep 09 15:39:21.870649 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.870522    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4" event={"ID":"33328140-c936-4ee4-84ee-bbd5d48276e2","Type":"ContainerDied","Data":"3c7a95d0c9978660e2496ba7e89d2203b8568af1a63bc28838d560b14016b270"}
Sep 09 15:39:21.870649 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.870546    2574 scope.go:117] "RemoveContainer" containerID="9c4f45514ba2d48120968dd9c126cfaeb1dc4707036ab2f0cd89f051a48c95f2"
Sep 09 15:39:21.872085 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.872055    2574 generic.go:356] "Generic (PLEG): container finished" podID="1942934c-336d-4f99-b773-bab3cb8e062d" containerID="99f87f153ccfc80edc9eaa96ababbbadeb0ad9a9f6369edb34538bf35f11a3d4" exitCode=0
Sep 09 15:39:21.872223 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.872097    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p" event={"ID":"1942934c-336d-4f99-b773-bab3cb8e062d","Type":"ContainerDied","Data":"99f87f153ccfc80edc9eaa96ababbbadeb0ad9a9f6369edb34538bf35f11a3d4"}
Sep 09 15:39:21.872223 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.872121    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"
Sep 09 15:39:21.872223 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.872141    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p" event={"ID":"1942934c-336d-4f99-b773-bab3cb8e062d","Type":"ContainerDied","Data":"781cfb6f6a631d15297c5307bc8248c96c5c0fed96f902afb33b935b2e696aa1"}
Sep 09 15:39:21.882443 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.882286    2574 scope.go:117] "RemoveContainer" containerID="9c4f45514ba2d48120968dd9c126cfaeb1dc4707036ab2f0cd89f051a48c95f2"
Sep 09 15:39:21.882650 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:39:21.882625    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c4f45514ba2d48120968dd9c126cfaeb1dc4707036ab2f0cd89f051a48c95f2\": container with ID starting with 9c4f45514ba2d48120968dd9c126cfaeb1dc4707036ab2f0cd89f051a48c95f2 not found: ID does not exist" containerID="9c4f45514ba2d48120968dd9c126cfaeb1dc4707036ab2f0cd89f051a48c95f2"
Sep 09 15:39:21.882753 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.882659    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c4f45514ba2d48120968dd9c126cfaeb1dc4707036ab2f0cd89f051a48c95f2"} err="failed to get container status \"9c4f45514ba2d48120968dd9c126cfaeb1dc4707036ab2f0cd89f051a48c95f2\": rpc error: code = NotFound desc = could not find container \"9c4f45514ba2d48120968dd9c126cfaeb1dc4707036ab2f0cd89f051a48c95f2\": container with ID starting with 9c4f45514ba2d48120968dd9c126cfaeb1dc4707036ab2f0cd89f051a48c95f2 not found: ID does not exist"
Sep 09 15:39:21.882753 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.882677    2574 scope.go:117] "RemoveContainer" containerID="99f87f153ccfc80edc9eaa96ababbbadeb0ad9a9f6369edb34538bf35f11a3d4"
Sep 09 15:39:21.891347 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.891330    2574 scope.go:117] "RemoveContainer" containerID="99f87f153ccfc80edc9eaa96ababbbadeb0ad9a9f6369edb34538bf35f11a3d4"
Sep 09 15:39:21.891727 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:39:21.891626    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99f87f153ccfc80edc9eaa96ababbbadeb0ad9a9f6369edb34538bf35f11a3d4\": container with ID starting with 99f87f153ccfc80edc9eaa96ababbbadeb0ad9a9f6369edb34538bf35f11a3d4 not found: ID does not exist" containerID="99f87f153ccfc80edc9eaa96ababbbadeb0ad9a9f6369edb34538bf35f11a3d4"
Sep 09 15:39:21.891727 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.891658    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99f87f153ccfc80edc9eaa96ababbbadeb0ad9a9f6369edb34538bf35f11a3d4"} err="failed to get container status \"99f87f153ccfc80edc9eaa96ababbbadeb0ad9a9f6369edb34538bf35f11a3d4\": rpc error: code = NotFound desc = could not find container \"99f87f153ccfc80edc9eaa96ababbbadeb0ad9a9f6369edb34538bf35f11a3d4\": container with ID starting with 99f87f153ccfc80edc9eaa96ababbbadeb0ad9a9f6369edb34538bf35f11a3d4 not found: ID does not exist"
Sep 09 15:39:21.894992 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.894973    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"]
Sep 09 15:39:21.899961 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.899939    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a7ffc761-755f95c5d-lhfn4"]
Sep 09 15:39:21.909714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.909694    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"]
Sep 09 15:39:21.913727 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:21.913709    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a7ffc761-7d5f8765d-8cf2p"]
Sep 09 15:39:22.067064 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.067036    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"]
Sep 09 15:39:22.067468 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.067455    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33328140-c936-4ee4-84ee-bbd5d48276e2" containerName="payload-pre-processing"
Sep 09 15:39:22.067511 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.067469    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="33328140-c936-4ee4-84ee-bbd5d48276e2" containerName="payload-pre-processing"
Sep 09 15:39:22.067511 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.067484    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1942934c-336d-4f99-b773-bab3cb8e062d" containerName="payload-processing"
Sep 09 15:39:22.067511 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.067489    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1942934c-336d-4f99-b773-bab3cb8e062d" containerName="payload-processing"
Sep 09 15:39:22.067511 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.067498    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5135d1d-80a3-424d-8ac7-519073e3cb3b" containerName="istio-proxy"
Sep 09 15:39:22.067511 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.067504    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5135d1d-80a3-424d-8ac7-519073e3cb3b" containerName="istio-proxy"
Sep 09 15:39:22.067666 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.067516    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5135d1d-80a3-424d-8ac7-519073e3cb3b" containerName="istio-proxy"
Sep 09 15:39:22.067666 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.067521    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5135d1d-80a3-424d-8ac7-519073e3cb3b" containerName="istio-proxy"
Sep 09 15:39:22.067666 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.067586    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="33328140-c936-4ee4-84ee-bbd5d48276e2" containerName="payload-pre-processing"
Sep 09 15:39:22.067666 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.067595    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5135d1d-80a3-424d-8ac7-519073e3cb3b" containerName="istio-proxy"
Sep 09 15:39:22.067666 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.067604    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1942934c-336d-4f99-b773-bab3cb8e062d" containerName="payload-processing"
Sep 09 15:39:22.067666 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.067609    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5135d1d-80a3-424d-8ac7-519073e3cb3b" containerName="istio-proxy"
Sep 09 15:39:22.072241 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.072217    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.074961 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.074943    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f1fbd128-openshift-default-dockercfg-pgjtt\""
Sep 09 15:39:22.083431 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.083408    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"]
Sep 09 15:39:22.141561 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.141432    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-data\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.141561 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.141479    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-credential-socket\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.141561 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.141513    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-podinfo\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.141907 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.141646    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-envoy\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.141907 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.141711    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e615e38-3532-4ece-8366-ad9ad375bd4e-istiod-ca-cert\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.141907 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.141742    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bzn5\" (UniqueName: \"kubernetes.io/projected/4e615e38-3532-4ece-8366-ad9ad375bd4e-kube-api-access-9bzn5\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.141907 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.141789    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-token\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.141907 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.141893    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-workload-certs\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.142122 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.141955    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-workload-socket\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.242829 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.242788    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e615e38-3532-4ece-8366-ad9ad375bd4e-istiod-ca-cert\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.242829 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.242826    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bzn5\" (UniqueName: \"kubernetes.io/projected/4e615e38-3532-4ece-8366-ad9ad375bd4e-kube-api-access-9bzn5\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.243133 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.242882    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-token\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.243133 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.242923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-workload-certs\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.243133 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.242960    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-workload-socket\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.243133 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.242990    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-data\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.243133 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.243014    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-credential-socket\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.243133 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.243040    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-podinfo\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.243133 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.243094    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-envoy\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.243481 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.243410    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-workload-certs\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.243481 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.243455    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-data\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.243601 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.243476    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-workload-socket\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.243601 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.243510    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-credential-socket\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.244065 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.244040    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e615e38-3532-4ece-8366-ad9ad375bd4e-istiod-ca-cert\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.245620 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.245596    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-envoy\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.245868 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.245824    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-podinfo\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.251518 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.251495    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-token\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.251638 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.251621    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bzn5\" (UniqueName: \"kubernetes.io/projected/4e615e38-3532-4ece-8366-ad9ad375bd4e-kube-api-access-9bzn5\") pod \"e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") " pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.320820 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.320782    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1942934c-336d-4f99-b773-bab3cb8e062d" path="/var/lib/kubelet/pods/1942934c-336d-4f99-b773-bab3cb8e062d/volumes"
Sep 09 15:39:22.321261 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.321239    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33328140-c936-4ee4-84ee-bbd5d48276e2" path="/var/lib/kubelet/pods/33328140-c936-4ee4-84ee-bbd5d48276e2/volumes"
Sep 09 15:39:22.384823 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.384788    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:22.667553 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.667507    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"]
Sep 09 15:39:22.669991 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:39:22.669966    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e615e38_3532_4ece_8366_ad9ad375bd4e.slice/crio-8c723ad1ddd207916f2a14608de52a651599a2d0fbc1171ca6c86cdcff8c7af3 WatchSource:0}: Error finding container 8c723ad1ddd207916f2a14608de52a651599a2d0fbc1171ca6c86cdcff8c7af3: Status 404 returned error can't find the container with id 8c723ad1ddd207916f2a14608de52a651599a2d0fbc1171ca6c86cdcff8c7af3
Sep 09 15:39:22.672350 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.672318    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:39:22.672421 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.672384    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:39:22.672421 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.672415    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:39:22.881546 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.881507    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x" event={"ID":"4e615e38-3532-4ece-8366-ad9ad375bd4e","Type":"ContainerStarted","Data":"35e88614d88615f769ac9f5b56bc24f274ca8d28205ebcb928e978cadf984f26"}
Sep 09 15:39:22.881747 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.881576    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x" event={"ID":"4e615e38-3532-4ece-8366-ad9ad375bd4e","Type":"ContainerStarted","Data":"8c723ad1ddd207916f2a14608de52a651599a2d0fbc1171ca6c86cdcff8c7af3"}
Sep 09 15:39:22.903461 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:22.903399    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x" podStartSLOduration=0.903362318 podStartE2EDuration="903.362318ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:39:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:39:22.899465686 +0000 UTC m=+1147.089668456" watchObservedRunningTime="2026-09-09 15:39:22.903362318 +0000 UTC m=+1147.093565069"
Sep 09 15:39:23.385996 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:23.385956    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:23.391345 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:23.391316    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:23.889079 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:23.889046    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:23.890048 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:23.890027    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:26.038037 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.038001    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"]
Sep 09 15:39:26.041376 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.041357    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"
Sep 09 15:39:26.044999 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.044978    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-f1fbd128\""
Sep 09 15:39:26.045100 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.045025    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-f1fbd128-dockercfg-j8dmn\""
Sep 09 15:39:26.053582 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.053558    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"]
Sep 09 15:39:26.082722 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.082681    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"]
Sep 09 15:39:26.086392 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.086374    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"
Sep 09 15:39:26.096066 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.096037    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"]
Sep 09 15:39:26.194035 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.193997    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjtdl\" (UniqueName: \"kubernetes.io/projected/2c076d4a-7f15-4062-9170-0990ced375de-kube-api-access-qjtdl\") pod \"payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb\" (UID: \"2c076d4a-7f15-4062-9170-0990ced375de\") " pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"
Sep 09 15:39:26.194035 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.194038    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d551be88-44ee-4435-b18a-c7e2a488cc06-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88\" (UID: \"d551be88-44ee-4435-b18a-c7e2a488cc06\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"
Sep 09 15:39:26.194298 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.194119    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkpgc\" (UniqueName: \"kubernetes.io/projected/d551be88-44ee-4435-b18a-c7e2a488cc06-kube-api-access-vkpgc\") pod \"payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88\" (UID: \"d551be88-44ee-4435-b18a-c7e2a488cc06\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"
Sep 09 15:39:26.194298 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.194202    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c076d4a-7f15-4062-9170-0990ced375de-plugins-config-volume\") pod \"payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb\" (UID: \"2c076d4a-7f15-4062-9170-0990ced375de\") " pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"
Sep 09 15:39:26.295824 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.295737    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c076d4a-7f15-4062-9170-0990ced375de-plugins-config-volume\") pod \"payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb\" (UID: \"2c076d4a-7f15-4062-9170-0990ced375de\") " pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"
Sep 09 15:39:26.296012 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.295831    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjtdl\" (UniqueName: \"kubernetes.io/projected/2c076d4a-7f15-4062-9170-0990ced375de-kube-api-access-qjtdl\") pod \"payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb\" (UID: \"2c076d4a-7f15-4062-9170-0990ced375de\") " pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"
Sep 09 15:39:26.296012 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.295903    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d551be88-44ee-4435-b18a-c7e2a488cc06-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88\" (UID: \"d551be88-44ee-4435-b18a-c7e2a488cc06\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"
Sep 09 15:39:26.296012 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.295947    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkpgc\" (UniqueName: \"kubernetes.io/projected/d551be88-44ee-4435-b18a-c7e2a488cc06-kube-api-access-vkpgc\") pod \"payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88\" (UID: \"d551be88-44ee-4435-b18a-c7e2a488cc06\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"
Sep 09 15:39:26.296629 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.296609    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d551be88-44ee-4435-b18a-c7e2a488cc06-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88\" (UID: \"d551be88-44ee-4435-b18a-c7e2a488cc06\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"
Sep 09 15:39:26.296709 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.296686    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c076d4a-7f15-4062-9170-0990ced375de-plugins-config-volume\") pod \"payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb\" (UID: \"2c076d4a-7f15-4062-9170-0990ced375de\") " pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"
Sep 09 15:39:26.304897 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.304820    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkpgc\" (UniqueName: \"kubernetes.io/projected/d551be88-44ee-4435-b18a-c7e2a488cc06-kube-api-access-vkpgc\") pod \"payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88\" (UID: \"d551be88-44ee-4435-b18a-c7e2a488cc06\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"
Sep 09 15:39:26.304897 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.304820    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjtdl\" (UniqueName: \"kubernetes.io/projected/2c076d4a-7f15-4062-9170-0990ced375de-kube-api-access-qjtdl\") pod \"payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb\" (UID: \"2c076d4a-7f15-4062-9170-0990ced375de\") " pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"
Sep 09 15:39:26.354093 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.354055    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"
Sep 09 15:39:26.399336 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.399289    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"
Sep 09 15:39:26.592246 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.592219    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:39:26.635940 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.635917    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"]
Sep 09 15:39:26.636962 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:39:26.636939    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd551be88_44ee_4435_b18a_c7e2a488cc06.slice/crio-2881f390f378045c7f59d823dd33d3e6434f27f1f1d4d30d5f3473d5295fc3af WatchSource:0}: Error finding container 2881f390f378045c7f59d823dd33d3e6434f27f1f1d4d30d5f3473d5295fc3af: Status 404 returned error can't find the container with id 2881f390f378045c7f59d823dd33d3e6434f27f1f1d4d30d5f3473d5295fc3af
Sep 09 15:39:26.695657 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.695626    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"]
Sep 09 15:39:26.696627 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:39:26.696598    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c076d4a_7f15_4062_9170_0990ced375de.slice/crio-9f02756250b04d2b3ffa352e5b90ce80ddeb24157b04dd5769b245a99243bfd0 WatchSource:0}: Error finding container 9f02756250b04d2b3ffa352e5b90ce80ddeb24157b04dd5769b245a99243bfd0: Status 404 returned error can't find the container with id 9f02756250b04d2b3ffa352e5b90ce80ddeb24157b04dd5769b245a99243bfd0
Sep 09 15:39:26.699493 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.699462    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-credential-socket\") pod \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") "
Sep 09 15:39:26.699619 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.699530    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-workload-socket\") pod \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") "
Sep 09 15:39:26.699619 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.699566    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9w67\" (UniqueName: \"kubernetes.io/projected/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-kube-api-access-m9w67\") pod \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") "
Sep 09 15:39:26.699619 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.699610    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-workload-certs\") pod \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") "
Sep 09 15:39:26.699793 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.699644    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istiod-ca-cert\") pod \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") "
Sep 09 15:39:26.699793 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.699684    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-podinfo\") pod \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") "
Sep 09 15:39:26.699793 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.699731    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-data\") pod \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") "
Sep 09 15:39:26.699793 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.699779    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-token\") pod \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") "
Sep 09 15:39:26.700043 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.699819    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-envoy\") pod \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\" (UID: \"2d9187a3-3d98-43b2-9a15-02281bdb1c6d\") "
Sep 09 15:39:26.700043 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.699874    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d9187a3-3d98-43b2-9a15-02281bdb1c6d" (UID: "2d9187a3-3d98-43b2-9a15-02281bdb1c6d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:39:26.700043 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.699975    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d9187a3-3d98-43b2-9a15-02281bdb1c6d" (UID: "2d9187a3-3d98-43b2-9a15-02281bdb1c6d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:39:26.700209 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.700065    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d9187a3-3d98-43b2-9a15-02281bdb1c6d" (UID: "2d9187a3-3d98-43b2-9a15-02281bdb1c6d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:39:26.700209 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.700180    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-credential-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:26.700209 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.700198    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-workload-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:26.700363 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.700212    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-workload-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:26.701174 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.701017    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d9187a3-3d98-43b2-9a15-02281bdb1c6d" (UID: "2d9187a3-3d98-43b2-9a15-02281bdb1c6d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:39:26.701174 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.701134    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d9187a3-3d98-43b2-9a15-02281bdb1c6d" (UID: "2d9187a3-3d98-43b2-9a15-02281bdb1c6d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:39:26.702732 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.702705    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d9187a3-3d98-43b2-9a15-02281bdb1c6d" (UID: "2d9187a3-3d98-43b2-9a15-02281bdb1c6d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:39:26.703270 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.703248    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-kube-api-access-m9w67" (OuterVolumeSpecName: "kube-api-access-m9w67") pod "2d9187a3-3d98-43b2-9a15-02281bdb1c6d" (UID: "2d9187a3-3d98-43b2-9a15-02281bdb1c6d"). InnerVolumeSpecName "kube-api-access-m9w67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:39:26.703353 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.703253    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d9187a3-3d98-43b2-9a15-02281bdb1c6d" (UID: "2d9187a3-3d98-43b2-9a15-02281bdb1c6d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 15:39:26.703455 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.703436    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d9187a3-3d98-43b2-9a15-02281bdb1c6d" (UID: "2d9187a3-3d98-43b2-9a15-02281bdb1c6d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:39:26.801455 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.801405    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-data\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:26.801455 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.801440    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-token\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:26.801455 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.801452    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-envoy\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:26.801455 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.801462    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9w67\" (UniqueName: \"kubernetes.io/projected/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-kube-api-access-m9w67\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:26.801810 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.801471    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istiod-ca-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:26.801810 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.801480    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d9187a3-3d98-43b2-9a15-02281bdb1c6d-istio-podinfo\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:26.912001 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.911900    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb" event={"ID":"2c076d4a-7f15-4062-9170-0990ced375de","Type":"ContainerStarted","Data":"a4256d3c100c368360684fc0228969e2229fffa3f9a8c506781b494bc35dd80a"}
Sep 09 15:39:26.912001 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.911970    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb" event={"ID":"2c076d4a-7f15-4062-9170-0990ced375de","Type":"ContainerStarted","Data":"9f02756250b04d2b3ffa352e5b90ce80ddeb24157b04dd5769b245a99243bfd0"}
Sep 09 15:39:26.912244 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.912094    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"
Sep 09 15:39:26.914503 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.914471    2574 generic.go:356] "Generic (PLEG): container finished" podID="2d9187a3-3d98-43b2-9a15-02281bdb1c6d" containerID="0341dbec04c231d97f641197a9a1254695244ba95b4f17283a46e80d123da870" exitCode=0
Sep 09 15:39:26.914644 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.914521    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"
Sep 09 15:39:26.914644 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.914582    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc" event={"ID":"2d9187a3-3d98-43b2-9a15-02281bdb1c6d","Type":"ContainerDied","Data":"0341dbec04c231d97f641197a9a1254695244ba95b4f17283a46e80d123da870"}
Sep 09 15:39:26.914644 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.914635    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc" event={"ID":"2d9187a3-3d98-43b2-9a15-02281bdb1c6d","Type":"ContainerDied","Data":"1b2cdd679a74a81c021d2227616a12ccc4f02ada3e4269d08c57e3d3016e961f"}
Sep 09 15:39:26.914808 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.914666    2574 scope.go:117] "RemoveContainer" containerID="0341dbec04c231d97f641197a9a1254695244ba95b4f17283a46e80d123da870"
Sep 09 15:39:26.925456 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.925426    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88" event={"ID":"d551be88-44ee-4435-b18a-c7e2a488cc06","Type":"ContainerStarted","Data":"29abe4a3800b0381106ea5267e16d28dd6611ff493994d85c442111bef3a5e26"}
Sep 09 15:39:26.925589 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.925527    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88" event={"ID":"d551be88-44ee-4435-b18a-c7e2a488cc06","Type":"ContainerStarted","Data":"2881f390f378045c7f59d823dd33d3e6434f27f1f1d4d30d5f3473d5295fc3af"}
Sep 09 15:39:26.925656 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.925605    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"
Sep 09 15:39:26.933036 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.932994    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb" podStartSLOduration=0.932980315 podStartE2EDuration="932.980315ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:39:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:39:26.930383007 +0000 UTC m=+1151.120585777" watchObservedRunningTime="2026-09-09 15:39:26.932980315 +0000 UTC m=+1151.123183064"
Sep 09 15:39:26.937615 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.937593    2574 scope.go:117] "RemoveContainer" containerID="b228d6bdcf5999ad3b62af60f2d2cc54b578db9d0ea825254b32c34ffea8c1ee"
Sep 09 15:39:26.947983 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.947954    2574 scope.go:117] "RemoveContainer" containerID="0341dbec04c231d97f641197a9a1254695244ba95b4f17283a46e80d123da870"
Sep 09 15:39:26.948347 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:39:26.948326    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0341dbec04c231d97f641197a9a1254695244ba95b4f17283a46e80d123da870\": container with ID starting with 0341dbec04c231d97f641197a9a1254695244ba95b4f17283a46e80d123da870 not found: ID does not exist" containerID="0341dbec04c231d97f641197a9a1254695244ba95b4f17283a46e80d123da870"
Sep 09 15:39:26.948409 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.948356    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0341dbec04c231d97f641197a9a1254695244ba95b4f17283a46e80d123da870"} err="failed to get container status \"0341dbec04c231d97f641197a9a1254695244ba95b4f17283a46e80d123da870\": rpc error: code = NotFound desc = could not find container \"0341dbec04c231d97f641197a9a1254695244ba95b4f17283a46e80d123da870\": container with ID starting with 0341dbec04c231d97f641197a9a1254695244ba95b4f17283a46e80d123da870 not found: ID does not exist"
Sep 09 15:39:26.948409 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.948386    2574 scope.go:117] "RemoveContainer" containerID="b228d6bdcf5999ad3b62af60f2d2cc54b578db9d0ea825254b32c34ffea8c1ee"
Sep 09 15:39:26.948712 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:39:26.948686    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b228d6bdcf5999ad3b62af60f2d2cc54b578db9d0ea825254b32c34ffea8c1ee\": container with ID starting with b228d6bdcf5999ad3b62af60f2d2cc54b578db9d0ea825254b32c34ffea8c1ee not found: ID does not exist" containerID="b228d6bdcf5999ad3b62af60f2d2cc54b578db9d0ea825254b32c34ffea8c1ee"
Sep 09 15:39:26.948793 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.948717    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b228d6bdcf5999ad3b62af60f2d2cc54b578db9d0ea825254b32c34ffea8c1ee"} err="failed to get container status \"b228d6bdcf5999ad3b62af60f2d2cc54b578db9d0ea825254b32c34ffea8c1ee\": rpc error: code = NotFound desc = could not find container \"b228d6bdcf5999ad3b62af60f2d2cc54b578db9d0ea825254b32c34ffea8c1ee\": container with ID starting with b228d6bdcf5999ad3b62af60f2d2cc54b578db9d0ea825254b32c34ffea8c1ee not found: ID does not exist"
Sep 09 15:39:26.949539 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.949478    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88" podStartSLOduration=0.949459686 podStartE2EDuration="949.459686ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:39:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:39:26.946621465 +0000 UTC m=+1151.136824236" watchObservedRunningTime="2026-09-09 15:39:26.949459686 +0000 UTC m=+1151.139662442"
Sep 09 15:39:26.964892 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.964867    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"]
Sep 09 15:39:26.968591 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:26.968568    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-a7ffc761-gw-openshift-default-78795b87b-sjzzc"]
Sep 09 15:39:28.322023 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:28.321991    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d9187a3-3d98-43b2-9a15-02281bdb1c6d" path="/var/lib/kubelet/pods/2d9187a3-3d98-43b2-9a15-02281bdb1c6d/volumes"
Sep 09 15:39:36.405228 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:36.405193    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:39:37.936755 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:37.936666    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"
Sep 09 15:39:37.936755 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:37.936755    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"
Sep 09 15:39:47.071204 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:47.071103    2574 generic.go:356] "Generic (PLEG): container finished" podID="4e615e38-3532-4ece-8366-ad9ad375bd4e" containerID="35e88614d88615f769ac9f5b56bc24f274ca8d28205ebcb928e978cadf984f26" exitCode=0
Sep 09 15:39:47.071204 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:47.071178    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x" event={"ID":"4e615e38-3532-4ece-8366-ad9ad375bd4e","Type":"ContainerDied","Data":"35e88614d88615f769ac9f5b56bc24f274ca8d28205ebcb928e978cadf984f26"}
Sep 09 15:39:47.071747 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:47.071731    2574 scope.go:117] "RemoveContainer" containerID="35e88614d88615f769ac9f5b56bc24f274ca8d28205ebcb928e978cadf984f26"
Sep 09 15:39:47.073194 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:47.073159    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:39:47.073261 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:47.073237    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:39:47.073297 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:47.073271    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:39:48.079539 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:48.079498    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x" event={"ID":"4e615e38-3532-4ece-8366-ad9ad375bd4e","Type":"ContainerStarted","Data":"19f1c51e0e266088566d99bf079e43031560d405af7b0d6de68eb00c869f176b"}
Sep 09 15:39:48.385373 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:48.385272    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:48.385552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:48.385477    2574 patch_prober.go:28] interesting pod/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 09 15:39:48.385552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:48.385521    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x" podUID="4e615e38-3532-4ece-8366-ad9ad375bd4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 09 15:39:49.386044 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:49.386000    2574 patch_prober.go:28] interesting pod/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 09 15:39:49.386435 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:49.386064    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x" podUID="4e615e38-3532-4ece-8366-ad9ad375bd4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 09 15:39:50.386107 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:50.386069    2574 patch_prober.go:28] interesting pod/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 09 15:39:50.386496 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:50.386133    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x" podUID="4e615e38-3532-4ece-8366-ad9ad375bd4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 09 15:39:51.386155 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:51.386115    2574 patch_prober.go:28] interesting pod/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 09 15:39:51.386552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:51.386172    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x" podUID="4e615e38-3532-4ece-8366-ad9ad375bd4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 09 15:39:52.194875 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:52.194831    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:39:52.385390 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:52.385350    2574 patch_prober.go:28] interesting pod/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 09 15:39:52.385589 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:52.385420    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x" podUID="4e615e38-3532-4ece-8366-ad9ad375bd4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 09 15:39:53.389892 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:53.389833    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:53.390281 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:53.390146    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:53.390957 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:53.390941    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:39:56.011476 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.011441    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"]
Sep 09 15:39:56.012434 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.012373    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb" podUID="2c076d4a-7f15-4062-9170-0990ced375de" containerName="payload-processing" containerID="cri-o://a4256d3c100c368360684fc0228969e2229fffa3f9a8c506781b494bc35dd80a" gracePeriod=30
Sep 09 15:39:56.014905 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.014879    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"]
Sep 09 15:39:56.015107 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.015070    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88" podUID="d551be88-44ee-4435-b18a-c7e2a488cc06" containerName="payload-pre-processing" containerID="cri-o://29abe4a3800b0381106ea5267e16d28dd6611ff493994d85c442111bef3a5e26" gracePeriod=30
Sep 09 15:39:56.138437 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.138401    2574 generic.go:356] "Generic (PLEG): container finished" podID="2c076d4a-7f15-4062-9170-0990ced375de" containerID="a4256d3c100c368360684fc0228969e2229fffa3f9a8c506781b494bc35dd80a" exitCode=0
Sep 09 15:39:56.138572 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.138452    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb" event={"ID":"2c076d4a-7f15-4062-9170-0990ced375de","Type":"ContainerDied","Data":"a4256d3c100c368360684fc0228969e2229fffa3f9a8c506781b494bc35dd80a"}
Sep 09 15:39:56.140386 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.140360    2574 generic.go:356] "Generic (PLEG): container finished" podID="d551be88-44ee-4435-b18a-c7e2a488cc06" containerID="29abe4a3800b0381106ea5267e16d28dd6611ff493994d85c442111bef3a5e26" exitCode=0
Sep 09 15:39:56.140513 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.140435    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88" event={"ID":"d551be88-44ee-4435-b18a-c7e2a488cc06","Type":"ContainerDied","Data":"29abe4a3800b0381106ea5267e16d28dd6611ff493994d85c442111bef3a5e26"}
Sep 09 15:39:56.283890 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.283807    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"
Sep 09 15:39:56.318049 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.318017    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"
Sep 09 15:39:56.413007 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.412969    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjtdl\" (UniqueName: \"kubernetes.io/projected/2c076d4a-7f15-4062-9170-0990ced375de-kube-api-access-qjtdl\") pod \"2c076d4a-7f15-4062-9170-0990ced375de\" (UID: \"2c076d4a-7f15-4062-9170-0990ced375de\") "
Sep 09 15:39:56.413007 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.413033    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d551be88-44ee-4435-b18a-c7e2a488cc06-plugins-config-volume\") pod \"d551be88-44ee-4435-b18a-c7e2a488cc06\" (UID: \"d551be88-44ee-4435-b18a-c7e2a488cc06\") "
Sep 09 15:39:56.413320 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.413081    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c076d4a-7f15-4062-9170-0990ced375de-plugins-config-volume\") pod \"2c076d4a-7f15-4062-9170-0990ced375de\" (UID: \"2c076d4a-7f15-4062-9170-0990ced375de\") "
Sep 09 15:39:56.413320 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.413137    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkpgc\" (UniqueName: \"kubernetes.io/projected/d551be88-44ee-4435-b18a-c7e2a488cc06-kube-api-access-vkpgc\") pod \"d551be88-44ee-4435-b18a-c7e2a488cc06\" (UID: \"d551be88-44ee-4435-b18a-c7e2a488cc06\") "
Sep 09 15:39:56.413572 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.413541    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d551be88-44ee-4435-b18a-c7e2a488cc06-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d551be88-44ee-4435-b18a-c7e2a488cc06" (UID: "d551be88-44ee-4435-b18a-c7e2a488cc06"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:39:56.413909 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.413881    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c076d4a-7f15-4062-9170-0990ced375de-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2c076d4a-7f15-4062-9170-0990ced375de" (UID: "2c076d4a-7f15-4062-9170-0990ced375de"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:39:56.415573 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.415550    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d551be88-44ee-4435-b18a-c7e2a488cc06-kube-api-access-vkpgc" (OuterVolumeSpecName: "kube-api-access-vkpgc") pod "d551be88-44ee-4435-b18a-c7e2a488cc06" (UID: "d551be88-44ee-4435-b18a-c7e2a488cc06"). InnerVolumeSpecName "kube-api-access-vkpgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:39:56.415700 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.415618    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c076d4a-7f15-4062-9170-0990ced375de-kube-api-access-qjtdl" (OuterVolumeSpecName: "kube-api-access-qjtdl") pod "2c076d4a-7f15-4062-9170-0990ced375de" (UID: "2c076d4a-7f15-4062-9170-0990ced375de"). InnerVolumeSpecName "kube-api-access-qjtdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:39:56.514450 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.514408    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkpgc\" (UniqueName: \"kubernetes.io/projected/d551be88-44ee-4435-b18a-c7e2a488cc06-kube-api-access-vkpgc\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:56.514450 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.514443    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjtdl\" (UniqueName: \"kubernetes.io/projected/2c076d4a-7f15-4062-9170-0990ced375de-kube-api-access-qjtdl\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:56.514450 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.514453    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d551be88-44ee-4435-b18a-c7e2a488cc06-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:56.514692 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:56.514462    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c076d4a-7f15-4062-9170-0990ced375de-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:39:57.147569 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:57.147538    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"
Sep 09 15:39:57.148015 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:57.147580    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb" event={"ID":"2c076d4a-7f15-4062-9170-0990ced375de","Type":"ContainerDied","Data":"9f02756250b04d2b3ffa352e5b90ce80ddeb24157b04dd5769b245a99243bfd0"}
Sep 09 15:39:57.148015 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:57.147654    2574 scope.go:117] "RemoveContainer" containerID="a4256d3c100c368360684fc0228969e2229fffa3f9a8c506781b494bc35dd80a"
Sep 09 15:39:57.149135 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:57.149043    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"
Sep 09 15:39:57.149135 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:57.149072    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88" event={"ID":"d551be88-44ee-4435-b18a-c7e2a488cc06","Type":"ContainerDied","Data":"2881f390f378045c7f59d823dd33d3e6434f27f1f1d4d30d5f3473d5295fc3af"}
Sep 09 15:39:57.157638 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:57.157620    2574 scope.go:117] "RemoveContainer" containerID="29abe4a3800b0381106ea5267e16d28dd6611ff493994d85c442111bef3a5e26"
Sep 09 15:39:57.173696 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:57.173665    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"]
Sep 09 15:39:57.183514 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:57.183488    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f1fbd128-7b5c95fb94-6jb88"]
Sep 09 15:39:57.193985 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:57.193962    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"]
Sep 09 15:39:57.197802 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:57.197775    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f1fbd128-6f76d7759-zd2hb"]
Sep 09 15:39:57.354323 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:57.354240    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"]
Sep 09 15:39:57.354501 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:57.354475    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x" podUID="4e615e38-3532-4ece-8366-ad9ad375bd4e" containerName="istio-proxy" containerID="cri-o://19f1c51e0e266088566d99bf079e43031560d405af7b0d6de68eb00c869f176b" gracePeriod=30
Sep 09 15:39:58.135752 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.135718    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"]
Sep 09 15:39:58.136409 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.136393    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d9187a3-3d98-43b2-9a15-02281bdb1c6d" containerName="istio-proxy"
Sep 09 15:39:58.136475 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.136415    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d9187a3-3d98-43b2-9a15-02281bdb1c6d" containerName="istio-proxy"
Sep 09 15:39:58.136475 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.136429    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d551be88-44ee-4435-b18a-c7e2a488cc06" containerName="payload-pre-processing"
Sep 09 15:39:58.136475 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.136438    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d551be88-44ee-4435-b18a-c7e2a488cc06" containerName="payload-pre-processing"
Sep 09 15:39:58.136475 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.136457    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c076d4a-7f15-4062-9170-0990ced375de" containerName="payload-processing"
Sep 09 15:39:58.136475 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.136466    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c076d4a-7f15-4062-9170-0990ced375de" containerName="payload-processing"
Sep 09 15:39:58.136696 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.136481    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d9187a3-3d98-43b2-9a15-02281bdb1c6d" containerName="istio-proxy"
Sep 09 15:39:58.136696 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.136492    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d9187a3-3d98-43b2-9a15-02281bdb1c6d" containerName="istio-proxy"
Sep 09 15:39:58.136696 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.136623    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d9187a3-3d98-43b2-9a15-02281bdb1c6d" containerName="istio-proxy"
Sep 09 15:39:58.136696 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.136636    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d9187a3-3d98-43b2-9a15-02281bdb1c6d" containerName="istio-proxy"
Sep 09 15:39:58.136696 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.136648    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d551be88-44ee-4435-b18a-c7e2a488cc06" containerName="payload-pre-processing"
Sep 09 15:39:58.136696 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.136657    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c076d4a-7f15-4062-9170-0990ced375de" containerName="payload-processing"
Sep 09 15:39:58.141477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.141456    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.144103 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.144082    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-c348b0d2-openshift-default-dockercfg-8vvqx\""
Sep 09 15:39:58.149965 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.149715    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"]
Sep 09 15:39:58.233285 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.233250    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83630355-2f01-4232-a814-b8b88de63efe-istiod-ca-cert\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.233468 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.233303    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-credential-socket\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.233468 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.233337    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83630355-2f01-4232-a814-b8b88de63efe-istio-podinfo\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.233468 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.233372    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-istio-data\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.233468 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.233401    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83630355-2f01-4232-a814-b8b88de63efe-istio-token\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.233682 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.233502    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chh9k\" (UniqueName: \"kubernetes.io/projected/83630355-2f01-4232-a814-b8b88de63efe-kube-api-access-chh9k\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.233682 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.233564    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-istio-envoy\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.233682 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.233613    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-workload-socket\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.233682 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.233658    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-workload-certs\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.321392 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.321356    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c076d4a-7f15-4062-9170-0990ced375de" path="/var/lib/kubelet/pods/2c076d4a-7f15-4062-9170-0990ced375de/volumes"
Sep 09 15:39:58.321763 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.321748    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d551be88-44ee-4435-b18a-c7e2a488cc06" path="/var/lib/kubelet/pods/d551be88-44ee-4435-b18a-c7e2a488cc06/volumes"
Sep 09 15:39:58.334758 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.334723    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83630355-2f01-4232-a814-b8b88de63efe-istiod-ca-cert\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.334969 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.334764    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-credential-socket\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.334969 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.334784    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83630355-2f01-4232-a814-b8b88de63efe-istio-podinfo\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.334969 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.334803    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-istio-data\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.334969 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.334877    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83630355-2f01-4232-a814-b8b88de63efe-istio-token\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.334969 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.334923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chh9k\" (UniqueName: \"kubernetes.io/projected/83630355-2f01-4232-a814-b8b88de63efe-kube-api-access-chh9k\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.334969 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.334968    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-istio-envoy\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.335319 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.335010    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-workload-socket\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.335319 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.335044    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-workload-certs\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.335319 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.335251    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-istio-data\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.335503 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.335369    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-workload-certs\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.335503 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.335463    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-workload-socket\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.335612 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.335569    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83630355-2f01-4232-a814-b8b88de63efe-istiod-ca-cert\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.335663 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.335621    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-credential-socket\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.337400 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.337368    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-istio-envoy\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.337761 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.337744    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83630355-2f01-4232-a814-b8b88de63efe-istio-podinfo\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.343629 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.343604    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83630355-2f01-4232-a814-b8b88de63efe-istio-token\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.343730 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.343712    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chh9k\" (UniqueName: \"kubernetes.io/projected/83630355-2f01-4232-a814-b8b88de63efe-kube-api-access-chh9k\") pod \"e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") " pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.454108 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.454070    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:58.739860 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.739805    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"]
Sep 09 15:39:58.740659 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:39:58.740621    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83630355_2f01_4232_a814_b8b88de63efe.slice/crio-c46253fea8964bfd08501557fbfc5d3dfa56f45373bc8f59a298360b5acb2acf WatchSource:0}: Error finding container c46253fea8964bfd08501557fbfc5d3dfa56f45373bc8f59a298360b5acb2acf: Status 404 returned error can't find the container with id c46253fea8964bfd08501557fbfc5d3dfa56f45373bc8f59a298360b5acb2acf
Sep 09 15:39:58.743249 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.743179    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:39:58.743389 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.743295    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:39:58.743389 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:58.743359    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:39:59.166270 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:59.166165    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l" event={"ID":"83630355-2f01-4232-a814-b8b88de63efe","Type":"ContainerStarted","Data":"a9dcf141d7c3c14be6b5cbcfe465e8551ec95eb9866e0bd0b3bafcb77755a729"}
Sep 09 15:39:59.166270 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:59.166233    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l" event={"ID":"83630355-2f01-4232-a814-b8b88de63efe","Type":"ContainerStarted","Data":"c46253fea8964bfd08501557fbfc5d3dfa56f45373bc8f59a298360b5acb2acf"}
Sep 09 15:39:59.187797 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:59.187741    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l" podStartSLOduration=1.187725402 podStartE2EDuration="1.187725402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:39:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:39:59.184938225 +0000 UTC m=+1183.375140996" watchObservedRunningTime="2026-09-09 15:39:59.187725402 +0000 UTC m=+1183.377928238"
Sep 09 15:39:59.454657 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:59.454626    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:39:59.460095 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:39:59.460068    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:40:00.171922 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:00.171888    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:40:00.172830 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:00.172807    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:40:01.638187 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.638152    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"]
Sep 09 15:40:01.642191 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.642166    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:01.644837 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.644814    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-c348b0d2-serving-cert\""
Sep 09 15:40:01.651816 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.651790    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"]
Sep 09 15:40:01.771133 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.771093    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6a55012-fd12-4376-947d-3a77e01d47db-openshift-service-ca\") pod \"maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd\" (UID: \"e6a55012-fd12-4376-947d-3a77e01d47db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:01.771305 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.771136    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6a55012-fd12-4376-947d-3a77e01d47db-metrics-certs\") pod \"maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd\" (UID: \"e6a55012-fd12-4376-947d-3a77e01d47db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:01.771305 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.771258    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6a55012-fd12-4376-947d-3a77e01d47db-maas-api-tls\") pod \"maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd\" (UID: \"e6a55012-fd12-4376-947d-3a77e01d47db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:01.771305 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.771292    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rjrf\" (UniqueName: \"kubernetes.io/projected/e6a55012-fd12-4376-947d-3a77e01d47db-kube-api-access-5rjrf\") pod \"maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd\" (UID: \"e6a55012-fd12-4376-947d-3a77e01d47db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:01.872495 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.872453    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6a55012-fd12-4376-947d-3a77e01d47db-openshift-service-ca\") pod \"maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd\" (UID: \"e6a55012-fd12-4376-947d-3a77e01d47db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:01.872495 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.872492    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6a55012-fd12-4376-947d-3a77e01d47db-metrics-certs\") pod \"maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd\" (UID: \"e6a55012-fd12-4376-947d-3a77e01d47db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:01.872791 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.872539    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6a55012-fd12-4376-947d-3a77e01d47db-maas-api-tls\") pod \"maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd\" (UID: \"e6a55012-fd12-4376-947d-3a77e01d47db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:01.872791 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.872568    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rjrf\" (UniqueName: \"kubernetes.io/projected/e6a55012-fd12-4376-947d-3a77e01d47db-kube-api-access-5rjrf\") pod \"maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd\" (UID: \"e6a55012-fd12-4376-947d-3a77e01d47db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:01.873201 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.873177    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6a55012-fd12-4376-947d-3a77e01d47db-openshift-service-ca\") pod \"maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd\" (UID: \"e6a55012-fd12-4376-947d-3a77e01d47db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:01.875299 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.875278    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6a55012-fd12-4376-947d-3a77e01d47db-maas-api-tls\") pod \"maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd\" (UID: \"e6a55012-fd12-4376-947d-3a77e01d47db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:01.875413 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.875313    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6a55012-fd12-4376-947d-3a77e01d47db-metrics-certs\") pod \"maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd\" (UID: \"e6a55012-fd12-4376-947d-3a77e01d47db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:01.880416 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.880393    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rjrf\" (UniqueName: \"kubernetes.io/projected/e6a55012-fd12-4376-947d-3a77e01d47db-kube-api-access-5rjrf\") pod \"maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd\" (UID: \"e6a55012-fd12-4376-947d-3a77e01d47db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:01.956929 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:01.956881    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:02.236587 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.236554    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"]
Sep 09 15:40:02.238146 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:40:02.238114    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a55012_fd12_4376_947d_3a77e01d47db.slice/crio-ea659d031801ad878363944d7c5b937f604198a89aab93a33daf45e972eaa8fe WatchSource:0}: Error finding container ea659d031801ad878363944d7c5b937f604198a89aab93a33daf45e972eaa8fe: Status 404 returned error can't find the container with id ea659d031801ad878363944d7c5b937f604198a89aab93a33daf45e972eaa8fe
Sep 09 15:40:02.262361 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.262329    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"]
Sep 09 15:40:02.267133 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.267109    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"
Sep 09 15:40:02.269658 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.269633    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-c348b0d2-dockercfg-l7hbd\""
Sep 09 15:40:02.269819 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.269802    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-c348b0d2\""
Sep 09 15:40:02.274396 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.274367    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"]
Sep 09 15:40:02.376825 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.376788    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9316eaae-10b4-4fdc-b365-3f130d44a880-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg\" (UID: \"9316eaae-10b4-4fdc-b365-3f130d44a880\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"
Sep 09 15:40:02.376988 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.376894    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xshm8\" (UniqueName: \"kubernetes.io/projected/9316eaae-10b4-4fdc-b365-3f130d44a880-kube-api-access-xshm8\") pod \"payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg\" (UID: \"9316eaae-10b4-4fdc-b365-3f130d44a880\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"
Sep 09 15:40:02.478027 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.477996    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xshm8\" (UniqueName: \"kubernetes.io/projected/9316eaae-10b4-4fdc-b365-3f130d44a880-kube-api-access-xshm8\") pod \"payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg\" (UID: \"9316eaae-10b4-4fdc-b365-3f130d44a880\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"
Sep 09 15:40:02.478168 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.478152    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9316eaae-10b4-4fdc-b365-3f130d44a880-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg\" (UID: \"9316eaae-10b4-4fdc-b365-3f130d44a880\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"
Sep 09 15:40:02.478786 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.478758    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9316eaae-10b4-4fdc-b365-3f130d44a880-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg\" (UID: \"9316eaae-10b4-4fdc-b365-3f130d44a880\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"
Sep 09 15:40:02.486148 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.486093    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xshm8\" (UniqueName: \"kubernetes.io/projected/9316eaae-10b4-4fdc-b365-3f130d44a880-kube-api-access-xshm8\") pod \"payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg\" (UID: \"9316eaae-10b4-4fdc-b365-3f130d44a880\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"
Sep 09 15:40:02.580338 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.580302    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"
Sep 09 15:40:02.614643 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.614613    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:40:02.781889 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.781793    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-envoy\") pod \"4e615e38-3532-4ece-8366-ad9ad375bd4e\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") "
Sep 09 15:40:02.781889 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.781874    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e615e38-3532-4ece-8366-ad9ad375bd4e-istiod-ca-cert\") pod \"4e615e38-3532-4ece-8366-ad9ad375bd4e\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") "
Sep 09 15:40:02.782385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.781917    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bzn5\" (UniqueName: \"kubernetes.io/projected/4e615e38-3532-4ece-8366-ad9ad375bd4e-kube-api-access-9bzn5\") pod \"4e615e38-3532-4ece-8366-ad9ad375bd4e\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") "
Sep 09 15:40:02.782385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.781968    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-workload-certs\") pod \"4e615e38-3532-4ece-8366-ad9ad375bd4e\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") "
Sep 09 15:40:02.782385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.782097    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-token\") pod \"4e615e38-3532-4ece-8366-ad9ad375bd4e\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") "
Sep 09 15:40:02.782385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.782154    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-podinfo\") pod \"4e615e38-3532-4ece-8366-ad9ad375bd4e\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") "
Sep 09 15:40:02.782385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.782163    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4e615e38-3532-4ece-8366-ad9ad375bd4e" (UID: "4e615e38-3532-4ece-8366-ad9ad375bd4e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:40:02.782385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.782208    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-data\") pod \"4e615e38-3532-4ece-8366-ad9ad375bd4e\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") "
Sep 09 15:40:02.782385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.782250    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-workload-socket\") pod \"4e615e38-3532-4ece-8366-ad9ad375bd4e\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") "
Sep 09 15:40:02.782385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.782301    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e615e38-3532-4ece-8366-ad9ad375bd4e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4e615e38-3532-4ece-8366-ad9ad375bd4e" (UID: "4e615e38-3532-4ece-8366-ad9ad375bd4e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:40:02.782385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.782346    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-credential-socket\") pod \"4e615e38-3532-4ece-8366-ad9ad375bd4e\" (UID: \"4e615e38-3532-4ece-8366-ad9ad375bd4e\") "
Sep 09 15:40:02.783051 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.782473    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-data" (OuterVolumeSpecName: "istio-data") pod "4e615e38-3532-4ece-8366-ad9ad375bd4e" (UID: "4e615e38-3532-4ece-8366-ad9ad375bd4e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:40:02.783051 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.782536    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4e615e38-3532-4ece-8366-ad9ad375bd4e" (UID: "4e615e38-3532-4ece-8366-ad9ad375bd4e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:40:02.783051 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.782610    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4e615e38-3532-4ece-8366-ad9ad375bd4e" (UID: "4e615e38-3532-4ece-8366-ad9ad375bd4e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:40:02.783051 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.782961    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-workload-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:02.783051 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.782981    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-data\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:02.783051 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.782993    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-workload-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:02.783051 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.783008    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-credential-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:02.783051 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.783021    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e615e38-3532-4ece-8366-ad9ad375bd4e-istiod-ca-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:02.784337 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.784308    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4e615e38-3532-4ece-8366-ad9ad375bd4e" (UID: "4e615e38-3532-4ece-8366-ad9ad375bd4e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:40:02.784456 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.784421    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4e615e38-3532-4ece-8366-ad9ad375bd4e" (UID: "4e615e38-3532-4ece-8366-ad9ad375bd4e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 15:40:02.784456 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.784421    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e615e38-3532-4ece-8366-ad9ad375bd4e-kube-api-access-9bzn5" (OuterVolumeSpecName: "kube-api-access-9bzn5") pod "4e615e38-3532-4ece-8366-ad9ad375bd4e" (UID: "4e615e38-3532-4ece-8366-ad9ad375bd4e"). InnerVolumeSpecName "kube-api-access-9bzn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:40:02.784676 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.784658    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-token" (OuterVolumeSpecName: "istio-token") pod "4e615e38-3532-4ece-8366-ad9ad375bd4e" (UID: "4e615e38-3532-4ece-8366-ad9ad375bd4e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:40:02.868174 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.868143    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"]
Sep 09 15:40:02.869714 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:40:02.869691    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9316eaae_10b4_4fdc_b365_3f130d44a880.slice/crio-2936f655a6990fe76492a418fc0da3031cc9d8113a760e31304a3dd1a297cfb1 WatchSource:0}: Error finding container 2936f655a6990fe76492a418fc0da3031cc9d8113a760e31304a3dd1a297cfb1: Status 404 returned error can't find the container with id 2936f655a6990fe76492a418fc0da3031cc9d8113a760e31304a3dd1a297cfb1
Sep 09 15:40:02.883874 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.883823    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-envoy\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:02.883874 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.883874    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bzn5\" (UniqueName: \"kubernetes.io/projected/4e615e38-3532-4ece-8366-ad9ad375bd4e-kube-api-access-9bzn5\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:02.884046 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.883888    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-token\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:02.884046 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:02.883903    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e615e38-3532-4ece-8366-ad9ad375bd4e-istio-podinfo\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:03.191007 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.190972    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd" event={"ID":"e6a55012-fd12-4376-947d-3a77e01d47db","Type":"ContainerStarted","Data":"ea659d031801ad878363944d7c5b937f604198a89aab93a33daf45e972eaa8fe"}
Sep 09 15:40:03.192718 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.192688    2574 generic.go:356] "Generic (PLEG): container finished" podID="4e615e38-3532-4ece-8366-ad9ad375bd4e" containerID="19f1c51e0e266088566d99bf079e43031560d405af7b0d6de68eb00c869f176b" exitCode=0
Sep 09 15:40:03.192862 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.192737    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"
Sep 09 15:40:03.192862 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.192768    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x" event={"ID":"4e615e38-3532-4ece-8366-ad9ad375bd4e","Type":"ContainerDied","Data":"19f1c51e0e266088566d99bf079e43031560d405af7b0d6de68eb00c869f176b"}
Sep 09 15:40:03.192862 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.192825    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x" event={"ID":"4e615e38-3532-4ece-8366-ad9ad375bd4e","Type":"ContainerDied","Data":"8c723ad1ddd207916f2a14608de52a651599a2d0fbc1171ca6c86cdcff8c7af3"}
Sep 09 15:40:03.193053 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.192876    2574 scope.go:117] "RemoveContainer" containerID="19f1c51e0e266088566d99bf079e43031560d405af7b0d6de68eb00c869f176b"
Sep 09 15:40:03.194775 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.194752    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg" event={"ID":"9316eaae-10b4-4fdc-b365-3f130d44a880","Type":"ContainerStarted","Data":"6b157f7726006997b0bd4c0b7c137c34dea2adb608a822b052c8e88236ab94c4"}
Sep 09 15:40:03.194912 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.194813    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"
Sep 09 15:40:03.194912 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.194865    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg" event={"ID":"9316eaae-10b4-4fdc-b365-3f130d44a880","Type":"ContainerStarted","Data":"2936f655a6990fe76492a418fc0da3031cc9d8113a760e31304a3dd1a297cfb1"}
Sep 09 15:40:03.204405 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.204388    2574 scope.go:117] "RemoveContainer" containerID="35e88614d88615f769ac9f5b56bc24f274ca8d28205ebcb928e978cadf984f26"
Sep 09 15:40:03.212187 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.212125    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg" podStartSLOduration=1.212107224 podStartE2EDuration="1.212107224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:40:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:40:03.211470039 +0000 UTC m=+1187.401672811" watchObservedRunningTime="2026-09-09 15:40:03.212107224 +0000 UTC m=+1187.402309975"
Sep 09 15:40:03.220405 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.220387    2574 scope.go:117] "RemoveContainer" containerID="19f1c51e0e266088566d99bf079e43031560d405af7b0d6de68eb00c869f176b"
Sep 09 15:40:03.220749 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:40:03.220725    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19f1c51e0e266088566d99bf079e43031560d405af7b0d6de68eb00c869f176b\": container with ID starting with 19f1c51e0e266088566d99bf079e43031560d405af7b0d6de68eb00c869f176b not found: ID does not exist" containerID="19f1c51e0e266088566d99bf079e43031560d405af7b0d6de68eb00c869f176b"
Sep 09 15:40:03.220804 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.220761    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f1c51e0e266088566d99bf079e43031560d405af7b0d6de68eb00c869f176b"} err="failed to get container status \"19f1c51e0e266088566d99bf079e43031560d405af7b0d6de68eb00c869f176b\": rpc error: code = NotFound desc = could not find container \"19f1c51e0e266088566d99bf079e43031560d405af7b0d6de68eb00c869f176b\": container with ID starting with 19f1c51e0e266088566d99bf079e43031560d405af7b0d6de68eb00c869f176b not found: ID does not exist"
Sep 09 15:40:03.220804 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.220789    2574 scope.go:117] "RemoveContainer" containerID="35e88614d88615f769ac9f5b56bc24f274ca8d28205ebcb928e978cadf984f26"
Sep 09 15:40:03.221114 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:40:03.221093    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35e88614d88615f769ac9f5b56bc24f274ca8d28205ebcb928e978cadf984f26\": container with ID starting with 35e88614d88615f769ac9f5b56bc24f274ca8d28205ebcb928e978cadf984f26 not found: ID does not exist" containerID="35e88614d88615f769ac9f5b56bc24f274ca8d28205ebcb928e978cadf984f26"
Sep 09 15:40:03.221174 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.221121    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35e88614d88615f769ac9f5b56bc24f274ca8d28205ebcb928e978cadf984f26"} err="failed to get container status \"35e88614d88615f769ac9f5b56bc24f274ca8d28205ebcb928e978cadf984f26\": rpc error: code = NotFound desc = could not find container \"35e88614d88615f769ac9f5b56bc24f274ca8d28205ebcb928e978cadf984f26\": container with ID starting with 35e88614d88615f769ac9f5b56bc24f274ca8d28205ebcb928e978cadf984f26 not found: ID does not exist"
Sep 09 15:40:03.227779 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.227751    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"]
Sep 09 15:40:03.231158 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:03.231137    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f1fbd128-openshift-default-5b59c598dd-xzq4x"]
Sep 09 15:40:04.202711 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:04.202671    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd" event={"ID":"e6a55012-fd12-4376-947d-3a77e01d47db","Type":"ContainerStarted","Data":"34fd24a0f69157f8959ab256f45d0c9a26f7653a8dca8459f79a364afc74fd7b"}
Sep 09 15:40:04.203196 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:04.202808    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:04.219530 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:04.219479    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd" podStartSLOduration=1.961555347 podStartE2EDuration="3.21946346s" totalImagesPullingTime="1.257908113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:40:04.217857757 +0000 UTC m=+1188.408060523" watchObservedRunningTime="2026-09-09 15:40:04.21946346 +0000 UTC m=+1188.409666208"
Sep 09 15:40:04.321007 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:04.320965    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e615e38-3532-4ece-8366-ad9ad375bd4e" path="/var/lib/kubelet/pods/4e615e38-3532-4ece-8366-ad9ad375bd4e/volumes"
Sep 09 15:40:10.217201 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:10.217169    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:12.354818 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:12.354777    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:40:14.206973 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:14.206937    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"
Sep 09 15:40:19.360205 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:19.360173    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"]
Sep 09 15:40:19.360774 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:19.360747    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl" podUID="fcccb715-2e54-455c-ae1c-6a231998896b" containerName="payload-pre-processing" containerID="cri-o://b5fd126051300a4511f2b009700b9fab10a5387e25d59b39ac1bc9cf0ec82796" gracePeriod=30
Sep 09 15:40:19.662172 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:19.662141    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"
Sep 09 15:40:19.778752 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:19.778716    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcccb715-2e54-455c-ae1c-6a231998896b-plugins-config-volume\") pod \"fcccb715-2e54-455c-ae1c-6a231998896b\" (UID: \"fcccb715-2e54-455c-ae1c-6a231998896b\") "
Sep 09 15:40:19.778752 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:19.778760    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jfdv\" (UniqueName: \"kubernetes.io/projected/fcccb715-2e54-455c-ae1c-6a231998896b-kube-api-access-6jfdv\") pod \"fcccb715-2e54-455c-ae1c-6a231998896b\" (UID: \"fcccb715-2e54-455c-ae1c-6a231998896b\") "
Sep 09 15:40:19.779181 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:19.779154    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcccb715-2e54-455c-ae1c-6a231998896b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fcccb715-2e54-455c-ae1c-6a231998896b" (UID: "fcccb715-2e54-455c-ae1c-6a231998896b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:40:19.781215 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:19.781195    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcccb715-2e54-455c-ae1c-6a231998896b-kube-api-access-6jfdv" (OuterVolumeSpecName: "kube-api-access-6jfdv") pod "fcccb715-2e54-455c-ae1c-6a231998896b" (UID: "fcccb715-2e54-455c-ae1c-6a231998896b"). InnerVolumeSpecName "kube-api-access-6jfdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:40:19.879760 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:19.879723    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcccb715-2e54-455c-ae1c-6a231998896b-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:19.879760 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:19.879754    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jfdv\" (UniqueName: \"kubernetes.io/projected/fcccb715-2e54-455c-ae1c-6a231998896b-kube-api-access-6jfdv\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:20.342895 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:20.342832    2574 generic.go:356] "Generic (PLEG): container finished" podID="fcccb715-2e54-455c-ae1c-6a231998896b" containerID="b5fd126051300a4511f2b009700b9fab10a5387e25d59b39ac1bc9cf0ec82796" exitCode=0
Sep 09 15:40:20.342895 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:20.342872    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl" event={"ID":"fcccb715-2e54-455c-ae1c-6a231998896b","Type":"ContainerDied","Data":"b5fd126051300a4511f2b009700b9fab10a5387e25d59b39ac1bc9cf0ec82796"}
Sep 09 15:40:20.343113 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:20.342906    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"
Sep 09 15:40:20.343113 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:20.342928    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl" event={"ID":"fcccb715-2e54-455c-ae1c-6a231998896b","Type":"ContainerDied","Data":"f0bcfb14fe71d5fa46f479f1c5353433d7fdd25ea79b05e7470db18de3e2fc62"}
Sep 09 15:40:20.343113 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:20.342953    2574 scope.go:117] "RemoveContainer" containerID="b5fd126051300a4511f2b009700b9fab10a5387e25d59b39ac1bc9cf0ec82796"
Sep 09 15:40:20.352440 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:20.352420    2574 scope.go:117] "RemoveContainer" containerID="b5fd126051300a4511f2b009700b9fab10a5387e25d59b39ac1bc9cf0ec82796"
Sep 09 15:40:20.352833 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:40:20.352802    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5fd126051300a4511f2b009700b9fab10a5387e25d59b39ac1bc9cf0ec82796\": container with ID starting with b5fd126051300a4511f2b009700b9fab10a5387e25d59b39ac1bc9cf0ec82796 not found: ID does not exist" containerID="b5fd126051300a4511f2b009700b9fab10a5387e25d59b39ac1bc9cf0ec82796"
Sep 09 15:40:20.353030 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:20.352864    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5fd126051300a4511f2b009700b9fab10a5387e25d59b39ac1bc9cf0ec82796"} err="failed to get container status \"b5fd126051300a4511f2b009700b9fab10a5387e25d59b39ac1bc9cf0ec82796\": rpc error: code = NotFound desc = could not find container \"b5fd126051300a4511f2b009700b9fab10a5387e25d59b39ac1bc9cf0ec82796\": container with ID starting with b5fd126051300a4511f2b009700b9fab10a5387e25d59b39ac1bc9cf0ec82796 not found: ID does not exist"
Sep 09 15:40:20.368381 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:20.368353    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"]
Sep 09 15:40:20.372062 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:20.372036    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-8a43b2-85fbb45d8b-b4jpl"]
Sep 09 15:40:22.321289 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:22.321252    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcccb715-2e54-455c-ae1c-6a231998896b" path="/var/lib/kubelet/pods/fcccb715-2e54-455c-ae1c-6a231998896b/volumes"
Sep 09 15:40:23.365007 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:23.364971    2574 generic.go:356] "Generic (PLEG): container finished" podID="83630355-2f01-4232-a814-b8b88de63efe" containerID="a9dcf141d7c3c14be6b5cbcfe465e8551ec95eb9866e0bd0b3bafcb77755a729" exitCode=0
Sep 09 15:40:23.365442 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:23.365041    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l" event={"ID":"83630355-2f01-4232-a814-b8b88de63efe","Type":"ContainerDied","Data":"a9dcf141d7c3c14be6b5cbcfe465e8551ec95eb9866e0bd0b3bafcb77755a729"}
Sep 09 15:40:23.365488 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:23.365478    2574 scope.go:117] "RemoveContainer" containerID="a9dcf141d7c3c14be6b5cbcfe465e8551ec95eb9866e0bd0b3bafcb77755a729"
Sep 09 15:40:23.366663 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:23.366631    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:40:23.366751 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:23.366702    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:40:23.366751 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:23.366739    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:40:24.373304 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:24.373262    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l" event={"ID":"83630355-2f01-4232-a814-b8b88de63efe","Type":"ContainerStarted","Data":"90bc7ef4e051043899bc7f4da6bbc5d4b9a10b01cba6fccef896edbdc18c985e"}
Sep 09 15:40:24.454926 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:24.454883    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:40:24.455168 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:24.455146    2574 patch_prober.go:28] interesting pod/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 09 15:40:24.455218 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:24.455196    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l" podUID="83630355-2f01-4232-a814-b8b88de63efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 09 15:40:25.455282 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:25.455246    2574 patch_prober.go:28] interesting pod/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 09 15:40:25.455643 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:25.455321    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l" podUID="83630355-2f01-4232-a814-b8b88de63efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 09 15:40:26.454429 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:26.454398    2574 patch_prober.go:28] interesting pod/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 09 15:40:26.454599 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:26.454448    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l" podUID="83630355-2f01-4232-a814-b8b88de63efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 09 15:40:27.455336 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:27.455297    2574 patch_prober.go:28] interesting pod/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 09 15:40:27.455756 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:27.455362    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l" podUID="83630355-2f01-4232-a814-b8b88de63efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 09 15:40:27.921796 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:27.921693    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:40:28.454695 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:28.454656    2574 patch_prober.go:28] interesting pod/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 09 15:40:28.454950 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:28.454723    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l" podUID="83630355-2f01-4232-a814-b8b88de63efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 09 15:40:29.476065 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:29.476030    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:40:29.476586 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:29.476308    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:40:29.477130 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:29.477110    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:40:32.170398 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.170363    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"]
Sep 09 15:40:32.170899 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.170761    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd" podUID="e6a55012-fd12-4376-947d-3a77e01d47db" containerName="maas-api" containerID="cri-o://34fd24a0f69157f8959ab256f45d0c9a26f7653a8dca8459f79a364afc74fd7b" gracePeriod=30
Sep 09 15:40:32.239274 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.239236    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"]
Sep 09 15:40:32.239750 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.239718    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg" podUID="9316eaae-10b4-4fdc-b365-3f130d44a880" containerName="payload-pre-processing" containerID="cri-o://6b157f7726006997b0bd4c0b7c137c34dea2adb608a822b052c8e88236ab94c4" gracePeriod=30
Sep 09 15:40:32.456209 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.456171    2574 generic.go:356] "Generic (PLEG): container finished" podID="9316eaae-10b4-4fdc-b365-3f130d44a880" containerID="6b157f7726006997b0bd4c0b7c137c34dea2adb608a822b052c8e88236ab94c4" exitCode=0
Sep 09 15:40:32.456404 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.456380    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg" event={"ID":"9316eaae-10b4-4fdc-b365-3f130d44a880","Type":"ContainerDied","Data":"6b157f7726006997b0bd4c0b7c137c34dea2adb608a822b052c8e88236ab94c4"}
Sep 09 15:40:32.459049 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.459022    2574 generic.go:356] "Generic (PLEG): container finished" podID="e6a55012-fd12-4376-947d-3a77e01d47db" containerID="34fd24a0f69157f8959ab256f45d0c9a26f7653a8dca8459f79a364afc74fd7b" exitCode=0
Sep 09 15:40:32.460041 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.459082    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd" event={"ID":"e6a55012-fd12-4376-947d-3a77e01d47db","Type":"ContainerDied","Data":"34fd24a0f69157f8959ab256f45d0c9a26f7653a8dca8459f79a364afc74fd7b"}
Sep 09 15:40:32.533403 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.533367    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:32.542285 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.542260    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"]
Sep 09 15:40:32.542661 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.542633    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l" podUID="83630355-2f01-4232-a814-b8b88de63efe" containerName="istio-proxy" containerID="cri-o://90bc7ef4e051043899bc7f4da6bbc5d4b9a10b01cba6fccef896edbdc18c985e" gracePeriod=30
Sep 09 15:40:32.548394 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.548321    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"
Sep 09 15:40:32.618734 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.618697    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6a55012-fd12-4376-947d-3a77e01d47db-metrics-certs\") pod \"e6a55012-fd12-4376-947d-3a77e01d47db\" (UID: \"e6a55012-fd12-4376-947d-3a77e01d47db\") "
Sep 09 15:40:32.618955 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.618755    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6a55012-fd12-4376-947d-3a77e01d47db-maas-api-tls\") pod \"e6a55012-fd12-4376-947d-3a77e01d47db\" (UID: \"e6a55012-fd12-4376-947d-3a77e01d47db\") "
Sep 09 15:40:32.618955 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.618800    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xshm8\" (UniqueName: \"kubernetes.io/projected/9316eaae-10b4-4fdc-b365-3f130d44a880-kube-api-access-xshm8\") pod \"9316eaae-10b4-4fdc-b365-3f130d44a880\" (UID: \"9316eaae-10b4-4fdc-b365-3f130d44a880\") "
Sep 09 15:40:32.618955 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.618838    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9316eaae-10b4-4fdc-b365-3f130d44a880-plugins-config-volume\") pod \"9316eaae-10b4-4fdc-b365-3f130d44a880\" (UID: \"9316eaae-10b4-4fdc-b365-3f130d44a880\") "
Sep 09 15:40:32.618955 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.618901    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rjrf\" (UniqueName: \"kubernetes.io/projected/e6a55012-fd12-4376-947d-3a77e01d47db-kube-api-access-5rjrf\") pod \"e6a55012-fd12-4376-947d-3a77e01d47db\" (UID: \"e6a55012-fd12-4376-947d-3a77e01d47db\") "
Sep 09 15:40:32.618955 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.618948    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6a55012-fd12-4376-947d-3a77e01d47db-openshift-service-ca\") pod \"e6a55012-fd12-4376-947d-3a77e01d47db\" (UID: \"e6a55012-fd12-4376-947d-3a77e01d47db\") "
Sep 09 15:40:32.619496 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.619466    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9316eaae-10b4-4fdc-b365-3f130d44a880-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9316eaae-10b4-4fdc-b365-3f130d44a880" (UID: "9316eaae-10b4-4fdc-b365-3f130d44a880"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:40:32.619730 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.619500    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6a55012-fd12-4376-947d-3a77e01d47db-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e6a55012-fd12-4376-947d-3a77e01d47db" (UID: "e6a55012-fd12-4376-947d-3a77e01d47db"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:40:32.621485 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.621449    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6a55012-fd12-4376-947d-3a77e01d47db-kube-api-access-5rjrf" (OuterVolumeSpecName: "kube-api-access-5rjrf") pod "e6a55012-fd12-4376-947d-3a77e01d47db" (UID: "e6a55012-fd12-4376-947d-3a77e01d47db"). InnerVolumeSpecName "kube-api-access-5rjrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:40:32.621579 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.621562    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6a55012-fd12-4376-947d-3a77e01d47db-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e6a55012-fd12-4376-947d-3a77e01d47db" (UID: "e6a55012-fd12-4376-947d-3a77e01d47db"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:40:32.621765 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.621741    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6a55012-fd12-4376-947d-3a77e01d47db-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e6a55012-fd12-4376-947d-3a77e01d47db" (UID: "e6a55012-fd12-4376-947d-3a77e01d47db"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:40:32.621931 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.621903    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9316eaae-10b4-4fdc-b365-3f130d44a880-kube-api-access-xshm8" (OuterVolumeSpecName: "kube-api-access-xshm8") pod "9316eaae-10b4-4fdc-b365-3f130d44a880" (UID: "9316eaae-10b4-4fdc-b365-3f130d44a880"). InnerVolumeSpecName "kube-api-access-xshm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:40:32.720146 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.720106    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9316eaae-10b4-4fdc-b365-3f130d44a880-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:32.720146 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.720139    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rjrf\" (UniqueName: \"kubernetes.io/projected/e6a55012-fd12-4376-947d-3a77e01d47db-kube-api-access-5rjrf\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:32.720146 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.720152    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6a55012-fd12-4376-947d-3a77e01d47db-openshift-service-ca\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:32.720393 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.720165    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6a55012-fd12-4376-947d-3a77e01d47db-metrics-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:32.720393 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.720176    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6a55012-fd12-4376-947d-3a77e01d47db-maas-api-tls\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:32.720393 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:32.720187    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xshm8\" (UniqueName: \"kubernetes.io/projected/9316eaae-10b4-4fdc-b365-3f130d44a880-kube-api-access-xshm8\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:33.466781 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:33.466753    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"
Sep 09 15:40:33.467281 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:33.466784    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd" event={"ID":"e6a55012-fd12-4376-947d-3a77e01d47db","Type":"ContainerDied","Data":"ea659d031801ad878363944d7c5b937f604198a89aab93a33daf45e972eaa8fe"}
Sep 09 15:40:33.467281 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:33.466868    2574 scope.go:117] "RemoveContainer" containerID="34fd24a0f69157f8959ab256f45d0c9a26f7653a8dca8459f79a364afc74fd7b"
Sep 09 15:40:33.468632 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:33.468612    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"
Sep 09 15:40:33.468754 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:33.468649    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg" event={"ID":"9316eaae-10b4-4fdc-b365-3f130d44a880","Type":"ContainerDied","Data":"2936f655a6990fe76492a418fc0da3031cc9d8113a760e31304a3dd1a297cfb1"}
Sep 09 15:40:33.477776 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:33.477757    2574 scope.go:117] "RemoveContainer" containerID="6b157f7726006997b0bd4c0b7c137c34dea2adb608a822b052c8e88236ab94c4"
Sep 09 15:40:33.493269 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:33.493242    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"]
Sep 09 15:40:33.497514 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:33.497484    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c348b0d2-5d56c5f46b-7q5gd"]
Sep 09 15:40:33.510820 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:33.510782    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"]
Sep 09 15:40:33.518352 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:33.518327    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c348b0d2-6f5df84c4b-589gg"]
Sep 09 15:40:34.320721 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:34.320689    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9316eaae-10b4-4fdc-b365-3f130d44a880" path="/var/lib/kubelet/pods/9316eaae-10b4-4fdc-b365-3f130d44a880/volumes"
Sep 09 15:40:34.321183 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:34.321167    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6a55012-fd12-4376-947d-3a77e01d47db" path="/var/lib/kubelet/pods/e6a55012-fd12-4376-947d-3a77e01d47db/volumes"
Sep 09 15:40:37.906938 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:37.906913    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:40:38.075235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.075140    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83630355-2f01-4232-a814-b8b88de63efe-istiod-ca-cert\") pod \"83630355-2f01-4232-a814-b8b88de63efe\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") "
Sep 09 15:40:38.075235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.075188    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83630355-2f01-4232-a814-b8b88de63efe-istio-podinfo\") pod \"83630355-2f01-4232-a814-b8b88de63efe\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") "
Sep 09 15:40:38.075235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.075216    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-workload-socket\") pod \"83630355-2f01-4232-a814-b8b88de63efe\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") "
Sep 09 15:40:38.075520 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.075239    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-istio-data\") pod \"83630355-2f01-4232-a814-b8b88de63efe\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") "
Sep 09 15:40:38.075520 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.075269    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83630355-2f01-4232-a814-b8b88de63efe-istio-token\") pod \"83630355-2f01-4232-a814-b8b88de63efe\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") "
Sep 09 15:40:38.075520 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.075327    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-workload-certs\") pod \"83630355-2f01-4232-a814-b8b88de63efe\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") "
Sep 09 15:40:38.075520 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.075424    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chh9k\" (UniqueName: \"kubernetes.io/projected/83630355-2f01-4232-a814-b8b88de63efe-kube-api-access-chh9k\") pod \"83630355-2f01-4232-a814-b8b88de63efe\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") "
Sep 09 15:40:38.075520 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.075476    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-credential-socket\") pod \"83630355-2f01-4232-a814-b8b88de63efe\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") "
Sep 09 15:40:38.075520 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.075503    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-istio-envoy\") pod \"83630355-2f01-4232-a814-b8b88de63efe\" (UID: \"83630355-2f01-4232-a814-b8b88de63efe\") "
Sep 09 15:40:38.075874 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.075547    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83630355-2f01-4232-a814-b8b88de63efe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "83630355-2f01-4232-a814-b8b88de63efe" (UID: "83630355-2f01-4232-a814-b8b88de63efe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:40:38.075952 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.075926    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83630355-2f01-4232-a814-b8b88de63efe-istiod-ca-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:38.076029 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.075564    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "83630355-2f01-4232-a814-b8b88de63efe" (UID: "83630355-2f01-4232-a814-b8b88de63efe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:40:38.076252 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.076218    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "83630355-2f01-4232-a814-b8b88de63efe" (UID: "83630355-2f01-4232-a814-b8b88de63efe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:40:38.076316 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.076296    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "83630355-2f01-4232-a814-b8b88de63efe" (UID: "83630355-2f01-4232-a814-b8b88de63efe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:40:38.076375 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.076312    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-istio-data" (OuterVolumeSpecName: "istio-data") pod "83630355-2f01-4232-a814-b8b88de63efe" (UID: "83630355-2f01-4232-a814-b8b88de63efe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:40:38.078286 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.078250    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83630355-2f01-4232-a814-b8b88de63efe-istio-token" (OuterVolumeSpecName: "istio-token") pod "83630355-2f01-4232-a814-b8b88de63efe" (UID: "83630355-2f01-4232-a814-b8b88de63efe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:40:38.078286 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.078250    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/83630355-2f01-4232-a814-b8b88de63efe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "83630355-2f01-4232-a814-b8b88de63efe" (UID: "83630355-2f01-4232-a814-b8b88de63efe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 15:40:38.078554 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.078528    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83630355-2f01-4232-a814-b8b88de63efe-kube-api-access-chh9k" (OuterVolumeSpecName: "kube-api-access-chh9k") pod "83630355-2f01-4232-a814-b8b88de63efe" (UID: "83630355-2f01-4232-a814-b8b88de63efe"). InnerVolumeSpecName "kube-api-access-chh9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:40:38.078621 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.078599    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "83630355-2f01-4232-a814-b8b88de63efe" (UID: "83630355-2f01-4232-a814-b8b88de63efe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:40:38.176882 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.176822    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-credential-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:38.176882 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.176876    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-istio-envoy\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:38.176882 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.176887    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83630355-2f01-4232-a814-b8b88de63efe-istio-podinfo\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:38.177113 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.176894    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-workload-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:38.177113 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.176904    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-istio-data\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:38.177113 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.176912    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83630355-2f01-4232-a814-b8b88de63efe-istio-token\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:38.177113 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.176920    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83630355-2f01-4232-a814-b8b88de63efe-workload-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:38.177113 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.176928    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chh9k\" (UniqueName: \"kubernetes.io/projected/83630355-2f01-4232-a814-b8b88de63efe-kube-api-access-chh9k\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:40:38.504570 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.504536    2574 generic.go:356] "Generic (PLEG): container finished" podID="83630355-2f01-4232-a814-b8b88de63efe" containerID="90bc7ef4e051043899bc7f4da6bbc5d4b9a10b01cba6fccef896edbdc18c985e" exitCode=0
Sep 09 15:40:38.504751 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.504590    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"
Sep 09 15:40:38.504751 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.504617    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l" event={"ID":"83630355-2f01-4232-a814-b8b88de63efe","Type":"ContainerDied","Data":"90bc7ef4e051043899bc7f4da6bbc5d4b9a10b01cba6fccef896edbdc18c985e"}
Sep 09 15:40:38.504751 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.504678    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l" event={"ID":"83630355-2f01-4232-a814-b8b88de63efe","Type":"ContainerDied","Data":"c46253fea8964bfd08501557fbfc5d3dfa56f45373bc8f59a298360b5acb2acf"}
Sep 09 15:40:38.504751 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.504702    2574 scope.go:117] "RemoveContainer" containerID="90bc7ef4e051043899bc7f4da6bbc5d4b9a10b01cba6fccef896edbdc18c985e"
Sep 09 15:40:38.514552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.514534    2574 scope.go:117] "RemoveContainer" containerID="a9dcf141d7c3c14be6b5cbcfe465e8551ec95eb9866e0bd0b3bafcb77755a729"
Sep 09 15:40:38.525376 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.525352    2574 scope.go:117] "RemoveContainer" containerID="90bc7ef4e051043899bc7f4da6bbc5d4b9a10b01cba6fccef896edbdc18c985e"
Sep 09 15:40:38.525462 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.525351    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"]
Sep 09 15:40:38.525690 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:40:38.525669    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90bc7ef4e051043899bc7f4da6bbc5d4b9a10b01cba6fccef896edbdc18c985e\": container with ID starting with 90bc7ef4e051043899bc7f4da6bbc5d4b9a10b01cba6fccef896edbdc18c985e not found: ID does not exist" containerID="90bc7ef4e051043899bc7f4da6bbc5d4b9a10b01cba6fccef896edbdc18c985e"
Sep 09 15:40:38.525763 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.525703    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90bc7ef4e051043899bc7f4da6bbc5d4b9a10b01cba6fccef896edbdc18c985e"} err="failed to get container status \"90bc7ef4e051043899bc7f4da6bbc5d4b9a10b01cba6fccef896edbdc18c985e\": rpc error: code = NotFound desc = could not find container \"90bc7ef4e051043899bc7f4da6bbc5d4b9a10b01cba6fccef896edbdc18c985e\": container with ID starting with 90bc7ef4e051043899bc7f4da6bbc5d4b9a10b01cba6fccef896edbdc18c985e not found: ID does not exist"
Sep 09 15:40:38.525763 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.525729    2574 scope.go:117] "RemoveContainer" containerID="a9dcf141d7c3c14be6b5cbcfe465e8551ec95eb9866e0bd0b3bafcb77755a729"
Sep 09 15:40:38.526095 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:40:38.526077    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9dcf141d7c3c14be6b5cbcfe465e8551ec95eb9866e0bd0b3bafcb77755a729\": container with ID starting with a9dcf141d7c3c14be6b5cbcfe465e8551ec95eb9866e0bd0b3bafcb77755a729 not found: ID does not exist" containerID="a9dcf141d7c3c14be6b5cbcfe465e8551ec95eb9866e0bd0b3bafcb77755a729"
Sep 09 15:40:38.526138 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.526101    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9dcf141d7c3c14be6b5cbcfe465e8551ec95eb9866e0bd0b3bafcb77755a729"} err="failed to get container status \"a9dcf141d7c3c14be6b5cbcfe465e8551ec95eb9866e0bd0b3bafcb77755a729\": rpc error: code = NotFound desc = could not find container \"a9dcf141d7c3c14be6b5cbcfe465e8551ec95eb9866e0bd0b3bafcb77755a729\": container with ID starting with a9dcf141d7c3c14be6b5cbcfe465e8551ec95eb9866e0bd0b3bafcb77755a729 not found: ID does not exist"
Sep 09 15:40:38.528061 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:38.528042    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-c348b0d2-openshift-default-68ccb6d756-ttj5l"]
Sep 09 15:40:40.320495 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:40.320450    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83630355-2f01-4232-a814-b8b88de63efe" path="/var/lib/kubelet/pods/83630355-2f01-4232-a814-b8b88de63efe/volumes"
Sep 09 15:40:46.298946 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:40:46.298898    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:41:00.199314 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:00.199279    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:41:02.819568 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.819533    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"]
Sep 09 15:41:02.820054 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820038    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcccb715-2e54-455c-ae1c-6a231998896b" containerName="payload-pre-processing"
Sep 09 15:41:02.820099 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820057    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcccb715-2e54-455c-ae1c-6a231998896b" containerName="payload-pre-processing"
Sep 09 15:41:02.820099 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820066    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e615e38-3532-4ece-8366-ad9ad375bd4e" containerName="istio-proxy"
Sep 09 15:41:02.820099 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820071    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e615e38-3532-4ece-8366-ad9ad375bd4e" containerName="istio-proxy"
Sep 09 15:41:02.820099 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820087    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a55012-fd12-4376-947d-3a77e01d47db" containerName="maas-api"
Sep 09 15:41:02.820099 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820092    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a55012-fd12-4376-947d-3a77e01d47db" containerName="maas-api"
Sep 09 15:41:02.820256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820104    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9316eaae-10b4-4fdc-b365-3f130d44a880" containerName="payload-pre-processing"
Sep 09 15:41:02.820256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820109    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9316eaae-10b4-4fdc-b365-3f130d44a880" containerName="payload-pre-processing"
Sep 09 15:41:02.820256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820117    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83630355-2f01-4232-a814-b8b88de63efe" containerName="istio-proxy"
Sep 09 15:41:02.820256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820123    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="83630355-2f01-4232-a814-b8b88de63efe" containerName="istio-proxy"
Sep 09 15:41:02.820256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820129    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83630355-2f01-4232-a814-b8b88de63efe" containerName="istio-proxy"
Sep 09 15:41:02.820256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820134    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="83630355-2f01-4232-a814-b8b88de63efe" containerName="istio-proxy"
Sep 09 15:41:02.820256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820191    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9316eaae-10b4-4fdc-b365-3f130d44a880" containerName="payload-pre-processing"
Sep 09 15:41:02.820256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820200    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="83630355-2f01-4232-a814-b8b88de63efe" containerName="istio-proxy"
Sep 09 15:41:02.820256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820206    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e615e38-3532-4ece-8366-ad9ad375bd4e" containerName="istio-proxy"
Sep 09 15:41:02.820256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820211    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6a55012-fd12-4376-947d-3a77e01d47db" containerName="maas-api"
Sep 09 15:41:02.820256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820218    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcccb715-2e54-455c-ae1c-6a231998896b" containerName="payload-pre-processing"
Sep 09 15:41:02.820256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820223    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e615e38-3532-4ece-8366-ad9ad375bd4e" containerName="istio-proxy"
Sep 09 15:41:02.820256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.820228    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="83630355-2f01-4232-a814-b8b88de63efe" containerName="istio-proxy"
Sep 09 15:41:02.823668 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.823647    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:02.826386 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.826364    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-d36ac1-openshift-default-dockercfg-mq259\""
Sep 09 15:41:02.835311 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.835276    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"]
Sep 09 15:41:02.909802 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.909723    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5152202d-00fc-4da5-9129-1a9195166999-istio-podinfo\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:02.909802 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.909779    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-credential-socket\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:02.910093 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.909906    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-istio-data\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:02.910093 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.909933    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j68hw\" (UniqueName: \"kubernetes.io/projected/5152202d-00fc-4da5-9129-1a9195166999-kube-api-access-j68hw\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:02.910093 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.909976    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5152202d-00fc-4da5-9129-1a9195166999-istio-token\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:02.910093 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.910013    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-workload-certs\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:02.910093 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.910036    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-istio-envoy\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:02.910093 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.910065    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5152202d-00fc-4da5-9129-1a9195166999-istiod-ca-cert\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:02.910457 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:02.910097    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-workload-socket\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.011181 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.011138    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5152202d-00fc-4da5-9129-1a9195166999-istio-token\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.011181 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.011184    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-workload-certs\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.011436 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.011204    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-istio-envoy\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.011436 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.011233    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5152202d-00fc-4da5-9129-1a9195166999-istiod-ca-cert\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.011436 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.011256    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-workload-socket\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.011436 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.011290    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5152202d-00fc-4da5-9129-1a9195166999-istio-podinfo\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.011436 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.011314    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-credential-socket\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.011436 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.011413    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-istio-data\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.011763 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.011439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j68hw\" (UniqueName: \"kubernetes.io/projected/5152202d-00fc-4da5-9129-1a9195166999-kube-api-access-j68hw\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.011763 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.011734    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-credential-socket\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.011900 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.011832    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-workload-socket\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.011962 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.011930    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-istio-data\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.012177 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.012081    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-workload-certs\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.012650 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.012624    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5152202d-00fc-4da5-9129-1a9195166999-istiod-ca-cert\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.013812 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.013787    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-istio-envoy\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.014140 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.014118    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5152202d-00fc-4da5-9129-1a9195166999-istio-podinfo\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.019165 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.019145    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5152202d-00fc-4da5-9129-1a9195166999-istio-token\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.019537 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.019521    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j68hw\" (UniqueName: \"kubernetes.io/projected/5152202d-00fc-4da5-9129-1a9195166999-kube-api-access-j68hw\") pod \"e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") " pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.136774 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.136684    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:03.418104 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.418074    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"]
Sep 09 15:41:03.419380 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:41:03.419352    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5152202d_00fc_4da5_9129_1a9195166999.slice/crio-bb38f9945f23840790fc8aff379e5347d5da94ad923dc6ac12b64f93aa858cf2 WatchSource:0}: Error finding container bb38f9945f23840790fc8aff379e5347d5da94ad923dc6ac12b64f93aa858cf2: Status 404 returned error can't find the container with id bb38f9945f23840790fc8aff379e5347d5da94ad923dc6ac12b64f93aa858cf2
Sep 09 15:41:03.422518 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.422409    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:41:03.422518 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.422502    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:41:03.422704 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.422545    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:41:03.662609 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.662573    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df" event={"ID":"5152202d-00fc-4da5-9129-1a9195166999","Type":"ContainerStarted","Data":"a7b1ca0d8a1e1ba1ab777ee5df1e3b26733489d610c712f34526999b4c5e9a96"}
Sep 09 15:41:03.662829 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.662634    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df" event={"ID":"5152202d-00fc-4da5-9129-1a9195166999","Type":"ContainerStarted","Data":"bb38f9945f23840790fc8aff379e5347d5da94ad923dc6ac12b64f93aa858cf2"}
Sep 09 15:41:03.684132 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:03.683966    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df" podStartSLOduration=1.683942418 podStartE2EDuration="1.683942418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:41:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:41:03.68251529 +0000 UTC m=+1247.872718070" watchObservedRunningTime="2026-09-09 15:41:03.683942418 +0000 UTC m=+1247.874145169"
Sep 09 15:41:04.137826 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:04.137792    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:04.143306 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:04.143276    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:04.668376 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:04.668345    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:04.669397 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:04.669372    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:06.967946 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:06.967907    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"]
Sep 09 15:41:06.968385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:06.968364    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e615e38-3532-4ece-8366-ad9ad375bd4e" containerName="istio-proxy"
Sep 09 15:41:06.968385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:06.968382    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e615e38-3532-4ece-8366-ad9ad375bd4e" containerName="istio-proxy"
Sep 09 15:41:06.972125 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:06.972102    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:41:06.974817 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:06.974795    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-d36ac1-serving-cert\""
Sep 09 15:41:06.985977 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:06.985946    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"]
Sep 09 15:41:07.053553 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.053516    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b125924e-9fa9-402c-8a75-837182b60f1f-openshift-service-ca\") pod \"maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c\" (UID: \"b125924e-9fa9-402c-8a75-837182b60f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:41:07.053745 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.053591    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b125924e-9fa9-402c-8a75-837182b60f1f-maas-api-tls\") pod \"maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c\" (UID: \"b125924e-9fa9-402c-8a75-837182b60f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:41:07.053745 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.053619    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hffn2\" (UniqueName: \"kubernetes.io/projected/b125924e-9fa9-402c-8a75-837182b60f1f-kube-api-access-hffn2\") pod \"maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c\" (UID: \"b125924e-9fa9-402c-8a75-837182b60f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:41:07.053745 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.053634    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b125924e-9fa9-402c-8a75-837182b60f1f-metrics-certs\") pod \"maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c\" (UID: \"b125924e-9fa9-402c-8a75-837182b60f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:41:07.154925 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.154883    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b125924e-9fa9-402c-8a75-837182b60f1f-openshift-service-ca\") pod \"maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c\" (UID: \"b125924e-9fa9-402c-8a75-837182b60f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:41:07.155103 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.154974    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b125924e-9fa9-402c-8a75-837182b60f1f-maas-api-tls\") pod \"maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c\" (UID: \"b125924e-9fa9-402c-8a75-837182b60f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:41:07.155103 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.155011    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hffn2\" (UniqueName: \"kubernetes.io/projected/b125924e-9fa9-402c-8a75-837182b60f1f-kube-api-access-hffn2\") pod \"maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c\" (UID: \"b125924e-9fa9-402c-8a75-837182b60f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:41:07.155103 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.155030    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b125924e-9fa9-402c-8a75-837182b60f1f-metrics-certs\") pod \"maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c\" (UID: \"b125924e-9fa9-402c-8a75-837182b60f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:41:07.155690 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.155657    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b125924e-9fa9-402c-8a75-837182b60f1f-openshift-service-ca\") pod \"maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c\" (UID: \"b125924e-9fa9-402c-8a75-837182b60f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:41:07.157559 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.157535    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b125924e-9fa9-402c-8a75-837182b60f1f-maas-api-tls\") pod \"maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c\" (UID: \"b125924e-9fa9-402c-8a75-837182b60f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:41:07.157685 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.157665    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b125924e-9fa9-402c-8a75-837182b60f1f-metrics-certs\") pod \"maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c\" (UID: \"b125924e-9fa9-402c-8a75-837182b60f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:41:07.162864 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.162822    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hffn2\" (UniqueName: \"kubernetes.io/projected/b125924e-9fa9-402c-8a75-837182b60f1f-kube-api-access-hffn2\") pod \"maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c\" (UID: \"b125924e-9fa9-402c-8a75-837182b60f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:41:07.285947 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.285809    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:41:07.565159 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.565135    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"]
Sep 09 15:41:07.566920 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:41:07.566884    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb125924e_9fa9_402c_8a75_837182b60f1f.slice/crio-547e908bf3a70ca8f0beb49f38c7aae769e08321bc77b10e979c8ac00a10dd9c WatchSource:0}: Error finding container 547e908bf3a70ca8f0beb49f38c7aae769e08321bc77b10e979c8ac00a10dd9c: Status 404 returned error can't find the container with id 547e908bf3a70ca8f0beb49f38c7aae769e08321bc77b10e979c8ac00a10dd9c
Sep 09 15:41:07.687623 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.687586    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c" event={"ID":"b125924e-9fa9-402c-8a75-837182b60f1f","Type":"ContainerStarted","Data":"547e908bf3a70ca8f0beb49f38c7aae769e08321bc77b10e979c8ac00a10dd9c"}
Sep 09 15:41:07.692675 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.692649    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"]
Sep 09 15:41:07.697484 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.697464    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"
Sep 09 15:41:07.700214 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.700187    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-d36ac1-dockercfg-gdcqd\""
Sep 09 15:41:07.700331 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.700196    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-d36ac1\""
Sep 09 15:41:07.705030 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.705002    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"]
Sep 09 15:41:07.722595 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.722565    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"]
Sep 09 15:41:07.726347 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.726327    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"
Sep 09 15:41:07.735666 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.735638    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"]
Sep 09 15:41:07.760901 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.760837    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8hlx\" (UniqueName: \"kubernetes.io/projected/7a850c36-d0ac-44ee-98f4-1eb85d7dca90-kube-api-access-b8hlx\") pod \"payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg\" (UID: \"7a850c36-d0ac-44ee-98f4-1eb85d7dca90\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"
Sep 09 15:41:07.761056 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.760938    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a850c36-d0ac-44ee-98f4-1eb85d7dca90-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg\" (UID: \"7a850c36-d0ac-44ee-98f4-1eb85d7dca90\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"
Sep 09 15:41:07.861684 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.861595    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8hlx\" (UniqueName: \"kubernetes.io/projected/7a850c36-d0ac-44ee-98f4-1eb85d7dca90-kube-api-access-b8hlx\") pod \"payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg\" (UID: \"7a850c36-d0ac-44ee-98f4-1eb85d7dca90\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"
Sep 09 15:41:07.861684 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.861655    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4kdb\" (UniqueName: \"kubernetes.io/projected/0ffd1b75-1ee3-495e-a791-42436d9a4f8a-kube-api-access-c4kdb\") pod \"payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg\" (UID: \"0ffd1b75-1ee3-495e-a791-42436d9a4f8a\") " pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"
Sep 09 15:41:07.861949 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.861710    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a850c36-d0ac-44ee-98f4-1eb85d7dca90-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg\" (UID: \"7a850c36-d0ac-44ee-98f4-1eb85d7dca90\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"
Sep 09 15:41:07.861949 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.861858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ffd1b75-1ee3-495e-a791-42436d9a4f8a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg\" (UID: \"0ffd1b75-1ee3-495e-a791-42436d9a4f8a\") " pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"
Sep 09 15:41:07.862430 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.862404    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a850c36-d0ac-44ee-98f4-1eb85d7dca90-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg\" (UID: \"7a850c36-d0ac-44ee-98f4-1eb85d7dca90\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"
Sep 09 15:41:07.869515 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.869496    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8hlx\" (UniqueName: \"kubernetes.io/projected/7a850c36-d0ac-44ee-98f4-1eb85d7dca90-kube-api-access-b8hlx\") pod \"payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg\" (UID: \"7a850c36-d0ac-44ee-98f4-1eb85d7dca90\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"
Sep 09 15:41:07.962887 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.962827    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ffd1b75-1ee3-495e-a791-42436d9a4f8a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg\" (UID: \"0ffd1b75-1ee3-495e-a791-42436d9a4f8a\") " pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"
Sep 09 15:41:07.963050 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.962952    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4kdb\" (UniqueName: \"kubernetes.io/projected/0ffd1b75-1ee3-495e-a791-42436d9a4f8a-kube-api-access-c4kdb\") pod \"payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg\" (UID: \"0ffd1b75-1ee3-495e-a791-42436d9a4f8a\") " pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"
Sep 09 15:41:07.963577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.963555    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ffd1b75-1ee3-495e-a791-42436d9a4f8a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg\" (UID: \"0ffd1b75-1ee3-495e-a791-42436d9a4f8a\") " pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"
Sep 09 15:41:07.971531 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:07.971508    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4kdb\" (UniqueName: \"kubernetes.io/projected/0ffd1b75-1ee3-495e-a791-42436d9a4f8a-kube-api-access-c4kdb\") pod \"payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg\" (UID: \"0ffd1b75-1ee3-495e-a791-42436d9a4f8a\") " pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"
Sep 09 15:41:08.010638 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:08.010604    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"
Sep 09 15:41:08.038369 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:08.038347    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"
Sep 09 15:41:08.305541 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:08.305510    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"]
Sep 09 15:41:08.306467 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:41:08.306441    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a850c36_d0ac_44ee_98f4_1eb85d7dca90.slice/crio-d0b7734f87047b1b0085664b05ce7c46e1d1ab34be34680e224abe6923e9f2ec WatchSource:0}: Error finding container d0b7734f87047b1b0085664b05ce7c46e1d1ab34be34680e224abe6923e9f2ec: Status 404 returned error can't find the container with id d0b7734f87047b1b0085664b05ce7c46e1d1ab34be34680e224abe6923e9f2ec
Sep 09 15:41:08.348319 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:08.348292    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"]
Sep 09 15:41:08.350538 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:41:08.350510    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ffd1b75_1ee3_495e_a791_42436d9a4f8a.slice/crio-8a67f5ad7aa9dea005d28d14e2cc5da6bec6bdefb436b2e19db27472e7aeebe8 WatchSource:0}: Error finding container 8a67f5ad7aa9dea005d28d14e2cc5da6bec6bdefb436b2e19db27472e7aeebe8: Status 404 returned error can't find the container with id 8a67f5ad7aa9dea005d28d14e2cc5da6bec6bdefb436b2e19db27472e7aeebe8
Sep 09 15:41:08.695532 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:08.695495    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg" event={"ID":"7a850c36-d0ac-44ee-98f4-1eb85d7dca90","Type":"ContainerStarted","Data":"df0236d96e0b874da23c07774192e4dcafd8f149db538fd8cf2de2d9451d6df0"}
Sep 09 15:41:08.695735 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:08.695568    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg" event={"ID":"7a850c36-d0ac-44ee-98f4-1eb85d7dca90","Type":"ContainerStarted","Data":"d0b7734f87047b1b0085664b05ce7c46e1d1ab34be34680e224abe6923e9f2ec"}
Sep 09 15:41:08.695735 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:08.695621    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"
Sep 09 15:41:08.697406 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:08.697351    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c" event={"ID":"b125924e-9fa9-402c-8a75-837182b60f1f","Type":"ContainerStarted","Data":"5ddb12104358f99045f943810a1b008cb083a1d8bbde47fe76bf97aa501f414e"}
Sep 09 15:41:08.697569 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:08.697555    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:41:08.699133 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:08.699111    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg" event={"ID":"0ffd1b75-1ee3-495e-a791-42436d9a4f8a","Type":"ContainerStarted","Data":"4e981d14687dea7d8155cba2a8e00f5da29807c4e97d82bdd1583cd6a43a55a8"}
Sep 09 15:41:08.699240 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:08.699155    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg" event={"ID":"0ffd1b75-1ee3-495e-a791-42436d9a4f8a","Type":"ContainerStarted","Data":"8a67f5ad7aa9dea005d28d14e2cc5da6bec6bdefb436b2e19db27472e7aeebe8"}
Sep 09 15:41:08.699319 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:08.699305    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"
Sep 09 15:41:08.712929 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:08.712888    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg" podStartSLOduration=1.712875326 podStartE2EDuration="1.712875326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:41:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:41:08.710288427 +0000 UTC m=+1252.900491199" watchObservedRunningTime="2026-09-09 15:41:08.712875326 +0000 UTC m=+1252.903078078"
Sep 09 15:41:08.728564 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:08.728517    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c" podStartSLOduration=2.263716106 podStartE2EDuration="2.728499869s" totalImagesPullingTime="464.783763ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:41:08.72580516 +0000 UTC m=+1252.916007910" watchObservedRunningTime="2026-09-09 15:41:08.728499869 +0000 UTC m=+1252.918702644"
Sep 09 15:41:08.742456 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:08.742381    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg" podStartSLOduration=1.7423675410000001 podStartE2EDuration="1.742367541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:41:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:41:08.741215036 +0000 UTC m=+1252.931417802" watchObservedRunningTime="2026-09-09 15:41:08.742367541 +0000 UTC m=+1252.932570290"
Sep 09 15:41:14.711224 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:14.711187    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:41:19.297134 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:19.297090    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:41:19.707742 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:19.707700    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"
Sep 09 15:41:19.707955 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:19.707889    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"
Sep 09 15:41:29.692647 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:41:29.692613    2574 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@5-18404-0.service\": RecentStats: unable to find data in memory cache]"
Sep 09 15:41:29.838007 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:29.837919    2574 generic.go:356] "Generic (PLEG): container finished" podID="5152202d-00fc-4da5-9129-1a9195166999" containerID="a7b1ca0d8a1e1ba1ab777ee5df1e3b26733489d610c712f34526999b4c5e9a96" exitCode=0
Sep 09 15:41:29.838184 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:29.838001    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df" event={"ID":"5152202d-00fc-4da5-9129-1a9195166999","Type":"ContainerDied","Data":"a7b1ca0d8a1e1ba1ab777ee5df1e3b26733489d610c712f34526999b4c5e9a96"}
Sep 09 15:41:29.838497 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:29.838481    2574 scope.go:117] "RemoveContainer" containerID="a7b1ca0d8a1e1ba1ab777ee5df1e3b26733489d610c712f34526999b4c5e9a96"
Sep 09 15:41:29.839787 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:29.839757    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:41:29.839872 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:29.839829    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:41:29.839917 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:29.839884    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:41:30.846928 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:30.846887    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df" event={"ID":"5152202d-00fc-4da5-9129-1a9195166999","Type":"ContainerStarted","Data":"445f154a6a7e86393da947d3f01ede5af219c659e8937289fa4e35bc61c5c7d5"}
Sep 09 15:41:31.137311 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:31.137200    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:31.138573 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:31.138544    2574 patch_prober.go:28] interesting pod/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 09 15:41:31.138697 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:31.138611    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df" podUID="5152202d-00fc-4da5-9129-1a9195166999" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 09 15:41:32.137773 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:32.137732    2574 patch_prober.go:28] interesting pod/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 09 15:41:32.138309 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:32.137804    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df" podUID="5152202d-00fc-4da5-9129-1a9195166999" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 09 15:41:33.137159 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:33.137123    2574 patch_prober.go:28] interesting pod/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 09 15:41:33.137377 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:33.137191    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df" podUID="5152202d-00fc-4da5-9129-1a9195166999" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 09 15:41:34.138007 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:34.137967    2574 patch_prober.go:28] interesting pod/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 09 15:41:34.138420 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:34.138026    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df" podUID="5152202d-00fc-4da5-9129-1a9195166999" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 09 15:41:34.495297 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:34.495260    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:41:34.668418 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:34.668381    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:35.137832 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:35.137796    2574 patch_prober.go:28] interesting pod/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 09 15:41:35.138045 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:35.137922    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df" podUID="5152202d-00fc-4da5-9129-1a9195166999" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 09 15:41:36.142256 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:36.142227    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:36.143328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:36.143311    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:41:58.903311 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:41:58.903271    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:42:15.915159 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:15.915121    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"]
Sep 09 15:42:15.919050 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:15.919030    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"
Sep 09 15:42:15.921967 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:15.921941    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-73d87788-dockercfg-xdv2q\""
Sep 09 15:42:15.922131 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:15.922109    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-73d87788\""
Sep 09 15:42:15.932181 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:15.932155    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"]
Sep 09 15:42:15.970904 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:15.970867    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwbpv\" (UniqueName: \"kubernetes.io/projected/51a4853b-c5b4-4b1e-a063-653b4771d39e-kube-api-access-dwbpv\") pod \"payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm\" (UID: \"51a4853b-c5b4-4b1e-a063-653b4771d39e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"
Sep 09 15:42:15.971083 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:15.970926    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51a4853b-c5b4-4b1e-a063-653b4771d39e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm\" (UID: \"51a4853b-c5b4-4b1e-a063-653b4771d39e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"
Sep 09 15:42:16.071663 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:16.071613    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51a4853b-c5b4-4b1e-a063-653b4771d39e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm\" (UID: \"51a4853b-c5b4-4b1e-a063-653b4771d39e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"
Sep 09 15:42:16.071889 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:16.071801    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwbpv\" (UniqueName: \"kubernetes.io/projected/51a4853b-c5b4-4b1e-a063-653b4771d39e-kube-api-access-dwbpv\") pod \"payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm\" (UID: \"51a4853b-c5b4-4b1e-a063-653b4771d39e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"
Sep 09 15:42:16.072380 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:16.072359    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51a4853b-c5b4-4b1e-a063-653b4771d39e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm\" (UID: \"51a4853b-c5b4-4b1e-a063-653b4771d39e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"
Sep 09 15:42:16.080258 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:16.080236    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwbpv\" (UniqueName: \"kubernetes.io/projected/51a4853b-c5b4-4b1e-a063-653b4771d39e-kube-api-access-dwbpv\") pod \"payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm\" (UID: \"51a4853b-c5b4-4b1e-a063-653b4771d39e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"
Sep 09 15:42:16.233398 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:16.233363    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-73d87788-dockercfg-xdv2q\""
Sep 09 15:42:16.241591 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:16.241568    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"
Sep 09 15:42:16.516573 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:16.516546    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"]
Sep 09 15:42:16.518000 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:42:16.517958    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a4853b_c5b4_4b1e_a063_653b4771d39e.slice/crio-30e745caef591b02b1e4e888ee84d2cae648968e2b6d47ebbc0b404b5cd65bcb WatchSource:0}: Error finding container 30e745caef591b02b1e4e888ee84d2cae648968e2b6d47ebbc0b404b5cd65bcb: Status 404 returned error can't find the container with id 30e745caef591b02b1e4e888ee84d2cae648968e2b6d47ebbc0b404b5cd65bcb
Sep 09 15:42:17.140893 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:17.140817    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm" event={"ID":"51a4853b-c5b4-4b1e-a063-653b4771d39e","Type":"ContainerStarted","Data":"44fe0e1ec35a3f4c5beb0b960ec9b2596d8db16837a8e9bad89fd55b2a5b85ef"}
Sep 09 15:42:17.141410 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:17.140958    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm" event={"ID":"51a4853b-c5b4-4b1e-a063-653b4771d39e","Type":"ContainerStarted","Data":"30e745caef591b02b1e4e888ee84d2cae648968e2b6d47ebbc0b404b5cd65bcb"}
Sep 09 15:42:17.141410 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:17.141183    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"
Sep 09 15:42:17.159475 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:17.159413    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm" podStartSLOduration=2.159394991 podStartE2EDuration="2.159394991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:42:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:42:17.15766363 +0000 UTC m=+1321.347866402" watchObservedRunningTime="2026-09-09 15:42:17.159394991 +0000 UTC m=+1321.349597740"
Sep 09 15:42:27.096611 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:27.096571    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:42:28.151617 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:28.151589    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"
Sep 09 15:42:57.049309 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.049271    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"]
Sep 09 15:42:57.049782 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.049554    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm" podUID="51a4853b-c5b4-4b1e-a063-653b4771d39e" containerName="payload-pre-processing" containerID="cri-o://44fe0e1ec35a3f4c5beb0b960ec9b2596d8db16837a8e9bad89fd55b2a5b85ef" gracePeriod=30
Sep 09 15:42:57.324401 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.324371    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"
Sep 09 15:42:57.400196 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.400161    2574 generic.go:356] "Generic (PLEG): container finished" podID="51a4853b-c5b4-4b1e-a063-653b4771d39e" containerID="44fe0e1ec35a3f4c5beb0b960ec9b2596d8db16837a8e9bad89fd55b2a5b85ef" exitCode=0
Sep 09 15:42:57.400385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.400210    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"
Sep 09 15:42:57.400385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.400234    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm" event={"ID":"51a4853b-c5b4-4b1e-a063-653b4771d39e","Type":"ContainerDied","Data":"44fe0e1ec35a3f4c5beb0b960ec9b2596d8db16837a8e9bad89fd55b2a5b85ef"}
Sep 09 15:42:57.400385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.400304    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm" event={"ID":"51a4853b-c5b4-4b1e-a063-653b4771d39e","Type":"ContainerDied","Data":"30e745caef591b02b1e4e888ee84d2cae648968e2b6d47ebbc0b404b5cd65bcb"}
Sep 09 15:42:57.400385 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.400336    2574 scope.go:117] "RemoveContainer" containerID="44fe0e1ec35a3f4c5beb0b960ec9b2596d8db16837a8e9bad89fd55b2a5b85ef"
Sep 09 15:42:57.401714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.401662    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51a4853b-c5b4-4b1e-a063-653b4771d39e-plugins-config-volume\") pod \"51a4853b-c5b4-4b1e-a063-653b4771d39e\" (UID: \"51a4853b-c5b4-4b1e-a063-653b4771d39e\") "
Sep 09 15:42:57.401784 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.401716    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwbpv\" (UniqueName: \"kubernetes.io/projected/51a4853b-c5b4-4b1e-a063-653b4771d39e-kube-api-access-dwbpv\") pod \"51a4853b-c5b4-4b1e-a063-653b4771d39e\" (UID: \"51a4853b-c5b4-4b1e-a063-653b4771d39e\") "
Sep 09 15:42:57.402147 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.402123    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a4853b-c5b4-4b1e-a063-653b4771d39e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "51a4853b-c5b4-4b1e-a063-653b4771d39e" (UID: "51a4853b-c5b4-4b1e-a063-653b4771d39e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:42:57.402269 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.402214    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51a4853b-c5b4-4b1e-a063-653b4771d39e-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:42:57.404296 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.404271    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51a4853b-c5b4-4b1e-a063-653b4771d39e-kube-api-access-dwbpv" (OuterVolumeSpecName: "kube-api-access-dwbpv") pod "51a4853b-c5b4-4b1e-a063-653b4771d39e" (UID: "51a4853b-c5b4-4b1e-a063-653b4771d39e"). InnerVolumeSpecName "kube-api-access-dwbpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:42:57.416717 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.416696    2574 scope.go:117] "RemoveContainer" containerID="44fe0e1ec35a3f4c5beb0b960ec9b2596d8db16837a8e9bad89fd55b2a5b85ef"
Sep 09 15:42:57.417076 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:42:57.417056    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44fe0e1ec35a3f4c5beb0b960ec9b2596d8db16837a8e9bad89fd55b2a5b85ef\": container with ID starting with 44fe0e1ec35a3f4c5beb0b960ec9b2596d8db16837a8e9bad89fd55b2a5b85ef not found: ID does not exist" containerID="44fe0e1ec35a3f4c5beb0b960ec9b2596d8db16837a8e9bad89fd55b2a5b85ef"
Sep 09 15:42:57.417159 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.417086    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44fe0e1ec35a3f4c5beb0b960ec9b2596d8db16837a8e9bad89fd55b2a5b85ef"} err="failed to get container status \"44fe0e1ec35a3f4c5beb0b960ec9b2596d8db16837a8e9bad89fd55b2a5b85ef\": rpc error: code = NotFound desc = could not find container \"44fe0e1ec35a3f4c5beb0b960ec9b2596d8db16837a8e9bad89fd55b2a5b85ef\": container with ID starting with 44fe0e1ec35a3f4c5beb0b960ec9b2596d8db16837a8e9bad89fd55b2a5b85ef not found: ID does not exist"
Sep 09 15:42:57.503773 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.503738    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwbpv\" (UniqueName: \"kubernetes.io/projected/51a4853b-c5b4-4b1e-a063-653b4771d39e-kube-api-access-dwbpv\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:42:57.727828 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.725871    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"]
Sep 09 15:42:57.732259 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:57.732235    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-73d87788-6666548d78-hcplm"]
Sep 09 15:42:58.320940 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:42:58.320902    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51a4853b-c5b4-4b1e-a063-653b4771d39e" path="/var/lib/kubelet/pods/51a4853b-c5b4-4b1e-a063-653b4771d39e/volumes"
Sep 09 15:43:00.603453 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:00.603416    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:43:03.945032 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:03.944995    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"]
Sep 09 15:43:03.945471 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:03.945295    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c" podUID="b125924e-9fa9-402c-8a75-837182b60f1f" containerName="maas-api" containerID="cri-o://5ddb12104358f99045f943810a1b008cb083a1d8bbde47fe76bf97aa501f414e" gracePeriod=30
Sep 09 15:43:03.997446 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:03.997407    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"]
Sep 09 15:43:03.997745 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:03.997686    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg" podUID="0ffd1b75-1ee3-495e-a791-42436d9a4f8a" containerName="payload-processing" containerID="cri-o://4e981d14687dea7d8155cba2a8e00f5da29807c4e97d82bdd1583cd6a43a55a8" gracePeriod=30
Sep 09 15:43:04.005516 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.005485    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"]
Sep 09 15:43:04.006236 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.005732    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg" podUID="7a850c36-d0ac-44ee-98f4-1eb85d7dca90" containerName="payload-pre-processing" containerID="cri-o://df0236d96e0b874da23c07774192e4dcafd8f149db538fd8cf2de2d9451d6df0" gracePeriod=30
Sep 09 15:43:04.291201 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.290089    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:43:04.329761 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.329731    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"
Sep 09 15:43:04.333688 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.333668    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"
Sep 09 15:43:04.384045 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.384010    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hffn2\" (UniqueName: \"kubernetes.io/projected/b125924e-9fa9-402c-8a75-837182b60f1f-kube-api-access-hffn2\") pod \"b125924e-9fa9-402c-8a75-837182b60f1f\" (UID: \"b125924e-9fa9-402c-8a75-837182b60f1f\") "
Sep 09 15:43:04.384227 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.384093    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b125924e-9fa9-402c-8a75-837182b60f1f-openshift-service-ca\") pod \"b125924e-9fa9-402c-8a75-837182b60f1f\" (UID: \"b125924e-9fa9-402c-8a75-837182b60f1f\") "
Sep 09 15:43:04.384227 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.384124    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b125924e-9fa9-402c-8a75-837182b60f1f-metrics-certs\") pod \"b125924e-9fa9-402c-8a75-837182b60f1f\" (UID: \"b125924e-9fa9-402c-8a75-837182b60f1f\") "
Sep 09 15:43:04.384227 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.384166    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b125924e-9fa9-402c-8a75-837182b60f1f-maas-api-tls\") pod \"b125924e-9fa9-402c-8a75-837182b60f1f\" (UID: \"b125924e-9fa9-402c-8a75-837182b60f1f\") "
Sep 09 15:43:04.384482 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.384450    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b125924e-9fa9-402c-8a75-837182b60f1f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b125924e-9fa9-402c-8a75-837182b60f1f" (UID: "b125924e-9fa9-402c-8a75-837182b60f1f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:43:04.384675 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.384643    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b125924e-9fa9-402c-8a75-837182b60f1f-openshift-service-ca\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:04.386473 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.386445    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b125924e-9fa9-402c-8a75-837182b60f1f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b125924e-9fa9-402c-8a75-837182b60f1f" (UID: "b125924e-9fa9-402c-8a75-837182b60f1f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:43:04.386929 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.386898    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b125924e-9fa9-402c-8a75-837182b60f1f-kube-api-access-hffn2" (OuterVolumeSpecName: "kube-api-access-hffn2") pod "b125924e-9fa9-402c-8a75-837182b60f1f" (UID: "b125924e-9fa9-402c-8a75-837182b60f1f"). InnerVolumeSpecName "kube-api-access-hffn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:43:04.386929 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.386904    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b125924e-9fa9-402c-8a75-837182b60f1f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b125924e-9fa9-402c-8a75-837182b60f1f" (UID: "b125924e-9fa9-402c-8a75-837182b60f1f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:43:04.449661 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.449624    2574 generic.go:356] "Generic (PLEG): container finished" podID="7a850c36-d0ac-44ee-98f4-1eb85d7dca90" containerID="df0236d96e0b874da23c07774192e4dcafd8f149db538fd8cf2de2d9451d6df0" exitCode=0
Sep 09 15:43:04.449894 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.449670    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"
Sep 09 15:43:04.449894 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.449714    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg" event={"ID":"7a850c36-d0ac-44ee-98f4-1eb85d7dca90","Type":"ContainerDied","Data":"df0236d96e0b874da23c07774192e4dcafd8f149db538fd8cf2de2d9451d6df0"}
Sep 09 15:43:04.449894 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.449770    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg" event={"ID":"7a850c36-d0ac-44ee-98f4-1eb85d7dca90","Type":"ContainerDied","Data":"d0b7734f87047b1b0085664b05ce7c46e1d1ab34be34680e224abe6923e9f2ec"}
Sep 09 15:43:04.449894 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.449799    2574 scope.go:117] "RemoveContainer" containerID="df0236d96e0b874da23c07774192e4dcafd8f149db538fd8cf2de2d9451d6df0"
Sep 09 15:43:04.451196 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.451177    2574 generic.go:356] "Generic (PLEG): container finished" podID="b125924e-9fa9-402c-8a75-837182b60f1f" containerID="5ddb12104358f99045f943810a1b008cb083a1d8bbde47fe76bf97aa501f414e" exitCode=0
Sep 09 15:43:04.451294 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.451226    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"
Sep 09 15:43:04.451294 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.451255    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c" event={"ID":"b125924e-9fa9-402c-8a75-837182b60f1f","Type":"ContainerDied","Data":"5ddb12104358f99045f943810a1b008cb083a1d8bbde47fe76bf97aa501f414e"}
Sep 09 15:43:04.451405 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.451294    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c" event={"ID":"b125924e-9fa9-402c-8a75-837182b60f1f","Type":"ContainerDied","Data":"547e908bf3a70ca8f0beb49f38c7aae769e08321bc77b10e979c8ac00a10dd9c"}
Sep 09 15:43:04.452902 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.452856    2574 generic.go:356] "Generic (PLEG): container finished" podID="0ffd1b75-1ee3-495e-a791-42436d9a4f8a" containerID="4e981d14687dea7d8155cba2a8e00f5da29807c4e97d82bdd1583cd6a43a55a8" exitCode=0
Sep 09 15:43:04.453021 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.452921    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"
Sep 09 15:43:04.453021 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.452932    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg" event={"ID":"0ffd1b75-1ee3-495e-a791-42436d9a4f8a","Type":"ContainerDied","Data":"4e981d14687dea7d8155cba2a8e00f5da29807c4e97d82bdd1583cd6a43a55a8"}
Sep 09 15:43:04.453021 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.452970    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg" event={"ID":"0ffd1b75-1ee3-495e-a791-42436d9a4f8a","Type":"ContainerDied","Data":"8a67f5ad7aa9dea005d28d14e2cc5da6bec6bdefb436b2e19db27472e7aeebe8"}
Sep 09 15:43:04.459952 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.459932    2574 scope.go:117] "RemoveContainer" containerID="df0236d96e0b874da23c07774192e4dcafd8f149db538fd8cf2de2d9451d6df0"
Sep 09 15:43:04.460252 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:43:04.460220    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df0236d96e0b874da23c07774192e4dcafd8f149db538fd8cf2de2d9451d6df0\": container with ID starting with df0236d96e0b874da23c07774192e4dcafd8f149db538fd8cf2de2d9451d6df0 not found: ID does not exist" containerID="df0236d96e0b874da23c07774192e4dcafd8f149db538fd8cf2de2d9451d6df0"
Sep 09 15:43:04.460305 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.460247    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df0236d96e0b874da23c07774192e4dcafd8f149db538fd8cf2de2d9451d6df0"} err="failed to get container status \"df0236d96e0b874da23c07774192e4dcafd8f149db538fd8cf2de2d9451d6df0\": rpc error: code = NotFound desc = could not find container \"df0236d96e0b874da23c07774192e4dcafd8f149db538fd8cf2de2d9451d6df0\": container with ID starting with df0236d96e0b874da23c07774192e4dcafd8f149db538fd8cf2de2d9451d6df0 not found: ID does not exist"
Sep 09 15:43:04.460305 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.460263    2574 scope.go:117] "RemoveContainer" containerID="5ddb12104358f99045f943810a1b008cb083a1d8bbde47fe76bf97aa501f414e"
Sep 09 15:43:04.469751 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.469729    2574 scope.go:117] "RemoveContainer" containerID="5ddb12104358f99045f943810a1b008cb083a1d8bbde47fe76bf97aa501f414e"
Sep 09 15:43:04.471283 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:43:04.471252    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ddb12104358f99045f943810a1b008cb083a1d8bbde47fe76bf97aa501f414e\": container with ID starting with 5ddb12104358f99045f943810a1b008cb083a1d8bbde47fe76bf97aa501f414e not found: ID does not exist" containerID="5ddb12104358f99045f943810a1b008cb083a1d8bbde47fe76bf97aa501f414e"
Sep 09 15:43:04.471374 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.471296    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ddb12104358f99045f943810a1b008cb083a1d8bbde47fe76bf97aa501f414e"} err="failed to get container status \"5ddb12104358f99045f943810a1b008cb083a1d8bbde47fe76bf97aa501f414e\": rpc error: code = NotFound desc = could not find container \"5ddb12104358f99045f943810a1b008cb083a1d8bbde47fe76bf97aa501f414e\": container with ID starting with 5ddb12104358f99045f943810a1b008cb083a1d8bbde47fe76bf97aa501f414e not found: ID does not exist"
Sep 09 15:43:04.471374 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.471317    2574 scope.go:117] "RemoveContainer" containerID="4e981d14687dea7d8155cba2a8e00f5da29807c4e97d82bdd1583cd6a43a55a8"
Sep 09 15:43:04.475084 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.475062    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"]
Sep 09 15:43:04.477935 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.477916    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-d36ac1-694fcd8687-w2n6c"]
Sep 09 15:43:04.481000 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.480983    2574 scope.go:117] "RemoveContainer" containerID="4e981d14687dea7d8155cba2a8e00f5da29807c4e97d82bdd1583cd6a43a55a8"
Sep 09 15:43:04.481331 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:43:04.481313    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e981d14687dea7d8155cba2a8e00f5da29807c4e97d82bdd1583cd6a43a55a8\": container with ID starting with 4e981d14687dea7d8155cba2a8e00f5da29807c4e97d82bdd1583cd6a43a55a8 not found: ID does not exist" containerID="4e981d14687dea7d8155cba2a8e00f5da29807c4e97d82bdd1583cd6a43a55a8"
Sep 09 15:43:04.481390 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.481339    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e981d14687dea7d8155cba2a8e00f5da29807c4e97d82bdd1583cd6a43a55a8"} err="failed to get container status \"4e981d14687dea7d8155cba2a8e00f5da29807c4e97d82bdd1583cd6a43a55a8\": rpc error: code = NotFound desc = could not find container \"4e981d14687dea7d8155cba2a8e00f5da29807c4e97d82bdd1583cd6a43a55a8\": container with ID starting with 4e981d14687dea7d8155cba2a8e00f5da29807c4e97d82bdd1583cd6a43a55a8 not found: ID does not exist"
Sep 09 15:43:04.485699 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.485680    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ffd1b75-1ee3-495e-a791-42436d9a4f8a-plugins-config-volume\") pod \"0ffd1b75-1ee3-495e-a791-42436d9a4f8a\" (UID: \"0ffd1b75-1ee3-495e-a791-42436d9a4f8a\") "
Sep 09 15:43:04.485777 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.485722    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4kdb\" (UniqueName: \"kubernetes.io/projected/0ffd1b75-1ee3-495e-a791-42436d9a4f8a-kube-api-access-c4kdb\") pod \"0ffd1b75-1ee3-495e-a791-42436d9a4f8a\" (UID: \"0ffd1b75-1ee3-495e-a791-42436d9a4f8a\") "
Sep 09 15:43:04.485818 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.485796    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8hlx\" (UniqueName: \"kubernetes.io/projected/7a850c36-d0ac-44ee-98f4-1eb85d7dca90-kube-api-access-b8hlx\") pod \"7a850c36-d0ac-44ee-98f4-1eb85d7dca90\" (UID: \"7a850c36-d0ac-44ee-98f4-1eb85d7dca90\") "
Sep 09 15:43:04.485899 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.485821    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a850c36-d0ac-44ee-98f4-1eb85d7dca90-plugins-config-volume\") pod \"7a850c36-d0ac-44ee-98f4-1eb85d7dca90\" (UID: \"7a850c36-d0ac-44ee-98f4-1eb85d7dca90\") "
Sep 09 15:43:04.486062 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.486040    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ffd1b75-1ee3-495e-a791-42436d9a4f8a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0ffd1b75-1ee3-495e-a791-42436d9a4f8a" (UID: "0ffd1b75-1ee3-495e-a791-42436d9a4f8a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:43:04.486213 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.486194    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a850c36-d0ac-44ee-98f4-1eb85d7dca90-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7a850c36-d0ac-44ee-98f4-1eb85d7dca90" (UID: "7a850c36-d0ac-44ee-98f4-1eb85d7dca90"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:43:04.486270 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.486210    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ffd1b75-1ee3-495e-a791-42436d9a4f8a-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:04.486270 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.486225    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hffn2\" (UniqueName: \"kubernetes.io/projected/b125924e-9fa9-402c-8a75-837182b60f1f-kube-api-access-hffn2\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:04.486270 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.486234    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b125924e-9fa9-402c-8a75-837182b60f1f-metrics-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:04.486270 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.486242    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b125924e-9fa9-402c-8a75-837182b60f1f-maas-api-tls\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:04.488045 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.488017    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a850c36-d0ac-44ee-98f4-1eb85d7dca90-kube-api-access-b8hlx" (OuterVolumeSpecName: "kube-api-access-b8hlx") pod "7a850c36-d0ac-44ee-98f4-1eb85d7dca90" (UID: "7a850c36-d0ac-44ee-98f4-1eb85d7dca90"). InnerVolumeSpecName "kube-api-access-b8hlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:43:04.488045 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.488040    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ffd1b75-1ee3-495e-a791-42436d9a4f8a-kube-api-access-c4kdb" (OuterVolumeSpecName: "kube-api-access-c4kdb") pod "0ffd1b75-1ee3-495e-a791-42436d9a4f8a" (UID: "0ffd1b75-1ee3-495e-a791-42436d9a4f8a"). InnerVolumeSpecName "kube-api-access-c4kdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:43:04.587459 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.587422    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4kdb\" (UniqueName: \"kubernetes.io/projected/0ffd1b75-1ee3-495e-a791-42436d9a4f8a-kube-api-access-c4kdb\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:04.587459 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.587452    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8hlx\" (UniqueName: \"kubernetes.io/projected/7a850c36-d0ac-44ee-98f4-1eb85d7dca90-kube-api-access-b8hlx\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:04.587459 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.587463    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a850c36-d0ac-44ee-98f4-1eb85d7dca90-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:04.772197 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.772168    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"]
Sep 09 15:43:04.776442 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.776415    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-d36ac1-787c98985d-44lsg"]
Sep 09 15:43:04.786248 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.786217    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"]
Sep 09 15:43:04.789996 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:04.789976    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-d36ac1-6c87477bc7-pw2hg"]
Sep 09 15:43:06.321055 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:06.321018    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ffd1b75-1ee3-495e-a791-42436d9a4f8a" path="/var/lib/kubelet/pods/0ffd1b75-1ee3-495e-a791-42436d9a4f8a/volumes"
Sep 09 15:43:06.321413 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:06.321400    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a850c36-d0ac-44ee-98f4-1eb85d7dca90" path="/var/lib/kubelet/pods/7a850c36-d0ac-44ee-98f4-1eb85d7dca90/volumes"
Sep 09 15:43:06.321750 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:06.321737    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b125924e-9fa9-402c-8a75-837182b60f1f" path="/var/lib/kubelet/pods/b125924e-9fa9-402c-8a75-837182b60f1f/volumes"
Sep 09 15:43:11.567009 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.566976    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"]
Sep 09 15:43:11.567433 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.567421    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a850c36-d0ac-44ee-98f4-1eb85d7dca90" containerName="payload-pre-processing"
Sep 09 15:43:11.567433 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.567435    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a850c36-d0ac-44ee-98f4-1eb85d7dca90" containerName="payload-pre-processing"
Sep 09 15:43:11.567517 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.567451    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ffd1b75-1ee3-495e-a791-42436d9a4f8a" containerName="payload-processing"
Sep 09 15:43:11.567517 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.567457    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ffd1b75-1ee3-495e-a791-42436d9a4f8a" containerName="payload-processing"
Sep 09 15:43:11.567517 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.567466    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51a4853b-c5b4-4b1e-a063-653b4771d39e" containerName="payload-pre-processing"
Sep 09 15:43:11.567517 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.567472    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="51a4853b-c5b4-4b1e-a063-653b4771d39e" containerName="payload-pre-processing"
Sep 09 15:43:11.567517 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.567481    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b125924e-9fa9-402c-8a75-837182b60f1f" containerName="maas-api"
Sep 09 15:43:11.567517 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.567487    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b125924e-9fa9-402c-8a75-837182b60f1f" containerName="maas-api"
Sep 09 15:43:11.567703 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.567557    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="51a4853b-c5b4-4b1e-a063-653b4771d39e" containerName="payload-pre-processing"
Sep 09 15:43:11.567703 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.567565    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b125924e-9fa9-402c-8a75-837182b60f1f" containerName="maas-api"
Sep 09 15:43:11.567703 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.567572    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a850c36-d0ac-44ee-98f4-1eb85d7dca90" containerName="payload-pre-processing"
Sep 09 15:43:11.567703 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.567579    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ffd1b75-1ee3-495e-a791-42436d9a4f8a" containerName="payload-processing"
Sep 09 15:43:11.572399 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.572375    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.576302 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.576274    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-1e15c8\"/\"openshift-service-ca.crt\""
Sep 09 15:43:11.576302 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.576275    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-1e15c8\"/\"default-dockercfg-qxwlq\""
Sep 09 15:43:11.576746 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.576724    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-1e15c8\"/\"distinct-w4-1e15c8-kserve-self-signed-certs\""
Sep 09 15:43:11.577028 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.576979    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-1e15c8\"/\"kube-root-ca.crt\""
Sep 09 15:43:11.579456 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.579434    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"]
Sep 09 15:43:11.758630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.758598    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-home\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.758817 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.758726    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de88fbbe-7606-4ae7-b86a-51d3463322e2-tls-certs\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.758817 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.758758    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f78qr\" (UniqueName: \"kubernetes.io/projected/de88fbbe-7606-4ae7-b86a-51d3463322e2-kube-api-access-f78qr\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.758817 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.758812    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-model-cache\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.759032 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.758948    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-dshm\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.759032 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.759001    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-tmp-dir\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.860396 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.860316    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-dshm\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.860396 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.860357    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-tmp-dir\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.860396 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.860379    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-home\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.860628 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.860435    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de88fbbe-7606-4ae7-b86a-51d3463322e2-tls-certs\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.860628 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.860454    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f78qr\" (UniqueName: \"kubernetes.io/projected/de88fbbe-7606-4ae7-b86a-51d3463322e2-kube-api-access-f78qr\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.860628 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.860501    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-model-cache\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.860873 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.860805    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-home\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.861032 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.860816    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-tmp-dir\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.861032 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.860905    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-model-cache\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.862817 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.862792    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-dshm\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.862995 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.862977    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de88fbbe-7606-4ae7-b86a-51d3463322e2-tls-certs\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.868976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.868955    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f78qr\" (UniqueName: \"kubernetes.io/projected/de88fbbe-7606-4ae7-b86a-51d3463322e2-kube-api-access-f78qr\") pod \"distinct-w4-1e15c8-kserve-6564f86b96-xhjvd\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") " pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:11.882968 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:11.882943    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:12.165378 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:12.165341    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"]
Sep 09 15:43:12.166647 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:43:12.166618    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde88fbbe_7606_4ae7_b86a_51d3463322e2.slice/crio-6ec2674ef9b30de9d373605d2079fe3d8ff888f4420aa531c34d93fcd30ffc3b WatchSource:0}: Error finding container 6ec2674ef9b30de9d373605d2079fe3d8ff888f4420aa531c34d93fcd30ffc3b: Status 404 returned error can't find the container with id 6ec2674ef9b30de9d373605d2079fe3d8ff888f4420aa531c34d93fcd30ffc3b
Sep 09 15:43:12.508459 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:12.508420    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd" event={"ID":"de88fbbe-7606-4ae7-b86a-51d3463322e2","Type":"ContainerStarted","Data":"8dc98d9322564a65ac16dbb39929405a60ec76b6c66464a8ffbac35ad4d8fc6a"}
Sep 09 15:43:12.508636 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:12.508469    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd" event={"ID":"de88fbbe-7606-4ae7-b86a-51d3463322e2","Type":"ContainerStarted","Data":"6ec2674ef9b30de9d373605d2079fe3d8ff888f4420aa531c34d93fcd30ffc3b"}
Sep 09 15:43:12.528111 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:12.528056    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd" podStartSLOduration=1.5280397190000001 podStartE2EDuration="1.528039719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:43:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:43:12.525539654 +0000 UTC m=+1376.715742436" watchObservedRunningTime="2026-09-09 15:43:12.528039719 +0000 UTC m=+1376.718242468"
Sep 09 15:43:17.719106 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.719070    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"]
Sep 09 15:43:17.724478 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.724455    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.727441 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.727409    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-ce3053-openshift-default-dockercfg-g8fgv\""
Sep 09 15:43:17.730163 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.730140    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"]
Sep 09 15:43:17.824335 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.824303    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-workload-socket\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.824547 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.824353    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-data\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.824547 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.824417    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnjtz\" (UniqueName: \"kubernetes.io/projected/7e6f3664-fb97-42ac-be4b-3fba79e73e08-kube-api-access-fnjtz\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.824547 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.824447    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-podinfo\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.824547 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.824530    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-workload-certs\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.824718 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.824580    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istiod-ca-cert\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.824718 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.824624    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-token\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.824718 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.824676    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-credential-socket\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.824816 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.824731    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-envoy\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.926295 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.926253    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-data\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.926504 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.926325    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnjtz\" (UniqueName: \"kubernetes.io/projected/7e6f3664-fb97-42ac-be4b-3fba79e73e08-kube-api-access-fnjtz\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.926504 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.926357    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-podinfo\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.926504 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.926405    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-workload-certs\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.926504 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.926438    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istiod-ca-cert\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.926504 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.926465    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-token\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.926823 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.926521    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-credential-socket\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.926823 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.926599    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-envoy\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.926823 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.926662    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-workload-socket\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.927078 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.927050    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-workload-certs\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.927143 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.927095    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-workload-socket\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.927354 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.927328    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-data\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.927927 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.927826    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-credential-socket\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.927927 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.927966    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istiod-ca-cert\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.930674 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.930579    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-podinfo\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.931354 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.931328    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-envoy\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.935597 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.935576    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-token\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:17.935829 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:17.935811    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnjtz\" (UniqueName: \"kubernetes.io/projected/7e6f3664-fb97-42ac-be4b-3fba79e73e08-kube-api-access-fnjtz\") pod \"e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") " pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:18.037947 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:18.037823    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:18.320283 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:43:18.320251    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e6f3664_fb97_42ac_be4b_3fba79e73e08.slice/crio-67c38d665e408e9aef4e7d4ab1ec43f18bd726625e3e1ac857647387ce028199 WatchSource:0}: Error finding container 67c38d665e408e9aef4e7d4ab1ec43f18bd726625e3e1ac857647387ce028199: Status 404 returned error can't find the container with id 67c38d665e408e9aef4e7d4ab1ec43f18bd726625e3e1ac857647387ce028199
Sep 09 15:43:18.322242 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:18.322221    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"]
Sep 09 15:43:18.322653 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:18.322620    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:43:18.322719 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:18.322706    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:43:18.322752 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:18.322739    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:43:18.546900 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:18.546832    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98" event={"ID":"7e6f3664-fb97-42ac-be4b-3fba79e73e08","Type":"ContainerStarted","Data":"44588b74c23498d9771ee3b6b8c7e41b6c10d9b3d5b72c33abdb22cc60fb85f6"}
Sep 09 15:43:18.547112 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:18.546927    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98" event={"ID":"7e6f3664-fb97-42ac-be4b-3fba79e73e08","Type":"ContainerStarted","Data":"67c38d665e408e9aef4e7d4ab1ec43f18bd726625e3e1ac857647387ce028199"}
Sep 09 15:43:18.568725 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:18.568588    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98" podStartSLOduration=1.568563255 podStartE2EDuration="1.568563255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:43:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:43:18.56443832 +0000 UTC m=+1382.754641093" watchObservedRunningTime="2026-09-09 15:43:18.568563255 +0000 UTC m=+1382.758766004"
Sep 09 15:43:19.038035 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:19.037997    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:19.043557 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:19.043530    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:19.553144 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:19.553112    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:19.554280 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:19.554259    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:21.651300 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.651259    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"]
Sep 09 15:43:21.655171 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.655152    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:21.657822 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.657795    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-ce3053-serving-cert\""
Sep 09 15:43:21.664459 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.664355    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"]
Sep 09 15:43:21.764901 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.764643    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4231318-06eb-4c6a-b579-577254bf1e04-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:21.764901 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.764699    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4231318-06eb-4c6a-b579-577254bf1e04-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:21.764901 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.764734    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj8fc\" (UniqueName: \"kubernetes.io/projected/c4231318-06eb-4c6a-b579-577254bf1e04-kube-api-access-lj8fc\") pod \"maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:21.765262 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.764954    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4231318-06eb-4c6a-b579-577254bf1e04-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:21.866264 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.866223    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4231318-06eb-4c6a-b579-577254bf1e04-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:21.866474 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.866332    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4231318-06eb-4c6a-b579-577254bf1e04-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:21.866474 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.866363    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4231318-06eb-4c6a-b579-577254bf1e04-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:21.866474 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.866392    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj8fc\" (UniqueName: \"kubernetes.io/projected/c4231318-06eb-4c6a-b579-577254bf1e04-kube-api-access-lj8fc\") pod \"maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:21.866635 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:43:21.866502    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-serving-cert: secret "maas-api-e2e-shared-a-w2-ce3053-serving-cert" not found
Sep 09 15:43:21.866635 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:43:21.866602    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4231318-06eb-4c6a-b579-577254bf1e04-maas-api-tls podName:c4231318-06eb-4c6a-b579-577254bf1e04 nodeName:}" failed. No retries permitted until 2026-09-09 15:43:22.366583771 +0000 UTC m=+1386.556786501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c4231318-06eb-4c6a-b579-577254bf1e04-maas-api-tls") pod "maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd" (UID: "c4231318-06eb-4c6a-b579-577254bf1e04") : secret "maas-api-e2e-shared-a-w2-ce3053-serving-cert" not found
Sep 09 15:43:21.866943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.866924    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4231318-06eb-4c6a-b579-577254bf1e04-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:21.869044 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.869028    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4231318-06eb-4c6a-b579-577254bf1e04-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:21.875222 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.875197    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj8fc\" (UniqueName: \"kubernetes.io/projected/c4231318-06eb-4c6a-b579-577254bf1e04-kube-api-access-lj8fc\") pod \"maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:21.884036 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.884007    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:21.884163 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.884061    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:21.897205 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:21.897171    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:22.371919 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.371883    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4231318-06eb-4c6a-b579-577254bf1e04-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:22.375139 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.375109    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4231318-06eb-4c6a-b579-577254bf1e04-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:22.409503 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.409450    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"]
Sep 09 15:43:22.414108 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.414085    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"
Sep 09 15:43:22.416653 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.416629    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-ce3053\""
Sep 09 15:43:22.416786 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.416653    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-ce3053-dockercfg-wc6f7\""
Sep 09 15:43:22.426139 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.426107    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"]
Sep 09 15:43:22.473062 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.473026    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj76g\" (UniqueName: \"kubernetes.io/projected/95478527-65df-46ca-9f93-90bc70449016-kube-api-access-dj76g\") pod \"payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj\" (UID: \"95478527-65df-46ca-9f93-90bc70449016\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"
Sep 09 15:43:22.473287 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.473257    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95478527-65df-46ca-9f93-90bc70449016-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj\" (UID: \"95478527-65df-46ca-9f93-90bc70449016\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"
Sep 09 15:43:22.571635 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.571607    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:22.574055 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.574023    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95478527-65df-46ca-9f93-90bc70449016-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj\" (UID: \"95478527-65df-46ca-9f93-90bc70449016\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"
Sep 09 15:43:22.574230 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.574081    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj76g\" (UniqueName: \"kubernetes.io/projected/95478527-65df-46ca-9f93-90bc70449016-kube-api-access-dj76g\") pod \"payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj\" (UID: \"95478527-65df-46ca-9f93-90bc70449016\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"
Sep 09 15:43:22.575195 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.574826    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95478527-65df-46ca-9f93-90bc70449016-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj\" (UID: \"95478527-65df-46ca-9f93-90bc70449016\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"
Sep 09 15:43:22.583771 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.583741    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj76g\" (UniqueName: \"kubernetes.io/projected/95478527-65df-46ca-9f93-90bc70449016-kube-api-access-dj76g\") pod \"payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj\" (UID: \"95478527-65df-46ca-9f93-90bc70449016\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"
Sep 09 15:43:22.587579 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.587553    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:43:22.729148 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.729096    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"
Sep 09 15:43:22.853336 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.853314    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"]
Sep 09 15:43:22.854951 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:43:22.854929    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4231318_06eb_4c6a_b579_577254bf1e04.slice/crio-c56d895044a478c481d6b22a0c7068f7e564aa19b710c94b8dda996dc8294db5 WatchSource:0}: Error finding container c56d895044a478c481d6b22a0c7068f7e564aa19b710c94b8dda996dc8294db5: Status 404 returned error can't find the container with id c56d895044a478c481d6b22a0c7068f7e564aa19b710c94b8dda996dc8294db5
Sep 09 15:43:22.856427 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:22.856409    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 15:43:23.010557 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:23.010535    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"]
Sep 09 15:43:23.012209 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:43:23.012182    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95478527_65df_46ca_9f93_90bc70449016.slice/crio-728703451b24c14c9eb4508a8a6a4f4053448b4fe7d28bbc7a23770c2b56d5dd WatchSource:0}: Error finding container 728703451b24c14c9eb4508a8a6a4f4053448b4fe7d28bbc7a23770c2b56d5dd: Status 404 returned error can't find the container with id 728703451b24c14c9eb4508a8a6a4f4053448b4fe7d28bbc7a23770c2b56d5dd
Sep 09 15:43:23.404924 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:23.404822    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:43:23.580793 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:23.580749    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd" event={"ID":"c4231318-06eb-4c6a-b579-577254bf1e04","Type":"ContainerStarted","Data":"c56d895044a478c481d6b22a0c7068f7e564aa19b710c94b8dda996dc8294db5"}
Sep 09 15:43:23.582479 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:23.582448    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj" event={"ID":"95478527-65df-46ca-9f93-90bc70449016","Type":"ContainerStarted","Data":"a61a3a399debd5c2114c222065b7794ee7817d3c00ca1b1ed19e1291211fdcd1"}
Sep 09 15:43:23.582640 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:23.582506    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj" event={"ID":"95478527-65df-46ca-9f93-90bc70449016","Type":"ContainerStarted","Data":"728703451b24c14c9eb4508a8a6a4f4053448b4fe7d28bbc7a23770c2b56d5dd"}
Sep 09 15:43:23.600217 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:23.600155    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj" podStartSLOduration=1.600131709 podStartE2EDuration="1.600131709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:43:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:43:23.599421434 +0000 UTC m=+1387.789624211" watchObservedRunningTime="2026-09-09 15:43:23.600131709 +0000 UTC m=+1387.790334459"
Sep 09 15:43:24.590638 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:24.590603    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd" event={"ID":"c4231318-06eb-4c6a-b579-577254bf1e04","Type":"ContainerStarted","Data":"1376ac11ca219ebff9df6fa41136c579027aa626847417fedbdb9975474ad469"}
Sep 09 15:43:24.591166 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:24.590987    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"
Sep 09 15:43:24.591166 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:24.591040    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:24.610784 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:24.610740    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd" podStartSLOduration=2.604303887 podStartE2EDuration="3.610726056s" totalImagesPullingTime="1.006422169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:43:24.606984293 +0000 UTC m=+1388.797187075" watchObservedRunningTime="2026-09-09 15:43:24.610726056 +0000 UTC m=+1388.800928814"
Sep 09 15:43:30.602675 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:30.602646    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:43:35.599035 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:35.599007    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"
Sep 09 15:43:47.264492 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:47.264452    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"]
Sep 09 15:43:47.264955 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:47.264684    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df" podUID="5152202d-00fc-4da5-9129-1a9195166999" containerName="istio-proxy" containerID="cri-o://445f154a6a7e86393da947d3f01ede5af219c659e8937289fa4e35bc61c5c7d5" gracePeriod=30
Sep 09 15:43:49.833906 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:49.833154    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": read tcp 10.133.0.2:37884->10.133.0.73:15021: read: connection reset by peer" start-of-body=
Sep 09 15:43:49.833906 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:49.833246    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98" podUID="7e6f3664-fb97-42ac-be4b-3fba79e73e08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": read tcp 10.133.0.2:37884->10.133.0.73:15021: read: connection reset by peer"
Sep 09 15:43:49.932675 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:49.932636    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:43:50.766215 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:50.766174    2574 generic.go:356] "Generic (PLEG): container finished" podID="7e6f3664-fb97-42ac-be4b-3fba79e73e08" containerID="44588b74c23498d9771ee3b6b8c7e41b6c10d9b3d5b72c33abdb22cc60fb85f6" exitCode=0
Sep 09 15:43:50.766396 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:50.766227    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98" event={"ID":"7e6f3664-fb97-42ac-be4b-3fba79e73e08","Type":"ContainerDied","Data":"44588b74c23498d9771ee3b6b8c7e41b6c10d9b3d5b72c33abdb22cc60fb85f6"}
Sep 09 15:43:50.766696 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:50.766681    2574 scope.go:117] "RemoveContainer" containerID="44588b74c23498d9771ee3b6b8c7e41b6c10d9b3d5b72c33abdb22cc60fb85f6"
Sep 09 15:43:50.768147 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:50.768108    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:43:50.768257 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:50.768186    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:43:50.768257 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:50.768217    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:43:51.145020 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:51.144922    2574 patch_prober.go:28] interesting pod/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 15:43:51.145020 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:51.144984    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df" podUID="5152202d-00fc-4da5-9129-1a9195166999" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 15:43:51.774856 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:51.774809    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98" event={"ID":"7e6f3664-fb97-42ac-be4b-3fba79e73e08","Type":"ContainerStarted","Data":"a835018262e21fba0ccbf6da79092dd85c8ee392820cfcdd73e966958c7643bc"}
Sep 09 15:43:52.038471 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.038381    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:52.038717 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.038694    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 09 15:43:52.038768 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.038744    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98" podUID="7e6f3664-fb97-42ac-be4b-3fba79e73e08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 09 15:43:52.237932 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.237887    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"]
Sep 09 15:43:52.241910 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.241889    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"
Sep 09 15:43:52.246200 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.246170    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-081ed3\""
Sep 09 15:43:52.246449 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.246182    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-081ed3-dockercfg-xdg9l\""
Sep 09 15:43:52.254010 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.253985    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"]
Sep 09 15:43:52.325670 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.324793    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pp7t\" (UniqueName: \"kubernetes.io/projected/f5f3cd29-6a52-4fde-9bf8-8199729d4d19-kube-api-access-5pp7t\") pod \"payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w\" (UID: \"f5f3cd29-6a52-4fde-9bf8-8199729d4d19\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"
Sep 09 15:43:52.325670 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.324885    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5f3cd29-6a52-4fde-9bf8-8199729d4d19-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w\" (UID: \"f5f3cd29-6a52-4fde-9bf8-8199729d4d19\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"
Sep 09 15:43:52.426059 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.426014    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5f3cd29-6a52-4fde-9bf8-8199729d4d19-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w\" (UID: \"f5f3cd29-6a52-4fde-9bf8-8199729d4d19\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"
Sep 09 15:43:52.426274 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.426252    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pp7t\" (UniqueName: \"kubernetes.io/projected/f5f3cd29-6a52-4fde-9bf8-8199729d4d19-kube-api-access-5pp7t\") pod \"payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w\" (UID: \"f5f3cd29-6a52-4fde-9bf8-8199729d4d19\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"
Sep 09 15:43:52.426917 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.426862    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5f3cd29-6a52-4fde-9bf8-8199729d4d19-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w\" (UID: \"f5f3cd29-6a52-4fde-9bf8-8199729d4d19\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"
Sep 09 15:43:52.434947 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.434922    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pp7t\" (UniqueName: \"kubernetes.io/projected/f5f3cd29-6a52-4fde-9bf8-8199729d4d19-kube-api-access-5pp7t\") pod \"payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w\" (UID: \"f5f3cd29-6a52-4fde-9bf8-8199729d4d19\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"
Sep 09 15:43:52.554378 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.554310    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"
Sep 09 15:43:52.555782 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.555764    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:43:52.628306 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.628266    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j68hw\" (UniqueName: \"kubernetes.io/projected/5152202d-00fc-4da5-9129-1a9195166999-kube-api-access-j68hw\") pod \"5152202d-00fc-4da5-9129-1a9195166999\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") "
Sep 09 15:43:52.628306 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.628307    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-workload-certs\") pod \"5152202d-00fc-4da5-9129-1a9195166999\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") "
Sep 09 15:43:52.628545 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.628338    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-credential-socket\") pod \"5152202d-00fc-4da5-9129-1a9195166999\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") "
Sep 09 15:43:52.628545 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.628370    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-istio-envoy\") pod \"5152202d-00fc-4da5-9129-1a9195166999\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") "
Sep 09 15:43:52.628545 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.628462    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-istio-data\") pod \"5152202d-00fc-4da5-9129-1a9195166999\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") "
Sep 09 15:43:52.628545 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.628525    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5152202d-00fc-4da5-9129-1a9195166999-istio-token\") pod \"5152202d-00fc-4da5-9129-1a9195166999\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") "
Sep 09 15:43:52.628732 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.628548    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-workload-socket\") pod \"5152202d-00fc-4da5-9129-1a9195166999\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") "
Sep 09 15:43:52.628732 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.628588    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5152202d-00fc-4da5-9129-1a9195166999-istiod-ca-cert\") pod \"5152202d-00fc-4da5-9129-1a9195166999\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") "
Sep 09 15:43:52.628732 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.628618    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5152202d-00fc-4da5-9129-1a9195166999-istio-podinfo\") pod \"5152202d-00fc-4da5-9129-1a9195166999\" (UID: \"5152202d-00fc-4da5-9129-1a9195166999\") "
Sep 09 15:43:52.628732 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.628621    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5152202d-00fc-4da5-9129-1a9195166999" (UID: "5152202d-00fc-4da5-9129-1a9195166999"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:43:52.629004 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.628800    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5152202d-00fc-4da5-9129-1a9195166999" (UID: "5152202d-00fc-4da5-9129-1a9195166999"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:43:52.629004 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.628861    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-istio-data" (OuterVolumeSpecName: "istio-data") pod "5152202d-00fc-4da5-9129-1a9195166999" (UID: "5152202d-00fc-4da5-9129-1a9195166999"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:43:52.629004 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.628933    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5152202d-00fc-4da5-9129-1a9195166999" (UID: "5152202d-00fc-4da5-9129-1a9195166999"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:43:52.629170 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.629109    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-workload-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:52.629170 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.629129    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-workload-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:52.629170 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.629144    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-credential-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:52.629170 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.629157    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-istio-data\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:52.629170 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.629158    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5152202d-00fc-4da5-9129-1a9195166999-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5152202d-00fc-4da5-9129-1a9195166999" (UID: "5152202d-00fc-4da5-9129-1a9195166999"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:43:52.631383 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.631358    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5152202d-00fc-4da5-9129-1a9195166999-istio-token" (OuterVolumeSpecName: "istio-token") pod "5152202d-00fc-4da5-9129-1a9195166999" (UID: "5152202d-00fc-4da5-9129-1a9195166999"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:43:52.631603 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.631579    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5152202d-00fc-4da5-9129-1a9195166999-kube-api-access-j68hw" (OuterVolumeSpecName: "kube-api-access-j68hw") pod "5152202d-00fc-4da5-9129-1a9195166999" (UID: "5152202d-00fc-4da5-9129-1a9195166999"). InnerVolumeSpecName "kube-api-access-j68hw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:43:52.631786 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.631762    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5152202d-00fc-4da5-9129-1a9195166999-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5152202d-00fc-4da5-9129-1a9195166999" (UID: "5152202d-00fc-4da5-9129-1a9195166999"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 15:43:52.632146 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.632126    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5152202d-00fc-4da5-9129-1a9195166999" (UID: "5152202d-00fc-4da5-9129-1a9195166999"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:43:52.730564 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.730524    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5152202d-00fc-4da5-9129-1a9195166999-istio-token\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:52.730564 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.730556    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5152202d-00fc-4da5-9129-1a9195166999-istiod-ca-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:52.730564 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.730565    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5152202d-00fc-4da5-9129-1a9195166999-istio-podinfo\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:52.730564 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.730573    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j68hw\" (UniqueName: \"kubernetes.io/projected/5152202d-00fc-4da5-9129-1a9195166999-kube-api-access-j68hw\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:52.730836 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.730583    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5152202d-00fc-4da5-9129-1a9195166999-istio-envoy\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:43:52.790542 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.790500    2574 generic.go:356] "Generic (PLEG): container finished" podID="5152202d-00fc-4da5-9129-1a9195166999" containerID="445f154a6a7e86393da947d3f01ede5af219c659e8937289fa4e35bc61c5c7d5" exitCode=0
Sep 09 15:43:52.790711 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.790557    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"
Sep 09 15:43:52.790711 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.790586    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df" event={"ID":"5152202d-00fc-4da5-9129-1a9195166999","Type":"ContainerDied","Data":"445f154a6a7e86393da947d3f01ede5af219c659e8937289fa4e35bc61c5c7d5"}
Sep 09 15:43:52.790711 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.790673    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df" event={"ID":"5152202d-00fc-4da5-9129-1a9195166999","Type":"ContainerDied","Data":"bb38f9945f23840790fc8aff379e5347d5da94ad923dc6ac12b64f93aa858cf2"}
Sep 09 15:43:52.790711 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.790707    2574 scope.go:117] "RemoveContainer" containerID="445f154a6a7e86393da947d3f01ede5af219c659e8937289fa4e35bc61c5c7d5"
Sep 09 15:43:52.828303 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.828280    2574 scope.go:117] "RemoveContainer" containerID="a7b1ca0d8a1e1ba1ab777ee5df1e3b26733489d610c712f34526999b4c5e9a96"
Sep 09 15:43:52.839417 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.839396    2574 scope.go:117] "RemoveContainer" containerID="445f154a6a7e86393da947d3f01ede5af219c659e8937289fa4e35bc61c5c7d5"
Sep 09 15:43:52.840221 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:43:52.840192    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"445f154a6a7e86393da947d3f01ede5af219c659e8937289fa4e35bc61c5c7d5\": container with ID starting with 445f154a6a7e86393da947d3f01ede5af219c659e8937289fa4e35bc61c5c7d5 not found: ID does not exist" containerID="445f154a6a7e86393da947d3f01ede5af219c659e8937289fa4e35bc61c5c7d5"
Sep 09 15:43:52.840374 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.840346    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445f154a6a7e86393da947d3f01ede5af219c659e8937289fa4e35bc61c5c7d5"} err="failed to get container status \"445f154a6a7e86393da947d3f01ede5af219c659e8937289fa4e35bc61c5c7d5\": rpc error: code = NotFound desc = could not find container \"445f154a6a7e86393da947d3f01ede5af219c659e8937289fa4e35bc61c5c7d5\": container with ID starting with 445f154a6a7e86393da947d3f01ede5af219c659e8937289fa4e35bc61c5c7d5 not found: ID does not exist"
Sep 09 15:43:52.840374 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.840372    2574 scope.go:117] "RemoveContainer" containerID="a7b1ca0d8a1e1ba1ab777ee5df1e3b26733489d610c712f34526999b4c5e9a96"
Sep 09 15:43:52.840529 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.840218    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"]
Sep 09 15:43:52.840707 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:43:52.840688    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7b1ca0d8a1e1ba1ab777ee5df1e3b26733489d610c712f34526999b4c5e9a96\": container with ID starting with a7b1ca0d8a1e1ba1ab777ee5df1e3b26733489d610c712f34526999b4c5e9a96 not found: ID does not exist" containerID="a7b1ca0d8a1e1ba1ab777ee5df1e3b26733489d610c712f34526999b4c5e9a96"
Sep 09 15:43:52.840772 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.840734    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7b1ca0d8a1e1ba1ab777ee5df1e3b26733489d610c712f34526999b4c5e9a96"} err="failed to get container status \"a7b1ca0d8a1e1ba1ab777ee5df1e3b26733489d610c712f34526999b4c5e9a96\": rpc error: code = NotFound desc = could not find container \"a7b1ca0d8a1e1ba1ab777ee5df1e3b26733489d610c712f34526999b4c5e9a96\": container with ID starting with a7b1ca0d8a1e1ba1ab777ee5df1e3b26733489d610c712f34526999b4c5e9a96 not found: ID does not exist"
Sep 09 15:43:52.850420 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.850393    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-d36ac1-openshift-default-855d7547fb-sj4df"]
Sep 09 15:43:52.862870 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:52.862818    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"]
Sep 09 15:43:52.864197 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:43:52.864176    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f3cd29_6a52_4fde_9bf8_8199729d4d19.slice/crio-d6adad478d9697dfcb5cfc1fcad5a3ab760077b4746c6f30b48eb26e0f8c77dc WatchSource:0}: Error finding container d6adad478d9697dfcb5cfc1fcad5a3ab760077b4746c6f30b48eb26e0f8c77dc: Status 404 returned error can't find the container with id d6adad478d9697dfcb5cfc1fcad5a3ab760077b4746c6f30b48eb26e0f8c77dc
Sep 09 15:43:53.038242 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:53.038208    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 09 15:43:53.038406 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:53.038269    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98" podUID="7e6f3664-fb97-42ac-be4b-3fba79e73e08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 09 15:43:53.800399 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:53.800360    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w" event={"ID":"f5f3cd29-6a52-4fde-9bf8-8199729d4d19","Type":"ContainerStarted","Data":"14b453b5fb61ca580c962e21a82c511aafbe5ff1fd473cca5cc923a1107a1e3f"}
Sep 09 15:43:53.800968 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:53.800424    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w" event={"ID":"f5f3cd29-6a52-4fde-9bf8-8199729d4d19","Type":"ContainerStarted","Data":"d6adad478d9697dfcb5cfc1fcad5a3ab760077b4746c6f30b48eb26e0f8c77dc"}
Sep 09 15:43:53.800968 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:53.800568    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"
Sep 09 15:43:53.823356 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:53.823286    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w" podStartSLOduration=1.823263514 podStartE2EDuration="1.823263514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:43:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:43:53.817969275 +0000 UTC m=+1418.008172050" watchObservedRunningTime="2026-09-09 15:43:53.823263514 +0000 UTC m=+1418.013466265"
Sep 09 15:43:54.039013 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:54.038970    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 09 15:43:54.039220 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:54.039055    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98" podUID="7e6f3664-fb97-42ac-be4b-3fba79e73e08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 09 15:43:54.324639 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:54.324603    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5152202d-00fc-4da5-9129-1a9195166999" path="/var/lib/kubelet/pods/5152202d-00fc-4da5-9129-1a9195166999/volumes"
Sep 09 15:43:55.038782 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:55.038746    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 09 15:43:55.039211 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:55.038811    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98" podUID="7e6f3664-fb97-42ac-be4b-3fba79e73e08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 09 15:43:56.038667 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:56.038623    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 09 15:43:56.039013 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:56.038691    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98" podUID="7e6f3664-fb97-42ac-be4b-3fba79e73e08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 09 15:43:57.042744 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:57.042713    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:57.043157 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:57.043078    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:43:57.043736 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:43:57.043721    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:44:04.816478 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:04.816444    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"
Sep 09 15:44:14.921194 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:14.921152    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:44:30.207800 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.207765    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"]
Sep 09 15:44:30.208315 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.208244    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5152202d-00fc-4da5-9129-1a9195166999" containerName="istio-proxy"
Sep 09 15:44:30.208315 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.208262    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5152202d-00fc-4da5-9129-1a9195166999" containerName="istio-proxy"
Sep 09 15:44:30.208399 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.208390    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5152202d-00fc-4da5-9129-1a9195166999" containerName="istio-proxy"
Sep 09 15:44:30.208434 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.208400    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5152202d-00fc-4da5-9129-1a9195166999" containerName="istio-proxy"
Sep 09 15:44:30.213118 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.213101    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.216562 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.216537    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-aeb0f8ca-openshift-default-dockercfg-5zhhd\""
Sep 09 15:44:30.231188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.231155    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"]
Sep 09 15:44:30.309997 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.309959    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/510f70d6-a782-43c0-a030-4e6562b403b9-istio-podinfo\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.309997 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.310000    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-istio-data\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.310279 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.310026    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/510f70d6-a782-43c0-a030-4e6562b403b9-istio-token\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.310279 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.310053    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-istio-envoy\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.310279 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.310164    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-workload-socket\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.310279 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.310192    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/510f70d6-a782-43c0-a030-4e6562b403b9-istiod-ca-cert\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.310279 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.310216    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-credential-socket\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.310279 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.310240    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vk7k\" (UniqueName: \"kubernetes.io/projected/510f70d6-a782-43c0-a030-4e6562b403b9-kube-api-access-8vk7k\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.310603 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.310284    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-workload-certs\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.411251 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.411212    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/510f70d6-a782-43c0-a030-4e6562b403b9-istio-podinfo\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.411251 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.411252    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-istio-data\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.411525 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.411344    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/510f70d6-a782-43c0-a030-4e6562b403b9-istio-token\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.411525 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.411372    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-istio-envoy\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.411525 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.411415    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-workload-socket\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.411525 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.411436    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/510f70d6-a782-43c0-a030-4e6562b403b9-istiod-ca-cert\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.411525 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.411468    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-credential-socket\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.411525 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.411500    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vk7k\" (UniqueName: \"kubernetes.io/projected/510f70d6-a782-43c0-a030-4e6562b403b9-kube-api-access-8vk7k\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.411886 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.411536    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-workload-certs\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.411967 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.411918    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-workload-socket\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.412155 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.412125    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-istio-data\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.412155 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.412147    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-workload-certs\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.412297 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.412126    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-credential-socket\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.412297 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.412280    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/510f70d6-a782-43c0-a030-4e6562b403b9-istiod-ca-cert\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.414351 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.414331    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-istio-envoy\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.414664 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.414646    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/510f70d6-a782-43c0-a030-4e6562b403b9-istio-podinfo\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.421627 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.421600    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/510f70d6-a782-43c0-a030-4e6562b403b9-istio-token\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.421938 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.421917    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vk7k\" (UniqueName: \"kubernetes.io/projected/510f70d6-a782-43c0-a030-4e6562b403b9-kube-api-access-8vk7k\") pod \"e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") " pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.524746 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.524666    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:30.815930 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.815510    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"]
Sep 09 15:44:30.836042 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:44:30.836010    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod510f70d6_a782_43c0_a030_4e6562b403b9.slice/crio-e37069bca38a87c48fe192e324b43782fe4f21f6c36cabf1cd6f6be432ef2330 WatchSource:0}: Error finding container e37069bca38a87c48fe192e324b43782fe4f21f6c36cabf1cd6f6be432ef2330: Status 404 returned error can't find the container with id e37069bca38a87c48fe192e324b43782fe4f21f6c36cabf1cd6f6be432ef2330
Sep 09 15:44:30.838411 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.838372    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:44:30.838507 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.838448    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:44:30.838507 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:30.838477    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:44:31.048121 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:31.048065    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d" event={"ID":"510f70d6-a782-43c0-a030-4e6562b403b9","Type":"ContainerStarted","Data":"be1777e1a64021443038b53742ebeaeaefd2ad32e55e49475c4078a9d83f9f6e"}
Sep 09 15:44:31.048296 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:31.048142    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d" event={"ID":"510f70d6-a782-43c0-a030-4e6562b403b9","Type":"ContainerStarted","Data":"e37069bca38a87c48fe192e324b43782fe4f21f6c36cabf1cd6f6be432ef2330"}
Sep 09 15:44:31.072073 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:31.071935    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d" podStartSLOduration=1.07191176 podStartE2EDuration="1.07191176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:44:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:44:31.067901221 +0000 UTC m=+1455.258103999" watchObservedRunningTime="2026-09-09 15:44:31.07191176 +0000 UTC m=+1455.262114510"
Sep 09 15:44:31.524924 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:31.524885    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:31.530465 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:31.530435    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:32.054970 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:32.054929    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:32.056190 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:32.056165    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:44:35.159956 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:35.159920    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"]
Sep 09 15:44:35.160407 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:35.160393    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5152202d-00fc-4da5-9129-1a9195166999" containerName="istio-proxy"
Sep 09 15:44:35.160453 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:35.160408    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5152202d-00fc-4da5-9129-1a9195166999" containerName="istio-proxy"
Sep 09 15:44:35.163798 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:35.163783    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"
Sep 09 15:44:35.166653 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:35.166630    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-aeb0f8ca\""
Sep 09 15:44:35.166802 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:35.166634    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-aeb0f8ca-dockercfg-cr8cz\""
Sep 09 15:44:35.173525 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:35.173499    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"]
Sep 09 15:44:35.278356 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:35.278321    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mspw\" (UniqueName: \"kubernetes.io/projected/d78d9f7c-e379-4e8f-867e-07e7e8a7fbae-kube-api-access-5mspw\") pod \"payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw\" (UID: \"d78d9f7c-e379-4e8f-867e-07e7e8a7fbae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"
Sep 09 15:44:35.278356 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:35.278365    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d78d9f7c-e379-4e8f-867e-07e7e8a7fbae-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw\" (UID: \"d78d9f7c-e379-4e8f-867e-07e7e8a7fbae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"
Sep 09 15:44:35.379952 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:35.379912    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mspw\" (UniqueName: \"kubernetes.io/projected/d78d9f7c-e379-4e8f-867e-07e7e8a7fbae-kube-api-access-5mspw\") pod \"payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw\" (UID: \"d78d9f7c-e379-4e8f-867e-07e7e8a7fbae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"
Sep 09 15:44:35.379952 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:35.379961    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d78d9f7c-e379-4e8f-867e-07e7e8a7fbae-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw\" (UID: \"d78d9f7c-e379-4e8f-867e-07e7e8a7fbae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"
Sep 09 15:44:35.380656 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:35.380635    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d78d9f7c-e379-4e8f-867e-07e7e8a7fbae-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw\" (UID: \"d78d9f7c-e379-4e8f-867e-07e7e8a7fbae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"
Sep 09 15:44:35.388650 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:35.388629    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mspw\" (UniqueName: \"kubernetes.io/projected/d78d9f7c-e379-4e8f-867e-07e7e8a7fbae-kube-api-access-5mspw\") pod \"payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw\" (UID: \"d78d9f7c-e379-4e8f-867e-07e7e8a7fbae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"
Sep 09 15:44:35.478598 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:35.478559    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"
Sep 09 15:44:35.756054 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:35.756030    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"]
Sep 09 15:44:35.757494 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:44:35.757465    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd78d9f7c_e379_4e8f_867e_07e7e8a7fbae.slice/crio-572a7b6bf9d4feead0557a99beeb7a7c761f8820e7fe5e23bf7b015ffa00af19 WatchSource:0}: Error finding container 572a7b6bf9d4feead0557a99beeb7a7c761f8820e7fe5e23bf7b015ffa00af19: Status 404 returned error can't find the container with id 572a7b6bf9d4feead0557a99beeb7a7c761f8820e7fe5e23bf7b015ffa00af19
Sep 09 15:44:36.080550 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:36.080453    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw" event={"ID":"d78d9f7c-e379-4e8f-867e-07e7e8a7fbae","Type":"ContainerStarted","Data":"d76d296268fd56de9adc14f8d2b9c3f024b29124cbb3dfbe4ae5940c12ce4806"}
Sep 09 15:44:36.080550 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:36.080507    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw" event={"ID":"d78d9f7c-e379-4e8f-867e-07e7e8a7fbae","Type":"ContainerStarted","Data":"572a7b6bf9d4feead0557a99beeb7a7c761f8820e7fe5e23bf7b015ffa00af19"}
Sep 09 15:44:36.080737 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:36.080581    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"
Sep 09 15:44:36.100739 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:36.100683    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw" podStartSLOduration=1.100666693 podStartE2EDuration="1.100666693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:44:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:44:36.099201349 +0000 UTC m=+1460.289404098" watchObservedRunningTime="2026-09-09 15:44:36.100666693 +0000 UTC m=+1460.290869441"
Sep 09 15:44:47.089030 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:47.088999    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"
Sep 09 15:44:48.205792 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:48.201594    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:44:59.227300 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:59.227247    2574 generic.go:356] "Generic (PLEG): container finished" podID="510f70d6-a782-43c0-a030-4e6562b403b9" containerID="be1777e1a64021443038b53742ebeaeaefd2ad32e55e49475c4078a9d83f9f6e" exitCode=0
Sep 09 15:44:59.227825 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:59.227337    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d" event={"ID":"510f70d6-a782-43c0-a030-4e6562b403b9","Type":"ContainerDied","Data":"be1777e1a64021443038b53742ebeaeaefd2ad32e55e49475c4078a9d83f9f6e"}
Sep 09 15:44:59.227935 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:59.227890    2574 scope.go:117] "RemoveContainer" containerID="be1777e1a64021443038b53742ebeaeaefd2ad32e55e49475c4078a9d83f9f6e"
Sep 09 15:44:59.229418 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:59.229391    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:44:59.229504 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:59.229455    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:44:59.229504 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:44:59.229489    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:45:00.150140 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.150103    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ce3053-29816145-gljk5"]
Sep 09 15:45:00.157833 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.154754    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ce3053-29816145-gljk5"
Sep 09 15:45:00.157833 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.156826    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-df30be-29816145-rkqk9"]
Sep 09 15:45:00.161071 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.159543    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2zlsf\""
Sep 09 15:45:00.167720 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.167691    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-df30be-29816145-rkqk9"
Sep 09 15:45:00.171348 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.171321    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-df30be-29816145-rkqk9"]
Sep 09 15:45:00.175930 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.175904    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ce3053-29816145-gljk5"
Sep 09 15:45:00.176060 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.175914    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ce3053-29816145-gljk5"]
Sep 09 15:45:00.180907 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.180880    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b579-29816145-jxz5w"]
Sep 09 15:45:00.190060 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.190032    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-df30be-29816145-rkqk9"
Sep 09 15:45:00.190322 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.190303    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b579-29816145-jxz5w"
Sep 09 15:45:00.193799 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.193774    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b579-29816145-jxz5w"]
Sep 09 15:45:00.240461 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.240428    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b579-29816145-jxz5w"
Sep 09 15:45:00.244480 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.244452    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d" event={"ID":"510f70d6-a782-43c0-a030-4e6562b403b9","Type":"ContainerStarted","Data":"ef8b5aaaf3dc6b9554b9cfa8bda9cf3335a4342c5b488d4a83050e787f671a14"}
Sep 09 15:45:00.475976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.475950    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ce3053-29816145-gljk5"]
Sep 09 15:45:00.476831 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:45:00.476803    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod532fb71d_af21_4233_b007_985b12035973.slice/crio-9dcb245bf42701a0665b75df9caa8f18424cbbf3ecf61958d75354ae21d044b0 WatchSource:0}: Error finding container 9dcb245bf42701a0665b75df9caa8f18424cbbf3ecf61958d75354ae21d044b0: Status 404 returned error can't find the container with id 9dcb245bf42701a0665b75df9caa8f18424cbbf3ecf61958d75354ae21d044b0
Sep 09 15:45:00.501945 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.501920    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-df30be-29816145-rkqk9"]
Sep 09 15:45:00.502947 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:45:00.502921    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43865284_173b_4572_b837_7a80b8cc3168.slice/crio-50cdfb29ada891412a67cd3de86d4a2b71c47d1a109b8cbb681bde796ae20532 WatchSource:0}: Error finding container 50cdfb29ada891412a67cd3de86d4a2b71c47d1a109b8cbb681bde796ae20532: Status 404 returned error can't find the container with id 50cdfb29ada891412a67cd3de86d4a2b71c47d1a109b8cbb681bde796ae20532
Sep 09 15:45:00.525594 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.525564    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:45:00.526650 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.526627    2574 patch_prober.go:28] interesting pod/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 09 15:45:00.526751 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.526682    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d" podUID="510f70d6-a782-43c0-a030-4e6562b403b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 09 15:45:00.550770 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:00.550732    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b579-29816145-jxz5w"]
Sep 09 15:45:00.552188 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:45:00.552160    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d16e4f_abaa_4349_820e_a8a8e8000550.slice/crio-d67bda33e3c32d46404e6d1395d9a9eb5e27884f254dcb1dd620fc361e1509d5 WatchSource:0}: Error finding container d67bda33e3c32d46404e6d1395d9a9eb5e27884f254dcb1dd620fc361e1509d5: Status 404 returned error can't find the container with id d67bda33e3c32d46404e6d1395d9a9eb5e27884f254dcb1dd620fc361e1509d5
Sep 09 15:45:01.251922 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:01.251886    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-df30be-29816145-rkqk9" event={"ID":"43865284-173b-4572-b837-7a80b8cc3168","Type":"ContainerStarted","Data":"50cdfb29ada891412a67cd3de86d4a2b71c47d1a109b8cbb681bde796ae20532"}
Sep 09 15:45:01.253280 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:01.253252    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ce3053-29816145-gljk5" event={"ID":"532fb71d-af21-4233-b007-985b12035973","Type":"ContainerStarted","Data":"9dcb245bf42701a0665b75df9caa8f18424cbbf3ecf61958d75354ae21d044b0"}
Sep 09 15:45:01.254447 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:01.254428    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b579-29816145-jxz5w" event={"ID":"a6d16e4f-abaa-4349-820e-a8a8e8000550","Type":"ContainerStarted","Data":"d67bda33e3c32d46404e6d1395d9a9eb5e27884f254dcb1dd620fc361e1509d5"}
Sep 09 15:45:01.525526 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:01.525405    2574 patch_prober.go:28] interesting pod/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 09 15:45:01.525676 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:01.525534    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d" podUID="510f70d6-a782-43c0-a030-4e6562b403b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 09 15:45:02.055201 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:02.055124    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:45:02.525356 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:02.525308    2574 patch_prober.go:28] interesting pod/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 09 15:45:02.525866 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:02.525395    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d" podUID="510f70d6-a782-43c0-a030-4e6562b403b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 09 15:45:03.526889 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:03.526476    2574 patch_prober.go:28] interesting pod/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 09 15:45:03.526889 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:03.526560    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d" podUID="510f70d6-a782-43c0-a030-4e6562b403b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 09 15:45:04.275882 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.275823    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-df30be-29816145-rkqk9" event={"ID":"43865284-173b-4572-b837-7a80b8cc3168","Type":"ContainerStarted","Data":"cc13298e2ed9d74c08030a57d52bdabc3f522f9a062e69aef89f49e5ad23a63c"}
Sep 09 15:45:04.440935 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.440873    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-df30be-29816145-rkqk9" podStartSLOduration=1.6557779799999999 podStartE2EDuration="4.44081753s" totalImagesPullingTime="2.78503955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:45:04.307253967 +0000 UTC m=+1488.497456717" watchObservedRunningTime="2026-09-09 15:45:04.44081753 +0000 UTC m=+1488.631020280"
Sep 09 15:45:04.443360 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.443330    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"]
Sep 09 15:45:04.444166 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.443779    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr" podUID="9dd1ffb7-d00e-416f-8a90-a9636d3bbe21" containerName="maas-api" containerID="cri-o://6fb3481ccabee8730f4c986df66872d4d87e608b90fece35b21953a194cd1cb0" gracePeriod=30
Sep 09 15:45:04.494991 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.494956    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b579-29816145-jxz5w"]
Sep 09 15:45:04.537259 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.537007    2574 patch_prober.go:28] interesting pod/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 09 15:45:04.537259 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.537082    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d" podUID="510f70d6-a782-43c0-a030-4e6562b403b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 09 15:45:04.840782 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.840520    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:45:04.893246 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.893213    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-metrics-certs\") pod \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") "
Sep 09 15:45:04.893246 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.893256    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztphc\" (UniqueName: \"kubernetes.io/projected/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-kube-api-access-ztphc\") pod \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") "
Sep 09 15:45:04.893520 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.893296    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-maas-api-tls\") pod \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") "
Sep 09 15:45:04.893520 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.893359    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-openshift-service-ca\") pod \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\" (UID: \"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21\") "
Sep 09 15:45:04.894049 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.894010    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9dd1ffb7-d00e-416f-8a90-a9636d3bbe21" (UID: "9dd1ffb7-d00e-416f-8a90-a9636d3bbe21"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:45:04.909465 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.909397    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9dd1ffb7-d00e-416f-8a90-a9636d3bbe21" (UID: "9dd1ffb7-d00e-416f-8a90-a9636d3bbe21"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:45:04.911034 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.910966    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9dd1ffb7-d00e-416f-8a90-a9636d3bbe21" (UID: "9dd1ffb7-d00e-416f-8a90-a9636d3bbe21"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:45:04.918867 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.916006    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-kube-api-access-ztphc" (OuterVolumeSpecName: "kube-api-access-ztphc") pod "9dd1ffb7-d00e-416f-8a90-a9636d3bbe21" (UID: "9dd1ffb7-d00e-416f-8a90-a9636d3bbe21"). InnerVolumeSpecName "kube-api-access-ztphc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:45:04.995160 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.995127    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-metrics-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:45:04.995160 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.995161    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztphc\" (UniqueName: \"kubernetes.io/projected/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-kube-api-access-ztphc\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:45:04.995379 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.995178    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-maas-api-tls\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:45:04.995379 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:04.995191    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21-openshift-service-ca\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:45:05.283607 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.283569    2574 generic.go:356] "Generic (PLEG): container finished" podID="43865284-173b-4572-b837-7a80b8cc3168" containerID="cc13298e2ed9d74c08030a57d52bdabc3f522f9a062e69aef89f49e5ad23a63c" exitCode=0
Sep 09 15:45:05.283903 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.283736    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-df30be-29816145-rkqk9" event={"ID":"43865284-173b-4572-b837-7a80b8cc3168","Type":"ContainerDied","Data":"cc13298e2ed9d74c08030a57d52bdabc3f522f9a062e69aef89f49e5ad23a63c"}
Sep 09 15:45:05.285786 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.285761    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b579-29816145-jxz5w" event={"ID":"a6d16e4f-abaa-4349-820e-a8a8e8000550","Type":"ContainerStarted","Data":"2726146aafe35fe9ac977ba26f6b6aff4a2ac2d02a600927a751a04aafcfaa67"}
Sep 09 15:45:05.285945 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.285786    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b579-29816145-jxz5w" podUID="a6d16e4f-abaa-4349-820e-a8a8e8000550" containerName="cleanup" containerID="cri-o://2726146aafe35fe9ac977ba26f6b6aff4a2ac2d02a600927a751a04aafcfaa67" gracePeriod=30
Sep 09 15:45:05.287507 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.287484    2574 generic.go:356] "Generic (PLEG): container finished" podID="9dd1ffb7-d00e-416f-8a90-a9636d3bbe21" containerID="6fb3481ccabee8730f4c986df66872d4d87e608b90fece35b21953a194cd1cb0" exitCode=0
Sep 09 15:45:05.287610 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.287523    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr" event={"ID":"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21","Type":"ContainerDied","Data":"6fb3481ccabee8730f4c986df66872d4d87e608b90fece35b21953a194cd1cb0"}
Sep 09 15:45:05.287610 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.287531    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"
Sep 09 15:45:05.287610 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.287553    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr" event={"ID":"9dd1ffb7-d00e-416f-8a90-a9636d3bbe21","Type":"ContainerDied","Data":"fb7bde8e7985f4b95c68ce791f023ec146d7e75afb8d484ea343413b6852cc47"}
Sep 09 15:45:05.287610 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.287574    2574 scope.go:117] "RemoveContainer" containerID="6fb3481ccabee8730f4c986df66872d4d87e608b90fece35b21953a194cd1cb0"
Sep 09 15:45:05.309883 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.306014    2574 scope.go:117] "RemoveContainer" containerID="6fb3481ccabee8730f4c986df66872d4d87e608b90fece35b21953a194cd1cb0"
Sep 09 15:45:05.309883 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:45:05.306403    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fb3481ccabee8730f4c986df66872d4d87e608b90fece35b21953a194cd1cb0\": container with ID starting with 6fb3481ccabee8730f4c986df66872d4d87e608b90fece35b21953a194cd1cb0 not found: ID does not exist" containerID="6fb3481ccabee8730f4c986df66872d4d87e608b90fece35b21953a194cd1cb0"
Sep 09 15:45:05.309883 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.306438    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fb3481ccabee8730f4c986df66872d4d87e608b90fece35b21953a194cd1cb0"} err="failed to get container status \"6fb3481ccabee8730f4c986df66872d4d87e608b90fece35b21953a194cd1cb0\": rpc error: code = NotFound desc = could not find container \"6fb3481ccabee8730f4c986df66872d4d87e608b90fece35b21953a194cd1cb0\": container with ID starting with 6fb3481ccabee8730f4c986df66872d4d87e608b90fece35b21953a194cd1cb0 not found: ID does not exist"
Sep 09 15:45:05.323374 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.323343    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"]
Sep 09 15:45:05.329332 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.329304    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57b579-54fdd76c7-l9lwr"]
Sep 09 15:45:05.346212 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.346166    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b579-29816145-jxz5w" podStartSLOduration=1.5134456219999999 podStartE2EDuration="5.3461486s" totalImagesPullingTime="3.832702978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:45:05.343942144 +0000 UTC m=+1489.534144892" watchObservedRunningTime="2026-09-09 15:45:05.3461486 +0000 UTC m=+1489.536351350"
Sep 09 15:45:05.525779 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.525708    2574 patch_prober.go:28] interesting pod/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 09 15:45:05.526011 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.525782    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d" podUID="510f70d6-a782-43c0-a030-4e6562b403b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 09 15:45:05.689296 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:05.689272    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b579-29816145-jxz5w"
Sep 09 15:45:06.295279 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:06.295248    2574 generic.go:356] "Generic (PLEG): container finished" podID="a6d16e4f-abaa-4349-820e-a8a8e8000550" containerID="2726146aafe35fe9ac977ba26f6b6aff4a2ac2d02a600927a751a04aafcfaa67" exitCode=6
Sep 09 15:45:06.295458 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:06.295297    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b579-29816145-jxz5w"
Sep 09 15:45:06.295458 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:06.295337    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b579-29816145-jxz5w" event={"ID":"a6d16e4f-abaa-4349-820e-a8a8e8000550","Type":"ContainerDied","Data":"2726146aafe35fe9ac977ba26f6b6aff4a2ac2d02a600927a751a04aafcfaa67"}
Sep 09 15:45:06.295458 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:06.295401    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b579-29816145-jxz5w" event={"ID":"a6d16e4f-abaa-4349-820e-a8a8e8000550","Type":"ContainerDied","Data":"d67bda33e3c32d46404e6d1395d9a9eb5e27884f254dcb1dd620fc361e1509d5"}
Sep 09 15:45:06.295458 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:06.295437    2574 scope.go:117] "RemoveContainer" containerID="2726146aafe35fe9ac977ba26f6b6aff4a2ac2d02a600927a751a04aafcfaa67"
Sep 09 15:45:06.308462 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:06.308441    2574 scope.go:117] "RemoveContainer" containerID="2726146aafe35fe9ac977ba26f6b6aff4a2ac2d02a600927a751a04aafcfaa67"
Sep 09 15:45:06.308908 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:45:06.308886    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2726146aafe35fe9ac977ba26f6b6aff4a2ac2d02a600927a751a04aafcfaa67\": container with ID starting with 2726146aafe35fe9ac977ba26f6b6aff4a2ac2d02a600927a751a04aafcfaa67 not found: ID does not exist" containerID="2726146aafe35fe9ac977ba26f6b6aff4a2ac2d02a600927a751a04aafcfaa67"
Sep 09 15:45:06.308974 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:06.308919    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2726146aafe35fe9ac977ba26f6b6aff4a2ac2d02a600927a751a04aafcfaa67"} err="failed to get container status \"2726146aafe35fe9ac977ba26f6b6aff4a2ac2d02a600927a751a04aafcfaa67\": rpc error: code = NotFound desc = could not find container \"2726146aafe35fe9ac977ba26f6b6aff4a2ac2d02a600927a751a04aafcfaa67\": container with ID starting with 2726146aafe35fe9ac977ba26f6b6aff4a2ac2d02a600927a751a04aafcfaa67 not found: ID does not exist"
Sep 09 15:45:06.323078 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:06.323032    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dd1ffb7-d00e-416f-8a90-a9636d3bbe21" path="/var/lib/kubelet/pods/9dd1ffb7-d00e-416f-8a90-a9636d3bbe21/volumes"
Sep 09 15:45:06.323461 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:06.323435    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b579-29816145-jxz5w"]
Sep 09 15:45:06.326625 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:06.326593    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b579-29816145-jxz5w"]
Sep 09 15:45:06.465058 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:06.465032    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-df30be-29816145-rkqk9"
Sep 09 15:45:06.529886 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:06.529836    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:45:06.531056 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:06.531034    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:45:07.307552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:07.307515    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ce3053-29816145-gljk5" event={"ID":"532fb71d-af21-4233-b007-985b12035973","Type":"ContainerStarted","Data":"7bbae5a84b4404e44cd2d229771e7efa2a06e2d250d4a8647fea23198c0fb165"}
Sep 09 15:45:07.310024 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:07.309999    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-df30be-29816145-rkqk9"
Sep 09 15:45:07.310161 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:07.310037    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-df30be-29816145-rkqk9" event={"ID":"43865284-173b-4572-b837-7a80b8cc3168","Type":"ContainerDied","Data":"50cdfb29ada891412a67cd3de86d4a2b71c47d1a109b8cbb681bde796ae20532"}
Sep 09 15:45:07.310161 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:07.310079    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50cdfb29ada891412a67cd3de86d4a2b71c47d1a109b8cbb681bde796ae20532"
Sep 09 15:45:07.324474 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:07.324427    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ce3053-29816145-gljk5" podStartSLOduration=1.234484004 podStartE2EDuration="7.324409282s" totalImagesPullingTime="6.089925278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:45:07.322681374 +0000 UTC m=+1491.512884124" watchObservedRunningTime="2026-09-09 15:45:07.324409282 +0000 UTC m=+1491.514612047"
Sep 09 15:45:08.318354 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:08.318314    2574 generic.go:356] "Generic (PLEG): container finished" podID="532fb71d-af21-4233-b007-985b12035973" containerID="7bbae5a84b4404e44cd2d229771e7efa2a06e2d250d4a8647fea23198c0fb165" exitCode=0
Sep 09 15:45:08.321341 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:08.321317    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6d16e4f-abaa-4349-820e-a8a8e8000550" path="/var/lib/kubelet/pods/a6d16e4f-abaa-4349-820e-a8a8e8000550/volumes"
Sep 09 15:45:08.321609 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:08.321590    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ce3053-29816145-gljk5" event={"ID":"532fb71d-af21-4233-b007-985b12035973","Type":"ContainerDied","Data":"7bbae5a84b4404e44cd2d229771e7efa2a06e2d250d4a8647fea23198c0fb165"}
Sep 09 15:45:09.473317 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:09.473289    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ce3053-29816145-gljk5"
Sep 09 15:45:10.331837 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:10.331808    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ce3053-29816145-gljk5" event={"ID":"532fb71d-af21-4233-b007-985b12035973","Type":"ContainerDied","Data":"9dcb245bf42701a0665b75df9caa8f18424cbbf3ecf61958d75354ae21d044b0"}
Sep 09 15:45:10.331984 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:10.331834    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ce3053-29816145-gljk5"
Sep 09 15:45:10.331984 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:10.331875    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9dcb245bf42701a0665b75df9caa8f18424cbbf3ecf61958d75354ae21d044b0"
Sep 09 15:45:14.199318 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:14.199278    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:45:29.955532 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.955494    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"]
Sep 09 15:45:29.956203 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.956181    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="532fb71d-af21-4233-b007-985b12035973" containerName="cleanup"
Sep 09 15:45:29.956323 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.956207    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="532fb71d-af21-4233-b007-985b12035973" containerName="cleanup"
Sep 09 15:45:29.956323 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.956223    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d16e4f-abaa-4349-820e-a8a8e8000550" containerName="cleanup"
Sep 09 15:45:29.956323 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.956231    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d16e4f-abaa-4349-820e-a8a8e8000550" containerName="cleanup"
Sep 09 15:45:29.956323 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.956254    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43865284-173b-4572-b837-7a80b8cc3168" containerName="cleanup"
Sep 09 15:45:29.956323 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.956262    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="43865284-173b-4572-b837-7a80b8cc3168" containerName="cleanup"
Sep 09 15:45:29.956323 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.956282    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd1ffb7-d00e-416f-8a90-a9636d3bbe21" containerName="maas-api"
Sep 09 15:45:29.956323 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.956289    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd1ffb7-d00e-416f-8a90-a9636d3bbe21" containerName="maas-api"
Sep 09 15:45:29.956688 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.956415    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6d16e4f-abaa-4349-820e-a8a8e8000550" containerName="cleanup"
Sep 09 15:45:29.956688 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.956428    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="532fb71d-af21-4233-b007-985b12035973" containerName="cleanup"
Sep 09 15:45:29.956688 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.956439    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dd1ffb7-d00e-416f-8a90-a9636d3bbe21" containerName="maas-api"
Sep 09 15:45:29.956688 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.956453    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="43865284-173b-4572-b837-7a80b8cc3168" containerName="cleanup"
Sep 09 15:45:29.961316 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.961288    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:29.965304 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.965249    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-a0938b\"/\"kube-root-ca.crt\""
Sep 09 15:45:29.965304 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.965301    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-a0938b\"/\"default-dockercfg-nsj44\""
Sep 09 15:45:29.965542 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.965323    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-a0938b\"/\"noten-model-a0938b-kserve-self-signed-certs\""
Sep 09 15:45:29.965619 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.965579    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-a0938b\"/\"openshift-service-ca.crt\""
Sep 09 15:45:29.970322 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:29.970115    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"]
Sep 09 15:45:30.079567 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.079524    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-home\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.079567 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.079571    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-model-cache\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.079884 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.079692    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-dshm\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.079884 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.079738    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-tmp-dir\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.079884 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.079816    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4378c116-c931-4e85-ab4e-b5eef416335f-tls-certs\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.080027 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.079926    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztzsh\" (UniqueName: \"kubernetes.io/projected/4378c116-c931-4e85-ab4e-b5eef416335f-kube-api-access-ztzsh\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.180707 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.180664    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-dshm\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.180707 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.180710    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-tmp-dir\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.180999 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.180749    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4378c116-c931-4e85-ab4e-b5eef416335f-tls-certs\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.180999 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.180785    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztzsh\" (UniqueName: \"kubernetes.io/projected/4378c116-c931-4e85-ab4e-b5eef416335f-kube-api-access-ztzsh\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.180999 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.180831    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-home\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.180999 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.180899    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-model-cache\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.181203 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.181164    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-tmp-dir\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.181203 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.181193    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-model-cache\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.181306 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.181231    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-home\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.183277 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.183237    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-dshm\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.183392 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.183366    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4378c116-c931-4e85-ab4e-b5eef416335f-tls-certs\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.189395 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.189378    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztzsh\" (UniqueName: \"kubernetes.io/projected/4378c116-c931-4e85-ab4e-b5eef416335f-kube-api-access-ztzsh\") pod \"noten-model-a0938b-kserve-777fb75ddc-xz8r4\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") " pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.273160 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.273051    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:30.549775 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:30.549745    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"]
Sep 09 15:45:30.551265 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:45:30.551232    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4378c116_c931_4e85_ab4e_b5eef416335f.slice/crio-2663360bc826f4042d3224cd00a82a1f8090ee5b00f896c26eb40921eeba2bae WatchSource:0}: Error finding container 2663360bc826f4042d3224cd00a82a1f8090ee5b00f896c26eb40921eeba2bae: Status 404 returned error can't find the container with id 2663360bc826f4042d3224cd00a82a1f8090ee5b00f896c26eb40921eeba2bae
Sep 09 15:45:31.477239 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:31.477201    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4" event={"ID":"4378c116-c931-4e85-ab4e-b5eef416335f","Type":"ContainerStarted","Data":"126aa09a24390b5ce7484b8b6b2dc6fa37b855931f689ac9704814e2c97b537e"}
Sep 09 15:45:31.477239 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:31.477247    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4" event={"ID":"4378c116-c931-4e85-ab4e-b5eef416335f","Type":"ContainerStarted","Data":"2663360bc826f4042d3224cd00a82a1f8090ee5b00f896c26eb40921eeba2bae"}
Sep 09 15:45:31.499713 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:31.499653    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4" podStartSLOduration=2.499635121 podStartE2EDuration="2.499635121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:45:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:45:31.496260277 +0000 UTC m=+1515.686463027" watchObservedRunningTime="2026-09-09 15:45:31.499635121 +0000 UTC m=+1515.689837885"
Sep 09 15:45:40.273877 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:40.273756    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:40.273877 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:40.273809    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:40.286978 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:40.286946    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:40.547236 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:40.547149    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:45:58.020791 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.020749    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"]
Sep 09 15:45:58.021399 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.021042    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5" podUID="1c640c28-d3b6-4de8-b8e3-178ccf26329f" containerName="payload-processing" containerID="cri-o://532f3787d2b7f80324ee24962c7b33f78907b059e0882811ac122633c1ec149d" gracePeriod=30
Sep 09 15:45:58.301539 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.301510    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"
Sep 09 15:45:58.378236 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.378202    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcswf\" (UniqueName: \"kubernetes.io/projected/1c640c28-d3b6-4de8-b8e3-178ccf26329f-kube-api-access-gcswf\") pod \"1c640c28-d3b6-4de8-b8e3-178ccf26329f\" (UID: \"1c640c28-d3b6-4de8-b8e3-178ccf26329f\") "
Sep 09 15:45:58.378436 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.378325    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c640c28-d3b6-4de8-b8e3-178ccf26329f-plugins-config-volume\") pod \"1c640c28-d3b6-4de8-b8e3-178ccf26329f\" (UID: \"1c640c28-d3b6-4de8-b8e3-178ccf26329f\") "
Sep 09 15:45:58.378756 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.378726    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c640c28-d3b6-4de8-b8e3-178ccf26329f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1c640c28-d3b6-4de8-b8e3-178ccf26329f" (UID: "1c640c28-d3b6-4de8-b8e3-178ccf26329f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:45:58.380888 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.380837    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c640c28-d3b6-4de8-b8e3-178ccf26329f-kube-api-access-gcswf" (OuterVolumeSpecName: "kube-api-access-gcswf") pod "1c640c28-d3b6-4de8-b8e3-178ccf26329f" (UID: "1c640c28-d3b6-4de8-b8e3-178ccf26329f"). InnerVolumeSpecName "kube-api-access-gcswf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:45:58.479418 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.479380    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcswf\" (UniqueName: \"kubernetes.io/projected/1c640c28-d3b6-4de8-b8e3-178ccf26329f-kube-api-access-gcswf\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:45:58.479418 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.479415    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c640c28-d3b6-4de8-b8e3-178ccf26329f-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:45:58.651139 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.651039    2574 generic.go:356] "Generic (PLEG): container finished" podID="1c640c28-d3b6-4de8-b8e3-178ccf26329f" containerID="532f3787d2b7f80324ee24962c7b33f78907b059e0882811ac122633c1ec149d" exitCode=0
Sep 09 15:45:58.651139 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.651109    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"
Sep 09 15:45:58.651335 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.651135    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5" event={"ID":"1c640c28-d3b6-4de8-b8e3-178ccf26329f","Type":"ContainerDied","Data":"532f3787d2b7f80324ee24962c7b33f78907b059e0882811ac122633c1ec149d"}
Sep 09 15:45:58.651335 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.651193    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5" event={"ID":"1c640c28-d3b6-4de8-b8e3-178ccf26329f","Type":"ContainerDied","Data":"68b24777b19daccb379727e45e9169acc17a273835313f2c25cefb5a243fe742"}
Sep 09 15:45:58.651335 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.651221    2574 scope.go:117] "RemoveContainer" containerID="532f3787d2b7f80324ee24962c7b33f78907b059e0882811ac122633c1ec149d"
Sep 09 15:45:58.661649 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.661571    2574 scope.go:117] "RemoveContainer" containerID="532f3787d2b7f80324ee24962c7b33f78907b059e0882811ac122633c1ec149d"
Sep 09 15:45:58.662916 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:45:58.661885    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"532f3787d2b7f80324ee24962c7b33f78907b059e0882811ac122633c1ec149d\": container with ID starting with 532f3787d2b7f80324ee24962c7b33f78907b059e0882811ac122633c1ec149d not found: ID does not exist" containerID="532f3787d2b7f80324ee24962c7b33f78907b059e0882811ac122633c1ec149d"
Sep 09 15:45:58.662916 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.662287    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"532f3787d2b7f80324ee24962c7b33f78907b059e0882811ac122633c1ec149d"} err="failed to get container status \"532f3787d2b7f80324ee24962c7b33f78907b059e0882811ac122633c1ec149d\": rpc error: code = NotFound desc = could not find container \"532f3787d2b7f80324ee24962c7b33f78907b059e0882811ac122633c1ec149d\": container with ID starting with 532f3787d2b7f80324ee24962c7b33f78907b059e0882811ac122633c1ec149d not found: ID does not exist"
Sep 09 15:45:58.680382 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.680348    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"]
Sep 09 15:45:58.683107 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:45:58.683084    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-267962-f47fbf6bc-b2rq5"]
Sep 09 15:46:00.321330 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:00.321295    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c640c28-d3b6-4de8-b8e3-178ccf26329f" path="/var/lib/kubelet/pods/1c640c28-d3b6-4de8-b8e3-178ccf26329f/volumes"
Sep 09 15:46:08.929802 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:08.929762    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"]
Sep 09 15:46:09.810485 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:09.810445    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:46:23.951321 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:23.951277    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4" podUID="4378c116-c931-4e85-ab4e-b5eef416335f" containerName="main" containerID="cri-o://126aa09a24390b5ce7484b8b6b2dc6fa37b855931f689ac9704814e2c97b537e" gracePeriod=45
Sep 09 15:46:24.212619 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.212553    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:46:24.253580 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.253542    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-dshm\") pod \"4378c116-c931-4e85-ab4e-b5eef416335f\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") "
Sep 09 15:46:24.253760 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.253592    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztzsh\" (UniqueName: \"kubernetes.io/projected/4378c116-c931-4e85-ab4e-b5eef416335f-kube-api-access-ztzsh\") pod \"4378c116-c931-4e85-ab4e-b5eef416335f\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") "
Sep 09 15:46:24.253836 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.253761    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-model-cache\") pod \"4378c116-c931-4e85-ab4e-b5eef416335f\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") "
Sep 09 15:46:24.253836 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.253789    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-tmp-dir\") pod \"4378c116-c931-4e85-ab4e-b5eef416335f\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") "
Sep 09 15:46:24.253836 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.253811    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-home\") pod \"4378c116-c931-4e85-ab4e-b5eef416335f\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") "
Sep 09 15:46:24.254017 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.253834    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4378c116-c931-4e85-ab4e-b5eef416335f-tls-certs\") pod \"4378c116-c931-4e85-ab4e-b5eef416335f\" (UID: \"4378c116-c931-4e85-ab4e-b5eef416335f\") "
Sep 09 15:46:24.254076 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.254027    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-model-cache" (OuterVolumeSpecName: "model-cache") pod "4378c116-c931-4e85-ab4e-b5eef416335f" (UID: "4378c116-c931-4e85-ab4e-b5eef416335f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:46:24.254133 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.254097    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4378c116-c931-4e85-ab4e-b5eef416335f" (UID: "4378c116-c931-4e85-ab4e-b5eef416335f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:46:24.254443 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.254202    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-home" (OuterVolumeSpecName: "home") pod "4378c116-c931-4e85-ab4e-b5eef416335f" (UID: "4378c116-c931-4e85-ab4e-b5eef416335f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:46:24.254443 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.254375    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-model-cache\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:46:24.254443 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.254396    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-tmp-dir\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:46:24.254443 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.254409    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-home\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:46:24.269100 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.257717    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-dshm" (OuterVolumeSpecName: "dshm") pod "4378c116-c931-4e85-ab4e-b5eef416335f" (UID: "4378c116-c931-4e85-ab4e-b5eef416335f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:46:24.269100 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.257871    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4378c116-c931-4e85-ab4e-b5eef416335f-kube-api-access-ztzsh" (OuterVolumeSpecName: "kube-api-access-ztzsh") pod "4378c116-c931-4e85-ab4e-b5eef416335f" (UID: "4378c116-c931-4e85-ab4e-b5eef416335f"). InnerVolumeSpecName "kube-api-access-ztzsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:46:24.269100 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.257950    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4378c116-c931-4e85-ab4e-b5eef416335f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4378c116-c931-4e85-ab4e-b5eef416335f" (UID: "4378c116-c931-4e85-ab4e-b5eef416335f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:46:24.357310 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.357105    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4378c116-c931-4e85-ab4e-b5eef416335f-tls-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:46:24.357310 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.357159    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4378c116-c931-4e85-ab4e-b5eef416335f-dshm\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:46:24.357310 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.357177    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztzsh\" (UniqueName: \"kubernetes.io/projected/4378c116-c931-4e85-ab4e-b5eef416335f-kube-api-access-ztzsh\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:46:24.829177 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.829142    2574 generic.go:356] "Generic (PLEG): container finished" podID="4378c116-c931-4e85-ab4e-b5eef416335f" containerID="126aa09a24390b5ce7484b8b6b2dc6fa37b855931f689ac9704814e2c97b537e" exitCode=0
Sep 09 15:46:24.829374 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.829201    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"
Sep 09 15:46:24.829374 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.829217    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4" event={"ID":"4378c116-c931-4e85-ab4e-b5eef416335f","Type":"ContainerDied","Data":"126aa09a24390b5ce7484b8b6b2dc6fa37b855931f689ac9704814e2c97b537e"}
Sep 09 15:46:24.829374 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.829266    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4" event={"ID":"4378c116-c931-4e85-ab4e-b5eef416335f","Type":"ContainerDied","Data":"2663360bc826f4042d3224cd00a82a1f8090ee5b00f896c26eb40921eeba2bae"}
Sep 09 15:46:24.829374 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.829285    2574 scope.go:117] "RemoveContainer" containerID="126aa09a24390b5ce7484b8b6b2dc6fa37b855931f689ac9704814e2c97b537e"
Sep 09 15:46:24.839108 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.839090    2574 scope.go:117] "RemoveContainer" containerID="126aa09a24390b5ce7484b8b6b2dc6fa37b855931f689ac9704814e2c97b537e"
Sep 09 15:46:24.839387 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:46:24.839366    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"126aa09a24390b5ce7484b8b6b2dc6fa37b855931f689ac9704814e2c97b537e\": container with ID starting with 126aa09a24390b5ce7484b8b6b2dc6fa37b855931f689ac9704814e2c97b537e not found: ID does not exist" containerID="126aa09a24390b5ce7484b8b6b2dc6fa37b855931f689ac9704814e2c97b537e"
Sep 09 15:46:24.839464 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.839396    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"126aa09a24390b5ce7484b8b6b2dc6fa37b855931f689ac9704814e2c97b537e"} err="failed to get container status \"126aa09a24390b5ce7484b8b6b2dc6fa37b855931f689ac9704814e2c97b537e\": rpc error: code = NotFound desc = could not find container \"126aa09a24390b5ce7484b8b6b2dc6fa37b855931f689ac9704814e2c97b537e\": container with ID starting with 126aa09a24390b5ce7484b8b6b2dc6fa37b855931f689ac9704814e2c97b537e not found: ID does not exist"
Sep 09 15:46:24.846944 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.846913    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"]
Sep 09 15:46:24.850390 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:24.850358    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-a0938b/noten-model-a0938b-kserve-777fb75ddc-xz8r4"]
Sep 09 15:46:26.322424 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:26.322391    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4378c116-c931-4e85-ab4e-b5eef416335f" path="/var/lib/kubelet/pods/4378c116-c931-4e85-ab4e-b5eef416335f/volumes"
Sep 09 15:46:40.704372 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:40.704334    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"]
Sep 09 15:46:40.926263 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:40.926221    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt" podUID="954e6e86-eb23-4e4c-ba0e-1a58a139d943" containerName="istio-proxy" containerID="cri-o://d963e3bb4cb22cc5f0aa7de196253923f49c087ee78f91c6fb4ac50704b57025" gracePeriod=30
Sep 09 15:46:41.686982 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.686942    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"]
Sep 09 15:46:41.687476 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.687459    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c640c28-d3b6-4de8-b8e3-178ccf26329f" containerName="payload-processing"
Sep 09 15:46:41.687555 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.687479    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c640c28-d3b6-4de8-b8e3-178ccf26329f" containerName="payload-processing"
Sep 09 15:46:41.687555 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.687509    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4378c116-c931-4e85-ab4e-b5eef416335f" containerName="main"
Sep 09 15:46:41.687555 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.687515    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4378c116-c931-4e85-ab4e-b5eef416335f" containerName="main"
Sep 09 15:46:41.687708 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.687607    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4378c116-c931-4e85-ab4e-b5eef416335f" containerName="main"
Sep 09 15:46:41.687708 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.687622    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c640c28-d3b6-4de8-b8e3-178ccf26329f" containerName="payload-processing"
Sep 09 15:46:41.692454 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.692426    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.695352 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.695327    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-450a51-openshift-default-dockercfg-mxncb\""
Sep 09 15:46:41.703877 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.703831    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"]
Sep 09 15:46:41.835706 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.835666    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-istio-envoy\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.836189 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.835730    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-workload-certs\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.836189 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.835825    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-credential-socket\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.836189 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.835906    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-istio-data\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.836189 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.835976    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53b263f5-7aef-4517-9317-910bf4183e3a-istio-token\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.836189 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.835995    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53b263f5-7aef-4517-9317-910bf4183e3a-istiod-ca-cert\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.836189 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.836111    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-workload-socket\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.836189 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.836163    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53b263f5-7aef-4517-9317-910bf4183e3a-istio-podinfo\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.836472 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.836210    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lpks\" (UniqueName: \"kubernetes.io/projected/53b263f5-7aef-4517-9317-910bf4183e3a-kube-api-access-4lpks\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.937138 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.937043    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53b263f5-7aef-4517-9317-910bf4183e3a-istio-podinfo\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.937138 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.937080    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lpks\" (UniqueName: \"kubernetes.io/projected/53b263f5-7aef-4517-9317-910bf4183e3a-kube-api-access-4lpks\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.937138 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.937101    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-istio-envoy\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.937138 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.937141    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-workload-certs\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.937495 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.937170    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-credential-socket\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.937495 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.937197    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-istio-data\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.937495 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.937240    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53b263f5-7aef-4517-9317-910bf4183e3a-istio-token\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.937495 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.937269    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53b263f5-7aef-4517-9317-910bf4183e3a-istiod-ca-cert\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.937495 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.937371    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-workload-socket\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.937768 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.937652    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-workload-certs\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.937870 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.937829    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-istio-data\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.938103 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.937874    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-credential-socket\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.938103 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.937901    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-workload-socket\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.938103 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.938064    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53b263f5-7aef-4517-9317-910bf4183e3a-istiod-ca-cert\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.939572 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.939552    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-istio-envoy\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.939780 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.939762    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53b263f5-7aef-4517-9317-910bf4183e3a-istio-podinfo\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.952919 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.952894    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53b263f5-7aef-4517-9317-910bf4183e3a-istio-token\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:41.955720 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:41.955699    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lpks\" (UniqueName: \"kubernetes.io/projected/53b263f5-7aef-4517-9317-910bf4183e3a-kube-api-access-4lpks\") pod \"e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") " pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:42.006894 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:42.006856    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:42.288578 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:42.288541    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"]
Sep 09 15:46:42.294431 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:42.294376    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:46:42.294555 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:42.294526    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:46:42.294622 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:42.294609    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:46:42.940549 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:42.940505    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn" event={"ID":"53b263f5-7aef-4517-9317-910bf4183e3a","Type":"ContainerStarted","Data":"8f45a38f98b02c119ab53ffcda3be1b1a3672072224503cd676c834f1d7f85cb"}
Sep 09 15:46:42.941006 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:42.940581    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn" event={"ID":"53b263f5-7aef-4517-9317-910bf4183e3a","Type":"ContainerStarted","Data":"964d63d09553b354898a5e4b3565d23e1efc5fa9574e60680c4756fac20a3650"}
Sep 09 15:46:42.963476 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:42.963421    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn" podStartSLOduration=1.9634048499999999 podStartE2EDuration="1.96340485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:46:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:46:42.961125836 +0000 UTC m=+1587.151328618" watchObservedRunningTime="2026-09-09 15:46:42.96340485 +0000 UTC m=+1587.153607598"
Sep 09 15:46:43.007932 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:43.007893    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:43.013316 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:43.013290    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:43.946440 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:43.946396    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:43.947423 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:43.947403    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:46:46.189347 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.189285    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:46:46.286430 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.286386    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istiod-ca-cert\") pod \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") "
Sep 09 15:46:46.286637 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.286443    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-workload-socket\") pod \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") "
Sep 09 15:46:46.286637 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.286461    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-credential-socket\") pod \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") "
Sep 09 15:46:46.286753 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.286647    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-data\") pod \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") "
Sep 09 15:46:46.286753 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.286676    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "954e6e86-eb23-4e4c-ba0e-1a58a139d943" (UID: "954e6e86-eb23-4e4c-ba0e-1a58a139d943"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:46:46.286753 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.286701    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-token\") pod \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") "
Sep 09 15:46:46.286905 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.286750    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "954e6e86-eb23-4e4c-ba0e-1a58a139d943" (UID: "954e6e86-eb23-4e4c-ba0e-1a58a139d943"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:46:46.286905 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.286809    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-data" (OuterVolumeSpecName: "istio-data") pod "954e6e86-eb23-4e4c-ba0e-1a58a139d943" (UID: "954e6e86-eb23-4e4c-ba0e-1a58a139d943"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:46:46.286905 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.286817    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-workload-certs\") pod \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") "
Sep 09 15:46:46.286905 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.286880    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8r5g\" (UniqueName: \"kubernetes.io/projected/954e6e86-eb23-4e4c-ba0e-1a58a139d943-kube-api-access-b8r5g\") pod \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") "
Sep 09 15:46:46.286905 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.286905    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-podinfo\") pod \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") "
Sep 09 15:46:46.287183 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.286916    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "954e6e86-eb23-4e4c-ba0e-1a58a139d943" (UID: "954e6e86-eb23-4e4c-ba0e-1a58a139d943"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:46:46.287183 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.286931    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-envoy\") pod \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\" (UID: \"954e6e86-eb23-4e4c-ba0e-1a58a139d943\") "
Sep 09 15:46:46.287183 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.286990    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "954e6e86-eb23-4e4c-ba0e-1a58a139d943" (UID: "954e6e86-eb23-4e4c-ba0e-1a58a139d943"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:46:46.287384 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.287366    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-workload-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:46:46.287454 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.287388    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istiod-ca-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:46:46.287454 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.287400    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-workload-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:46:46.287454 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.287409    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-credential-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:46:46.287454 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.287417    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-data\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:46:46.289319 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.289292    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "954e6e86-eb23-4e4c-ba0e-1a58a139d943" (UID: "954e6e86-eb23-4e4c-ba0e-1a58a139d943"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:46:46.289319 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.289293    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/954e6e86-eb23-4e4c-ba0e-1a58a139d943-kube-api-access-b8r5g" (OuterVolumeSpecName: "kube-api-access-b8r5g") pod "954e6e86-eb23-4e4c-ba0e-1a58a139d943" (UID: "954e6e86-eb23-4e4c-ba0e-1a58a139d943"). InnerVolumeSpecName "kube-api-access-b8r5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:46:46.289506 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.289485    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-token" (OuterVolumeSpecName: "istio-token") pod "954e6e86-eb23-4e4c-ba0e-1a58a139d943" (UID: "954e6e86-eb23-4e4c-ba0e-1a58a139d943"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:46:46.289547 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.289506    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "954e6e86-eb23-4e4c-ba0e-1a58a139d943" (UID: "954e6e86-eb23-4e4c-ba0e-1a58a139d943"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 15:46:46.388389 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.388353    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-token\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:46:46.388389 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.388389    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8r5g\" (UniqueName: \"kubernetes.io/projected/954e6e86-eb23-4e4c-ba0e-1a58a139d943-kube-api-access-b8r5g\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:46:46.388578 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.388403    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-podinfo\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:46:46.388578 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.388413    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/954e6e86-eb23-4e4c-ba0e-1a58a139d943-istio-envoy\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:46:46.699678 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.699645    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"]
Sep 09 15:46:46.700165 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.700150    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954e6e86-eb23-4e4c-ba0e-1a58a139d943" containerName="istio-proxy"
Sep 09 15:46:46.700231 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.700168    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="954e6e86-eb23-4e4c-ba0e-1a58a139d943" containerName="istio-proxy"
Sep 09 15:46:46.700231 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.700187    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954e6e86-eb23-4e4c-ba0e-1a58a139d943" containerName="istio-proxy"
Sep 09 15:46:46.700231 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.700193    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="954e6e86-eb23-4e4c-ba0e-1a58a139d943" containerName="istio-proxy"
Sep 09 15:46:46.700331 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.700287    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="954e6e86-eb23-4e4c-ba0e-1a58a139d943" containerName="istio-proxy"
Sep 09 15:46:46.700331 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.700298    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="954e6e86-eb23-4e4c-ba0e-1a58a139d943" containerName="istio-proxy"
Sep 09 15:46:46.703824 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.703803    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"
Sep 09 15:46:46.706596 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.706574    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-450a51\""
Sep 09 15:46:46.706740 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.706596    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-450a51-dockercfg-kg5mv\""
Sep 09 15:46:46.719826 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.719789    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"]
Sep 09 15:46:46.745612 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.745569    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"]
Sep 09 15:46:46.749346 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.749327    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"
Sep 09 15:46:46.760032 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.759989    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"]
Sep 09 15:46:46.795214 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.795171    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/988f996b-28e3-4f78-b53a-32d097fb8e0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl\" (UID: \"988f996b-28e3-4f78-b53a-32d097fb8e0d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"
Sep 09 15:46:46.795415 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.795327    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz6tx\" (UniqueName: \"kubernetes.io/projected/988f996b-28e3-4f78-b53a-32d097fb8e0d-kube-api-access-fz6tx\") pod \"payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl\" (UID: \"988f996b-28e3-4f78-b53a-32d097fb8e0d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"
Sep 09 15:46:46.896104 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.896060    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz6tx\" (UniqueName: \"kubernetes.io/projected/988f996b-28e3-4f78-b53a-32d097fb8e0d-kube-api-access-fz6tx\") pod \"payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl\" (UID: \"988f996b-28e3-4f78-b53a-32d097fb8e0d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"
Sep 09 15:46:46.896317 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.896129    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd37fc58-1503-4604-9936-674e15616390-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7\" (UID: \"cd37fc58-1503-4604-9936-674e15616390\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"
Sep 09 15:46:46.896317 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.896189    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/988f996b-28e3-4f78-b53a-32d097fb8e0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl\" (UID: \"988f996b-28e3-4f78-b53a-32d097fb8e0d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"
Sep 09 15:46:46.896317 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.896220    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q7gh\" (UniqueName: \"kubernetes.io/projected/cd37fc58-1503-4604-9936-674e15616390-kube-api-access-7q7gh\") pod \"payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7\" (UID: \"cd37fc58-1503-4604-9936-674e15616390\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"
Sep 09 15:46:46.897156 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.897128    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/988f996b-28e3-4f78-b53a-32d097fb8e0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl\" (UID: \"988f996b-28e3-4f78-b53a-32d097fb8e0d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"
Sep 09 15:46:46.906065 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.906040    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz6tx\" (UniqueName: \"kubernetes.io/projected/988f996b-28e3-4f78-b53a-32d097fb8e0d-kube-api-access-fz6tx\") pod \"payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl\" (UID: \"988f996b-28e3-4f78-b53a-32d097fb8e0d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"
Sep 09 15:46:46.967671 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.967577    2574 generic.go:356] "Generic (PLEG): container finished" podID="954e6e86-eb23-4e4c-ba0e-1a58a139d943" containerID="d963e3bb4cb22cc5f0aa7de196253923f49c087ee78f91c6fb4ac50704b57025" exitCode=0
Sep 09 15:46:46.967671 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.967641    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"
Sep 09 15:46:46.967878 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.967667    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt" event={"ID":"954e6e86-eb23-4e4c-ba0e-1a58a139d943","Type":"ContainerDied","Data":"d963e3bb4cb22cc5f0aa7de196253923f49c087ee78f91c6fb4ac50704b57025"}
Sep 09 15:46:46.967878 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.967724    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt" event={"ID":"954e6e86-eb23-4e4c-ba0e-1a58a139d943","Type":"ContainerDied","Data":"e740608590e22182c0f8cffdbe34c89e8e383f3478db7b2c674633dfa691f18d"}
Sep 09 15:46:46.967878 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.967752    2574 scope.go:117] "RemoveContainer" containerID="d963e3bb4cb22cc5f0aa7de196253923f49c087ee78f91c6fb4ac50704b57025"
Sep 09 15:46:46.978622 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.978602    2574 scope.go:117] "RemoveContainer" containerID="6b74ab6cb8833900645759ca8a1b1b0a9cdee664249e26df8f4a4f413c4968ac"
Sep 09 15:46:46.986976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.986951    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"]
Sep 09 15:46:46.989496 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.989469    2574 scope.go:117] "RemoveContainer" containerID="d963e3bb4cb22cc5f0aa7de196253923f49c087ee78f91c6fb4ac50704b57025"
Sep 09 15:46:46.989767 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.989747    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-267962-openshift-default-5575947768-cngdt"]
Sep 09 15:46:46.989876 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:46:46.989805    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d963e3bb4cb22cc5f0aa7de196253923f49c087ee78f91c6fb4ac50704b57025\": container with ID starting with d963e3bb4cb22cc5f0aa7de196253923f49c087ee78f91c6fb4ac50704b57025 not found: ID does not exist" containerID="d963e3bb4cb22cc5f0aa7de196253923f49c087ee78f91c6fb4ac50704b57025"
Sep 09 15:46:46.989876 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.989857    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d963e3bb4cb22cc5f0aa7de196253923f49c087ee78f91c6fb4ac50704b57025"} err="failed to get container status \"d963e3bb4cb22cc5f0aa7de196253923f49c087ee78f91c6fb4ac50704b57025\": rpc error: code = NotFound desc = could not find container \"d963e3bb4cb22cc5f0aa7de196253923f49c087ee78f91c6fb4ac50704b57025\": container with ID starting with d963e3bb4cb22cc5f0aa7de196253923f49c087ee78f91c6fb4ac50704b57025 not found: ID does not exist"
Sep 09 15:46:46.990005 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.989884    2574 scope.go:117] "RemoveContainer" containerID="6b74ab6cb8833900645759ca8a1b1b0a9cdee664249e26df8f4a4f413c4968ac"
Sep 09 15:46:46.990231 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:46:46.990214    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b74ab6cb8833900645759ca8a1b1b0a9cdee664249e26df8f4a4f413c4968ac\": container with ID starting with 6b74ab6cb8833900645759ca8a1b1b0a9cdee664249e26df8f4a4f413c4968ac not found: ID does not exist" containerID="6b74ab6cb8833900645759ca8a1b1b0a9cdee664249e26df8f4a4f413c4968ac"
Sep 09 15:46:46.990272 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.990238    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b74ab6cb8833900645759ca8a1b1b0a9cdee664249e26df8f4a4f413c4968ac"} err="failed to get container status \"6b74ab6cb8833900645759ca8a1b1b0a9cdee664249e26df8f4a4f413c4968ac\": rpc error: code = NotFound desc = could not find container \"6b74ab6cb8833900645759ca8a1b1b0a9cdee664249e26df8f4a4f413c4968ac\": container with ID starting with 6b74ab6cb8833900645759ca8a1b1b0a9cdee664249e26df8f4a4f413c4968ac not found: ID does not exist"
Sep 09 15:46:46.997793 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.997762    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q7gh\" (UniqueName: \"kubernetes.io/projected/cd37fc58-1503-4604-9936-674e15616390-kube-api-access-7q7gh\") pod \"payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7\" (UID: \"cd37fc58-1503-4604-9936-674e15616390\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"
Sep 09 15:46:46.997952 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.997891    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd37fc58-1503-4604-9936-674e15616390-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7\" (UID: \"cd37fc58-1503-4604-9936-674e15616390\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"
Sep 09 15:46:46.998572 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:46.998550    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd37fc58-1503-4604-9936-674e15616390-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7\" (UID: \"cd37fc58-1503-4604-9936-674e15616390\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"
Sep 09 15:46:47.006009 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:47.005990    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q7gh\" (UniqueName: \"kubernetes.io/projected/cd37fc58-1503-4604-9936-674e15616390-kube-api-access-7q7gh\") pod \"payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7\" (UID: \"cd37fc58-1503-4604-9936-674e15616390\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"
Sep 09 15:46:47.016986 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:47.016965    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"
Sep 09 15:46:47.061646 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:47.061609    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"
Sep 09 15:46:47.294179 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:47.294140    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"]
Sep 09 15:46:47.295389 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:46:47.295362    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod988f996b_28e3_4f78_b53a_32d097fb8e0d.slice/crio-372618253efd9926b9b145f5ac5f6a2124dc3cff1090da46a94d9688d6ec5f8a WatchSource:0}: Error finding container 372618253efd9926b9b145f5ac5f6a2124dc3cff1090da46a94d9688d6ec5f8a: Status 404 returned error can't find the container with id 372618253efd9926b9b145f5ac5f6a2124dc3cff1090da46a94d9688d6ec5f8a
Sep 09 15:46:47.355449 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:47.355428    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"]
Sep 09 15:46:47.356304 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:46:47.356280    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd37fc58_1503_4604_9936_674e15616390.slice/crio-47b7bb6a453a7224bdb0c3f510ee42fccf26792b0b9e94706ea8f8ac0ef4eaf7 WatchSource:0}: Error finding container 47b7bb6a453a7224bdb0c3f510ee42fccf26792b0b9e94706ea8f8ac0ef4eaf7: Status 404 returned error can't find the container with id 47b7bb6a453a7224bdb0c3f510ee42fccf26792b0b9e94706ea8f8ac0ef4eaf7
Sep 09 15:46:47.975537 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:47.975503    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl" event={"ID":"988f996b-28e3-4f78-b53a-32d097fb8e0d","Type":"ContainerStarted","Data":"c7fa9104ba6c69697d18f67c59e8551282f661ad9f42b74bb9da9a15b7787797"}
Sep 09 15:46:47.975737 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:47.975556    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl" event={"ID":"988f996b-28e3-4f78-b53a-32d097fb8e0d","Type":"ContainerStarted","Data":"372618253efd9926b9b145f5ac5f6a2124dc3cff1090da46a94d9688d6ec5f8a"}
Sep 09 15:46:47.975737 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:47.975690    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"
Sep 09 15:46:47.978116 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:47.978089    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7" event={"ID":"cd37fc58-1503-4604-9936-674e15616390","Type":"ContainerStarted","Data":"1554ea973d82adc7b78d0f1842f44aa3b83f66f4d3e80eaf9c7e8efa1006efca"}
Sep 09 15:46:47.978235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:47.978134    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7" event={"ID":"cd37fc58-1503-4604-9936-674e15616390","Type":"ContainerStarted","Data":"47b7bb6a453a7224bdb0c3f510ee42fccf26792b0b9e94706ea8f8ac0ef4eaf7"}
Sep 09 15:46:47.978235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:47.978221    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"
Sep 09 15:46:47.992743 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:47.992697    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl" podStartSLOduration=1.992681756 podStartE2EDuration="1.992681756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:46:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:46:47.990457855 +0000 UTC m=+1592.180660618" watchObservedRunningTime="2026-09-09 15:46:47.992681756 +0000 UTC m=+1592.182884546"
Sep 09 15:46:48.006326 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:48.006273    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7" podStartSLOduration=2.006254274 podStartE2EDuration="2.006254274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:46:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:46:48.0056948 +0000 UTC m=+1592.195897575" watchObservedRunningTime="2026-09-09 15:46:48.006254274 +0000 UTC m=+1592.196457026"
Sep 09 15:46:48.321154 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:48.321069    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="954e6e86-eb23-4e4c-ba0e-1a58a139d943" path="/var/lib/kubelet/pods/954e6e86-eb23-4e4c-ba0e-1a58a139d943/volumes"
Sep 09 15:46:52.103228 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:52.103187    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:46:58.987673 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:58.987635    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"
Sep 09 15:46:58.988142 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:46:58.987780    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"
Sep 09 15:47:04.096229 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:04.096191    2574 generic.go:356] "Generic (PLEG): container finished" podID="53b263f5-7aef-4517-9317-910bf4183e3a" containerID="8f45a38f98b02c119ab53ffcda3be1b1a3672072224503cd676c834f1d7f85cb" exitCode=0
Sep 09 15:47:04.096765 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:04.096272    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn" event={"ID":"53b263f5-7aef-4517-9317-910bf4183e3a","Type":"ContainerDied","Data":"8f45a38f98b02c119ab53ffcda3be1b1a3672072224503cd676c834f1d7f85cb"}
Sep 09 15:47:04.096890 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:04.096870    2574 scope.go:117] "RemoveContainer" containerID="8f45a38f98b02c119ab53ffcda3be1b1a3672072224503cd676c834f1d7f85cb"
Sep 09 15:47:04.098386 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:04.098352    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:47:04.098491 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:04.098426    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:47:04.098491 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:04.098457    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:47:05.110010 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:05.109970    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn" event={"ID":"53b263f5-7aef-4517-9317-910bf4183e3a","Type":"ContainerStarted","Data":"d4e30ef00cea19bda3baf59a381dc15eddfc73e0d4b955151d28c732e05b09d2"}
Sep 09 15:47:06.007932 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:06.007889    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:47:06.008157 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:06.007950    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 09 15:47:06.008157 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:06.008022    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn" podUID="53b263f5-7aef-4517-9317-910bf4183e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 09 15:47:07.007671 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:07.007615    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 09 15:47:07.008208 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:07.007700    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn" podUID="53b263f5-7aef-4517-9317-910bf4183e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 09 15:47:08.007489 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:08.007445    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 09 15:47:08.007793 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:08.007761    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn" podUID="53b263f5-7aef-4517-9317-910bf4183e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 09 15:47:09.008094 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:09.008053    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 09 15:47:09.008701 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:09.008663    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn" podUID="53b263f5-7aef-4517-9317-910bf4183e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 09 15:47:10.007922 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.007879    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 09 15:47:10.008119 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.007944    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn" podUID="53b263f5-7aef-4517-9317-910bf4183e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 09 15:47:10.814544 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.814503    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"]
Sep 09 15:47:10.818938 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.818917    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.821698 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.821676    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-482dce-openshift-default-dockercfg-vmq5j\""
Sep 09 15:47:10.829499 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.829467    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"]
Sep 09 15:47:10.869418 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.869378    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-workload-socket\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.869596 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.869436    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-data\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.869596 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.869503    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hglvk\" (UniqueName: \"kubernetes.io/projected/ee1747e8-e331-4cde-b6b0-55957aa87f1a-kube-api-access-hglvk\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.869596 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.869581    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-podinfo\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.869739 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.869631    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-workload-certs\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.869739 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.869659    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-envoy\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.869739 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.869716    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-token\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.869887 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.869760    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istiod-ca-cert\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.869887 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.869783    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-credential-socket\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.971197 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.971154    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-workload-certs\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.971197 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.971201    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-envoy\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.971414 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.971319    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-token\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.971414 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.971372    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istiod-ca-cert\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.971414 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.971396    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-credential-socket\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.971564 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.971450    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-workload-socket\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.971564 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.971482    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-data\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.971666 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.971561    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hglvk\" (UniqueName: \"kubernetes.io/projected/ee1747e8-e331-4cde-b6b0-55957aa87f1a-kube-api-access-hglvk\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.971740 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.971707    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-podinfo\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.971808 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.971757    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-credential-socket\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.971808 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.971800    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-workload-socket\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.971942 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.971898    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-workload-certs\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.971994 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.971938    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-data\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.972168 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.972150    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istiod-ca-cert\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.973888 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.973866    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-envoy\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.974666 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.974647    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-podinfo\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.981631 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.981583    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-token\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:10.981965 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:10.981942    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hglvk\" (UniqueName: \"kubernetes.io/projected/ee1747e8-e331-4cde-b6b0-55957aa87f1a-kube-api-access-hglvk\") pod \"e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") " pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:11.011758 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:11.011728    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:47:11.012272 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:11.012252    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:47:11.012988 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:11.012971    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 15:47:11.133445 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:11.133360    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:11.417423 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:11.417383    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"]
Sep 09 15:47:11.418998 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:47:11.418968    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee1747e8_e331_4cde_b6b0_55957aa87f1a.slice/crio-336d159837de58b9ffcf68a10e9ef368457d4d2f0e7eb39e237cf60a2cf06aa4 WatchSource:0}: Error finding container 336d159837de58b9ffcf68a10e9ef368457d4d2f0e7eb39e237cf60a2cf06aa4: Status 404 returned error can't find the container with id 336d159837de58b9ffcf68a10e9ef368457d4d2f0e7eb39e237cf60a2cf06aa4
Sep 09 15:47:11.421496 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:11.421454    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:47:11.421591 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:11.421531    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:47:11.421591 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:11.421576    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:47:12.166280 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:12.166247    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7" event={"ID":"ee1747e8-e331-4cde-b6b0-55957aa87f1a","Type":"ContainerStarted","Data":"dd691f776d410dffdfd913ad5757e5b255d1bf13828305a02ddca964ccadaf2d"}
Sep 09 15:47:12.166767 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:12.166297    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7" event={"ID":"ee1747e8-e331-4cde-b6b0-55957aa87f1a","Type":"ContainerStarted","Data":"336d159837de58b9ffcf68a10e9ef368457d4d2f0e7eb39e237cf60a2cf06aa4"}
Sep 09 15:47:12.191332 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:12.191281    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7" podStartSLOduration=2.191266012 podStartE2EDuration="2.191266012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:47:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:47:12.184981091 +0000 UTC m=+1616.375183872" watchObservedRunningTime="2026-09-09 15:47:12.191266012 +0000 UTC m=+1616.381468757"
Sep 09 15:47:13.134335 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:13.134298    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:13.140506 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:13.140475    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:13.173245 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:13.173215    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:13.174574 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:13.174554    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:15.523113 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:15.523081    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"]
Sep 09 15:47:15.528085 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:15.528062    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:15.530992 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:15.530967    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-482dce-serving-cert\""
Sep 09 15:47:15.539373 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:15.539348    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"]
Sep 09 15:47:15.623158 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:15.623115    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh2ph\" (UniqueName: \"kubernetes.io/projected/a06df2ca-fa09-41df-aeea-8927ba8e3823-kube-api-access-sh2ph\") pod \"maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:15.623366 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:15.623342    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a06df2ca-fa09-41df-aeea-8927ba8e3823-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:15.623435 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:15.623387    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a06df2ca-fa09-41df-aeea-8927ba8e3823-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:15.623523 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:15.623509    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a06df2ca-fa09-41df-aeea-8927ba8e3823-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:15.724721 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:15.724675    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a06df2ca-fa09-41df-aeea-8927ba8e3823-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:15.724721 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:15.724721    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a06df2ca-fa09-41df-aeea-8927ba8e3823-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:15.725055 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:15.724791    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a06df2ca-fa09-41df-aeea-8927ba8e3823-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:15.725055 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:47:15.724828    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-serving-cert: secret "maas-api-e2e-shared-b-w3-482dce-serving-cert" not found
Sep 09 15:47:15.725055 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:15.724902    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh2ph\" (UniqueName: \"kubernetes.io/projected/a06df2ca-fa09-41df-aeea-8927ba8e3823-kube-api-access-sh2ph\") pod \"maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:15.725055 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:47:15.724929    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a06df2ca-fa09-41df-aeea-8927ba8e3823-maas-api-tls podName:a06df2ca-fa09-41df-aeea-8927ba8e3823 nodeName:}" failed. No retries permitted until 2026-09-09 15:47:16.224911111 +0000 UTC m=+1620.415113861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a06df2ca-fa09-41df-aeea-8927ba8e3823-maas-api-tls") pod "maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn" (UID: "a06df2ca-fa09-41df-aeea-8927ba8e3823") : secret "maas-api-e2e-shared-b-w3-482dce-serving-cert" not found
Sep 09 15:47:15.725458 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:15.725439    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a06df2ca-fa09-41df-aeea-8927ba8e3823-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:15.728018 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:15.727985    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a06df2ca-fa09-41df-aeea-8927ba8e3823-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:15.739113 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:15.739083    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh2ph\" (UniqueName: \"kubernetes.io/projected/a06df2ca-fa09-41df-aeea-8927ba8e3823-kube-api-access-sh2ph\") pod \"maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:16.230387 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:16.230349    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a06df2ca-fa09-41df-aeea-8927ba8e3823-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:16.233063 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:16.233038    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a06df2ca-fa09-41df-aeea-8927ba8e3823-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:16.442912 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:16.442874    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:16.722786 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:16.722761    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"]
Sep 09 15:47:17.200996 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:17.200961    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn" event={"ID":"a06df2ca-fa09-41df-aeea-8927ba8e3823","Type":"ContainerStarted","Data":"90d28ee8742bc323cb18e5320801310127ecb2fdd48906979b9ae5433924ae84"}
Sep 09 15:47:17.201215 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:17.201023    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:17.201215 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:17.201041    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn" event={"ID":"a06df2ca-fa09-41df-aeea-8927ba8e3823","Type":"ContainerStarted","Data":"91841e1fbd486c5f1649457e1b4235bb64deea7abdb0ddae80399f9684aa351a"}
Sep 09 15:47:17.219682 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:17.219633    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn" podStartSLOduration=1.933632815 podStartE2EDuration="2.219617199s" totalImagesPullingTime="285.984384ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:47:17.216812998 +0000 UTC m=+1621.407015767" watchObservedRunningTime="2026-09-09 15:47:17.219617199 +0000 UTC m=+1621.409819997"
Sep 09 15:47:23.214327 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:23.214296    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 15:47:27.801729 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:27.801686    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:47:37.665400 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:37.665348    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"]
Sep 09 15:47:37.666207 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:37.666169    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw" podUID="d78d9f7c-e379-4e8f-867e-07e7e8a7fbae" containerName="payload-pre-processing" containerID="cri-o://d76d296268fd56de9adc14f8d2b9c3f024b29124cbb3dfbe4ae5940c12ce4806" gracePeriod=30
Sep 09 15:47:37.955594 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:37.955565    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"
Sep 09 15:47:38.070365 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:38.070333    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d78d9f7c-e379-4e8f-867e-07e7e8a7fbae-plugins-config-volume\") pod \"d78d9f7c-e379-4e8f-867e-07e7e8a7fbae\" (UID: \"d78d9f7c-e379-4e8f-867e-07e7e8a7fbae\") "
Sep 09 15:47:38.070365 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:38.070372    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mspw\" (UniqueName: \"kubernetes.io/projected/d78d9f7c-e379-4e8f-867e-07e7e8a7fbae-kube-api-access-5mspw\") pod \"d78d9f7c-e379-4e8f-867e-07e7e8a7fbae\" (UID: \"d78d9f7c-e379-4e8f-867e-07e7e8a7fbae\") "
Sep 09 15:47:38.070682 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:38.070660    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d78d9f7c-e379-4e8f-867e-07e7e8a7fbae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d78d9f7c-e379-4e8f-867e-07e7e8a7fbae" (UID: "d78d9f7c-e379-4e8f-867e-07e7e8a7fbae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:47:38.072691 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:38.072666    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d78d9f7c-e379-4e8f-867e-07e7e8a7fbae-kube-api-access-5mspw" (OuterVolumeSpecName: "kube-api-access-5mspw") pod "d78d9f7c-e379-4e8f-867e-07e7e8a7fbae" (UID: "d78d9f7c-e379-4e8f-867e-07e7e8a7fbae"). InnerVolumeSpecName "kube-api-access-5mspw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:47:38.171235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:38.171188    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d78d9f7c-e379-4e8f-867e-07e7e8a7fbae-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:47:38.171235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:38.171226    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mspw\" (UniqueName: \"kubernetes.io/projected/d78d9f7c-e379-4e8f-867e-07e7e8a7fbae-kube-api-access-5mspw\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:47:38.367277 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:38.367244    2574 generic.go:356] "Generic (PLEG): container finished" podID="d78d9f7c-e379-4e8f-867e-07e7e8a7fbae" containerID="d76d296268fd56de9adc14f8d2b9c3f024b29124cbb3dfbe4ae5940c12ce4806" exitCode=0
Sep 09 15:47:38.367443 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:38.367299    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"
Sep 09 15:47:38.367443 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:38.367340    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw" event={"ID":"d78d9f7c-e379-4e8f-867e-07e7e8a7fbae","Type":"ContainerDied","Data":"d76d296268fd56de9adc14f8d2b9c3f024b29124cbb3dfbe4ae5940c12ce4806"}
Sep 09 15:47:38.367443 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:38.367387    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw" event={"ID":"d78d9f7c-e379-4e8f-867e-07e7e8a7fbae","Type":"ContainerDied","Data":"572a7b6bf9d4feead0557a99beeb7a7c761f8820e7fe5e23bf7b015ffa00af19"}
Sep 09 15:47:38.367443 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:38.367412    2574 scope.go:117] "RemoveContainer" containerID="d76d296268fd56de9adc14f8d2b9c3f024b29124cbb3dfbe4ae5940c12ce4806"
Sep 09 15:47:38.380545 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:38.380518    2574 scope.go:117] "RemoveContainer" containerID="d76d296268fd56de9adc14f8d2b9c3f024b29124cbb3dfbe4ae5940c12ce4806"
Sep 09 15:47:38.381130 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:47:38.381103    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d76d296268fd56de9adc14f8d2b9c3f024b29124cbb3dfbe4ae5940c12ce4806\": container with ID starting with d76d296268fd56de9adc14f8d2b9c3f024b29124cbb3dfbe4ae5940c12ce4806 not found: ID does not exist" containerID="d76d296268fd56de9adc14f8d2b9c3f024b29124cbb3dfbe4ae5940c12ce4806"
Sep 09 15:47:38.381250 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:38.381140    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d76d296268fd56de9adc14f8d2b9c3f024b29124cbb3dfbe4ae5940c12ce4806"} err="failed to get container status \"d76d296268fd56de9adc14f8d2b9c3f024b29124cbb3dfbe4ae5940c12ce4806\": rpc error: code = NotFound desc = could not find container \"d76d296268fd56de9adc14f8d2b9c3f024b29124cbb3dfbe4ae5940c12ce4806\": container with ID starting with d76d296268fd56de9adc14f8d2b9c3f024b29124cbb3dfbe4ae5940c12ce4806 not found: ID does not exist"
Sep 09 15:47:38.386936 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:38.386908    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"]
Sep 09 15:47:38.389696 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:38.389670    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-aeb0f8ca-64754b9674-549tw"]
Sep 09 15:47:39.375438 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:39.375406    2574 generic.go:356] "Generic (PLEG): container finished" podID="ee1747e8-e331-4cde-b6b0-55957aa87f1a" containerID="dd691f776d410dffdfd913ad5757e5b255d1bf13828305a02ddca964ccadaf2d" exitCode=0
Sep 09 15:47:39.375929 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:39.375484    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7" event={"ID":"ee1747e8-e331-4cde-b6b0-55957aa87f1a","Type":"ContainerDied","Data":"dd691f776d410dffdfd913ad5757e5b255d1bf13828305a02ddca964ccadaf2d"}
Sep 09 15:47:39.376006 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:39.375989    2574 scope.go:117] "RemoveContainer" containerID="dd691f776d410dffdfd913ad5757e5b255d1bf13828305a02ddca964ccadaf2d"
Sep 09 15:47:39.377259 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:39.377229    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:47:39.377337 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:39.377299    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:47:39.377337 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:39.377332    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:47:40.321624 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:40.321586    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d78d9f7c-e379-4e8f-867e-07e7e8a7fbae" path="/var/lib/kubelet/pods/d78d9f7c-e379-4e8f-867e-07e7e8a7fbae/volumes"
Sep 09 15:47:40.392619 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:40.392574    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7" event={"ID":"ee1747e8-e331-4cde-b6b0-55957aa87f1a","Type":"ContainerStarted","Data":"68703de05f6f65a35b6e97f6c13a638930273d7896a3e0ea383d3f54c574511b"}
Sep 09 15:47:41.133958 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:41.133919    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:41.135224 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:41.135194    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 09 15:47:41.135354 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:41.135258    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7" podUID="ee1747e8-e331-4cde-b6b0-55957aa87f1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 09 15:47:42.134268 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:42.134230    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 09 15:47:42.134682 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:42.134299    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7" podUID="ee1747e8-e331-4cde-b6b0-55957aa87f1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 09 15:47:43.133943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:43.133902    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 09 15:47:43.134214 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:43.133984    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7" podUID="ee1747e8-e331-4cde-b6b0-55957aa87f1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 09 15:47:43.173386 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:43.173342    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:44.134176 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:44.134136    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 09 15:47:44.134354 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:44.134198    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7" podUID="ee1747e8-e331-4cde-b6b0-55957aa87f1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 09 15:47:45.134096 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:45.134056    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 09 15:47:45.134511 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:45.134131    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7" podUID="ee1747e8-e331-4cde-b6b0-55957aa87f1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 09 15:47:46.138439 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:46.138404    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:46.139528 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:46.139507    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 15:47:55.625518 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:47:55.625477    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:48:32.327752 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:48:32.327719    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:49:12.136605 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:12.136571    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"]
Sep 09 15:49:12.137168 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:12.136788    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d" podUID="510f70d6-a782-43c0-a030-4e6562b403b9" containerName="istio-proxy" containerID="cri-o://ef8b5aaaf3dc6b9554b9cfa8bda9cf3335a4342c5b488d4a83050e787f671a14" gracePeriod=30
Sep 09 15:49:17.413003 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.412975    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:49:17.435762 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.435729    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vk7k\" (UniqueName: \"kubernetes.io/projected/510f70d6-a782-43c0-a030-4e6562b403b9-kube-api-access-8vk7k\") pod \"510f70d6-a782-43c0-a030-4e6562b403b9\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") "
Sep 09 15:49:17.435937 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.435791    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/510f70d6-a782-43c0-a030-4e6562b403b9-istio-podinfo\") pod \"510f70d6-a782-43c0-a030-4e6562b403b9\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") "
Sep 09 15:49:17.435937 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.435811    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/510f70d6-a782-43c0-a030-4e6562b403b9-istio-token\") pod \"510f70d6-a782-43c0-a030-4e6562b403b9\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") "
Sep 09 15:49:17.435937 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.435828    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-workload-socket\") pod \"510f70d6-a782-43c0-a030-4e6562b403b9\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") "
Sep 09 15:49:17.435937 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.435877    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-workload-certs\") pod \"510f70d6-a782-43c0-a030-4e6562b403b9\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") "
Sep 09 15:49:17.435937 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.435913    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/510f70d6-a782-43c0-a030-4e6562b403b9-istiod-ca-cert\") pod \"510f70d6-a782-43c0-a030-4e6562b403b9\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") "
Sep 09 15:49:17.436216 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.435944    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-credential-socket\") pod \"510f70d6-a782-43c0-a030-4e6562b403b9\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") "
Sep 09 15:49:17.436216 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.436022    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-istio-envoy\") pod \"510f70d6-a782-43c0-a030-4e6562b403b9\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") "
Sep 09 15:49:17.436216 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.436082    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-istio-data\") pod \"510f70d6-a782-43c0-a030-4e6562b403b9\" (UID: \"510f70d6-a782-43c0-a030-4e6562b403b9\") "
Sep 09 15:49:17.436365 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.436271    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "510f70d6-a782-43c0-a030-4e6562b403b9" (UID: "510f70d6-a782-43c0-a030-4e6562b403b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:49:17.436365 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.436288    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "510f70d6-a782-43c0-a030-4e6562b403b9" (UID: "510f70d6-a782-43c0-a030-4e6562b403b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:49:17.436365 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.436336    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "510f70d6-a782-43c0-a030-4e6562b403b9" (UID: "510f70d6-a782-43c0-a030-4e6562b403b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:49:17.436508 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.436402    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/510f70d6-a782-43c0-a030-4e6562b403b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "510f70d6-a782-43c0-a030-4e6562b403b9" (UID: "510f70d6-a782-43c0-a030-4e6562b403b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:49:17.436508 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.436500    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "510f70d6-a782-43c0-a030-4e6562b403b9" (UID: "510f70d6-a782-43c0-a030-4e6562b403b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:49:17.436714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.436641    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-istio-data\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:49:17.436714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.436665    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-workload-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:49:17.436714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.436680    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-workload-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:49:17.436714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.436711    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/510f70d6-a782-43c0-a030-4e6562b403b9-istiod-ca-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:49:17.436998 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.436725    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-credential-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:49:17.438378 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.438350    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/510f70d6-a782-43c0-a030-4e6562b403b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "510f70d6-a782-43c0-a030-4e6562b403b9" (UID: "510f70d6-a782-43c0-a030-4e6562b403b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:49:17.438649 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.438626    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/510f70d6-a782-43c0-a030-4e6562b403b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "510f70d6-a782-43c0-a030-4e6562b403b9" (UID: "510f70d6-a782-43c0-a030-4e6562b403b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 15:49:17.439109 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.439079    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "510f70d6-a782-43c0-a030-4e6562b403b9" (UID: "510f70d6-a782-43c0-a030-4e6562b403b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:49:17.439109 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.439095    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/510f70d6-a782-43c0-a030-4e6562b403b9-kube-api-access-8vk7k" (OuterVolumeSpecName: "kube-api-access-8vk7k") pod "510f70d6-a782-43c0-a030-4e6562b403b9" (UID: "510f70d6-a782-43c0-a030-4e6562b403b9"). InnerVolumeSpecName "kube-api-access-8vk7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:49:17.538240 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.538205    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/510f70d6-a782-43c0-a030-4e6562b403b9-istio-envoy\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:49:17.538240 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.538238    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vk7k\" (UniqueName: \"kubernetes.io/projected/510f70d6-a782-43c0-a030-4e6562b403b9-kube-api-access-8vk7k\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:49:17.538240 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.538250    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/510f70d6-a782-43c0-a030-4e6562b403b9-istio-podinfo\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:49:17.538491 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:17.538258    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/510f70d6-a782-43c0-a030-4e6562b403b9-istio-token\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:49:18.047419 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:18.047386    2574 generic.go:356] "Generic (PLEG): container finished" podID="510f70d6-a782-43c0-a030-4e6562b403b9" containerID="ef8b5aaaf3dc6b9554b9cfa8bda9cf3335a4342c5b488d4a83050e787f671a14" exitCode=0
Sep 09 15:49:18.047681 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:18.047434    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d" event={"ID":"510f70d6-a782-43c0-a030-4e6562b403b9","Type":"ContainerDied","Data":"ef8b5aaaf3dc6b9554b9cfa8bda9cf3335a4342c5b488d4a83050e787f671a14"}
Sep 09 15:49:18.047681 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:18.047439    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"
Sep 09 15:49:18.047681 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:18.047479    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d" event={"ID":"510f70d6-a782-43c0-a030-4e6562b403b9","Type":"ContainerDied","Data":"e37069bca38a87c48fe192e324b43782fe4f21f6c36cabf1cd6f6be432ef2330"}
Sep 09 15:49:18.047681 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:18.047503    2574 scope.go:117] "RemoveContainer" containerID="ef8b5aaaf3dc6b9554b9cfa8bda9cf3335a4342c5b488d4a83050e787f671a14"
Sep 09 15:49:18.058458 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:18.058438    2574 scope.go:117] "RemoveContainer" containerID="be1777e1a64021443038b53742ebeaeaefd2ad32e55e49475c4078a9d83f9f6e"
Sep 09 15:49:18.067512 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:18.067491    2574 scope.go:117] "RemoveContainer" containerID="ef8b5aaaf3dc6b9554b9cfa8bda9cf3335a4342c5b488d4a83050e787f671a14"
Sep 09 15:49:18.067815 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:49:18.067797    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef8b5aaaf3dc6b9554b9cfa8bda9cf3335a4342c5b488d4a83050e787f671a14\": container with ID starting with ef8b5aaaf3dc6b9554b9cfa8bda9cf3335a4342c5b488d4a83050e787f671a14 not found: ID does not exist" containerID="ef8b5aaaf3dc6b9554b9cfa8bda9cf3335a4342c5b488d4a83050e787f671a14"
Sep 09 15:49:18.068057 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:18.067830    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef8b5aaaf3dc6b9554b9cfa8bda9cf3335a4342c5b488d4a83050e787f671a14"} err="failed to get container status \"ef8b5aaaf3dc6b9554b9cfa8bda9cf3335a4342c5b488d4a83050e787f671a14\": rpc error: code = NotFound desc = could not find container \"ef8b5aaaf3dc6b9554b9cfa8bda9cf3335a4342c5b488d4a83050e787f671a14\": container with ID starting with ef8b5aaaf3dc6b9554b9cfa8bda9cf3335a4342c5b488d4a83050e787f671a14 not found: ID does not exist"
Sep 09 15:49:18.068057 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:18.067867    2574 scope.go:117] "RemoveContainer" containerID="be1777e1a64021443038b53742ebeaeaefd2ad32e55e49475c4078a9d83f9f6e"
Sep 09 15:49:18.068188 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:49:18.068095    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be1777e1a64021443038b53742ebeaeaefd2ad32e55e49475c4078a9d83f9f6e\": container with ID starting with be1777e1a64021443038b53742ebeaeaefd2ad32e55e49475c4078a9d83f9f6e not found: ID does not exist" containerID="be1777e1a64021443038b53742ebeaeaefd2ad32e55e49475c4078a9d83f9f6e"
Sep 09 15:49:18.068188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:18.068111    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be1777e1a64021443038b53742ebeaeaefd2ad32e55e49475c4078a9d83f9f6e"} err="failed to get container status \"be1777e1a64021443038b53742ebeaeaefd2ad32e55e49475c4078a9d83f9f6e\": rpc error: code = NotFound desc = could not find container \"be1777e1a64021443038b53742ebeaeaefd2ad32e55e49475c4078a9d83f9f6e\": container with ID starting with be1777e1a64021443038b53742ebeaeaefd2ad32e55e49475c4078a9d83f9f6e not found: ID does not exist"
Sep 09 15:49:18.081670 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:18.081636    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"]
Sep 09 15:49:18.090684 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:18.090655    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-aeb0f8ca-openshift-default-7f4d45848-zsb7d"]
Sep 09 15:49:18.322347 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:18.322249    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="510f70d6-a782-43c0-a030-4e6562b403b9" path="/var/lib/kubelet/pods/510f70d6-a782-43c0-a030-4e6562b403b9/volumes"
Sep 09 15:49:20.813664 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:49:20.813630    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:50:03.810998 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:03.810959    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:50:08.689169 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.689134    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"]
Sep 09 15:50:08.689955 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.689927    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="510f70d6-a782-43c0-a030-4e6562b403b9" containerName="istio-proxy"
Sep 09 15:50:08.689955 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.689956    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="510f70d6-a782-43c0-a030-4e6562b403b9" containerName="istio-proxy"
Sep 09 15:50:08.690133 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.689983    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d78d9f7c-e379-4e8f-867e-07e7e8a7fbae" containerName="payload-pre-processing"
Sep 09 15:50:08.690133 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.689991    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d78d9f7c-e379-4e8f-867e-07e7e8a7fbae" containerName="payload-pre-processing"
Sep 09 15:50:08.690133 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.690129    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d78d9f7c-e379-4e8f-867e-07e7e8a7fbae" containerName="payload-pre-processing"
Sep 09 15:50:08.690287 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.690146    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="510f70d6-a782-43c0-a030-4e6562b403b9" containerName="istio-proxy"
Sep 09 15:50:08.690287 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.690157    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="510f70d6-a782-43c0-a030-4e6562b403b9" containerName="istio-proxy"
Sep 09 15:50:08.693638 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.693616    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.696261 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.696234    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-3ac2fa-openshift-default-dockercfg-9s5lg\""
Sep 09 15:50:08.703872 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.703826    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"]
Sep 09 15:50:08.770673 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.770636    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-credential-socket\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.770673 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.770680    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhvdp\" (UniqueName: \"kubernetes.io/projected/12b0578c-9bab-4836-afe9-64df8ce627ad-kube-api-access-lhvdp\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.770903 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.770743    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-workload-socket\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.770903 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.770801    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-podinfo\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.770903 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.770872    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-workload-certs\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.771013 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.770909    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-data\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.771013 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.770930    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-token\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.771013 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.770996    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12b0578c-9bab-4836-afe9-64df8ce627ad-istiod-ca-cert\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.771113 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.771053    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-envoy\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.871712 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.871676    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-envoy\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.871932 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.871717    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-credential-socket\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.871932 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.871741    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhvdp\" (UniqueName: \"kubernetes.io/projected/12b0578c-9bab-4836-afe9-64df8ce627ad-kube-api-access-lhvdp\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.871932 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.871772    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-workload-socket\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.871932 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.871801    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-podinfo\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.871932 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.871863    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-workload-certs\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.871932 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.871916    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-data\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.872310 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.871944    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-token\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.872310 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.871996    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12b0578c-9bab-4836-afe9-64df8ce627ad-istiod-ca-cert\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.872310 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.872145    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-workload-socket\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.872310 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.872176    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-credential-socket\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.872701 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.872361    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-data\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.872701 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.872588    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-workload-certs\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.872701 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.872653    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12b0578c-9bab-4836-afe9-64df8ce627ad-istiod-ca-cert\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.874284 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.874264    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-envoy\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.874422 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.874403    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-podinfo\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.879451 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.879425    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-token\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:08.879736 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:08.879715    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhvdp\" (UniqueName: \"kubernetes.io/projected/12b0578c-9bab-4836-afe9-64df8ce627ad-kube-api-access-lhvdp\") pod \"e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") " pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:09.007087 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:09.006983    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:09.290484 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:09.290457    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"]
Sep 09 15:50:09.301445 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:50:09.301297    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b0578c_9bab_4836_afe9_64df8ce627ad.slice/crio-f766db07b3c2148f14a7025c0932f494242e07b8acc435556ce471322fa09004 WatchSource:0}: Error finding container f766db07b3c2148f14a7025c0932f494242e07b8acc435556ce471322fa09004: Status 404 returned error can't find the container with id f766db07b3c2148f14a7025c0932f494242e07b8acc435556ce471322fa09004
Sep 09 15:50:09.304128 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:09.304090    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:50:09.304251 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:09.304180    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:50:09.304321 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:09.304250    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:50:09.380418 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:09.380382    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb" event={"ID":"12b0578c-9bab-4836-afe9-64df8ce627ad","Type":"ContainerStarted","Data":"4298ab36b9593aad463ff4fa12a4ec5458b5103d4132c060b8a4c982c63e5139"}
Sep 09 15:50:09.380561 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:09.380498    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb" event={"ID":"12b0578c-9bab-4836-afe9-64df8ce627ad","Type":"ContainerStarted","Data":"f766db07b3c2148f14a7025c0932f494242e07b8acc435556ce471322fa09004"}
Sep 09 15:50:09.404406 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:09.404340    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb" podStartSLOduration=1.404318397 podStartE2EDuration="1.404318397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:50:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:50:09.401504557 +0000 UTC m=+1793.591707305" watchObservedRunningTime="2026-09-09 15:50:09.404318397 +0000 UTC m=+1793.594521147"
Sep 09 15:50:10.007693 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:10.007659    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:10.014867 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:10.014813    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:10.387833 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:10.387732    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:10.388720 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:10.388700    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:10.786607 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:10.786573    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-df30be-29816145-rkqk9"]
Sep 09 15:50:10.789407 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:10.789375    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-df30be-29816145-rkqk9"]
Sep 09 15:50:10.812739 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:10.812704    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"]
Sep 09 15:50:10.813361 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:10.812987    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg" podUID="9610f1c2-2449-416e-bda8-3879c3722a05" containerName="payload-processing" containerID="cri-o://3a1deb5aba9784d48da01cd8793caa0a76b08084f9e37177d715697588e41641" gracePeriod=30
Sep 09 15:50:11.097727 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:11.097694    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"
Sep 09 15:50:11.196159 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:11.196126    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbcbb\" (UniqueName: \"kubernetes.io/projected/9610f1c2-2449-416e-bda8-3879c3722a05-kube-api-access-dbcbb\") pod \"9610f1c2-2449-416e-bda8-3879c3722a05\" (UID: \"9610f1c2-2449-416e-bda8-3879c3722a05\") "
Sep 09 15:50:11.196319 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:11.196229    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9610f1c2-2449-416e-bda8-3879c3722a05-plugins-config-volume\") pod \"9610f1c2-2449-416e-bda8-3879c3722a05\" (UID: \"9610f1c2-2449-416e-bda8-3879c3722a05\") "
Sep 09 15:50:11.196656 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:11.196629    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9610f1c2-2449-416e-bda8-3879c3722a05-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9610f1c2-2449-416e-bda8-3879c3722a05" (UID: "9610f1c2-2449-416e-bda8-3879c3722a05"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:50:11.198509 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:11.198481    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9610f1c2-2449-416e-bda8-3879c3722a05-kube-api-access-dbcbb" (OuterVolumeSpecName: "kube-api-access-dbcbb") pod "9610f1c2-2449-416e-bda8-3879c3722a05" (UID: "9610f1c2-2449-416e-bda8-3879c3722a05"). InnerVolumeSpecName "kube-api-access-dbcbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:50:11.297964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:11.297926    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbcbb\" (UniqueName: \"kubernetes.io/projected/9610f1c2-2449-416e-bda8-3879c3722a05-kube-api-access-dbcbb\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:50:11.297964 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:11.297969    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9610f1c2-2449-416e-bda8-3879c3722a05-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:50:11.396301 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:11.396208    2574 generic.go:356] "Generic (PLEG): container finished" podID="9610f1c2-2449-416e-bda8-3879c3722a05" containerID="3a1deb5aba9784d48da01cd8793caa0a76b08084f9e37177d715697588e41641" exitCode=0
Sep 09 15:50:11.396301 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:11.396267    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"
Sep 09 15:50:11.396524 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:11.396292    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg" event={"ID":"9610f1c2-2449-416e-bda8-3879c3722a05","Type":"ContainerDied","Data":"3a1deb5aba9784d48da01cd8793caa0a76b08084f9e37177d715697588e41641"}
Sep 09 15:50:11.396524 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:11.396354    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg" event={"ID":"9610f1c2-2449-416e-bda8-3879c3722a05","Type":"ContainerDied","Data":"5fda2743ee8fb3dc1632ac76bf7dd27575978bd988f1e2d9afbc1dc42b584e5f"}
Sep 09 15:50:11.396524 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:11.396376    2574 scope.go:117] "RemoveContainer" containerID="3a1deb5aba9784d48da01cd8793caa0a76b08084f9e37177d715697588e41641"
Sep 09 15:50:11.408179 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:11.408159    2574 scope.go:117] "RemoveContainer" containerID="3a1deb5aba9784d48da01cd8793caa0a76b08084f9e37177d715697588e41641"
Sep 09 15:50:11.408482 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:50:11.408461    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a1deb5aba9784d48da01cd8793caa0a76b08084f9e37177d715697588e41641\": container with ID starting with 3a1deb5aba9784d48da01cd8793caa0a76b08084f9e37177d715697588e41641 not found: ID does not exist" containerID="3a1deb5aba9784d48da01cd8793caa0a76b08084f9e37177d715697588e41641"
Sep 09 15:50:11.408559 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:11.408495    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a1deb5aba9784d48da01cd8793caa0a76b08084f9e37177d715697588e41641"} err="failed to get container status \"3a1deb5aba9784d48da01cd8793caa0a76b08084f9e37177d715697588e41641\": rpc error: code = NotFound desc = could not find container \"3a1deb5aba9784d48da01cd8793caa0a76b08084f9e37177d715697588e41641\": container with ID starting with 3a1deb5aba9784d48da01cd8793caa0a76b08084f9e37177d715697588e41641 not found: ID does not exist"
Sep 09 15:50:11.429257 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:11.429226    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"]
Sep 09 15:50:11.433492 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:11.433458    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-df30be-7d989c5b79-bnkmg"]
Sep 09 15:50:12.321830 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:12.321784    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43865284-173b-4572-b837-7a80b8cc3168" path="/var/lib/kubelet/pods/43865284-173b-4572-b837-7a80b8cc3168/volumes"
Sep 09 15:50:12.322351 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:12.322331    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9610f1c2-2449-416e-bda8-3879c3722a05" path="/var/lib/kubelet/pods/9610f1c2-2449-416e-bda8-3879c3722a05/volumes"
Sep 09 15:50:13.316695 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.316659    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"]
Sep 09 15:50:13.317238 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.317208    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9610f1c2-2449-416e-bda8-3879c3722a05" containerName="payload-processing"
Sep 09 15:50:13.317238 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.317242    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9610f1c2-2449-416e-bda8-3879c3722a05" containerName="payload-processing"
Sep 09 15:50:13.317343 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.317271    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="510f70d6-a782-43c0-a030-4e6562b403b9" containerName="istio-proxy"
Sep 09 15:50:13.317343 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.317277    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="510f70d6-a782-43c0-a030-4e6562b403b9" containerName="istio-proxy"
Sep 09 15:50:13.317421 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.317361    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9610f1c2-2449-416e-bda8-3879c3722a05" containerName="payload-processing"
Sep 09 15:50:13.321893 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.321870    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"
Sep 09 15:50:13.322324 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.322179    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"]
Sep 09 15:50:13.325830 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.325789    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"
Sep 09 15:50:13.325988 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.325910    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-3ac2fa\""
Sep 09 15:50:13.326181 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.326165    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-3ac2fa-dockercfg-85s52\""
Sep 09 15:50:13.331369 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.331347    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"]
Sep 09 15:50:13.339376 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.339345    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"]
Sep 09 15:50:13.422589 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.422534    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d22pj\" (UniqueName: \"kubernetes.io/projected/710b20fc-778a-4b93-a5d4-e4fb116a384c-kube-api-access-d22pj\") pod \"payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst\" (UID: \"710b20fc-778a-4b93-a5d4-e4fb116a384c\") " pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"
Sep 09 15:50:13.422787 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.422603    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fqz8\" (UniqueName: \"kubernetes.io/projected/4b322ad0-1ed9-48d3-aa78-ca72234b34b6-kube-api-access-9fqz8\") pod \"payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz\" (UID: \"4b322ad0-1ed9-48d3-aa78-ca72234b34b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"
Sep 09 15:50:13.422787 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.422677    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b322ad0-1ed9-48d3-aa78-ca72234b34b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz\" (UID: \"4b322ad0-1ed9-48d3-aa78-ca72234b34b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"
Sep 09 15:50:13.422787 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.422753    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/710b20fc-778a-4b93-a5d4-e4fb116a384c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst\" (UID: \"710b20fc-778a-4b93-a5d4-e4fb116a384c\") " pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"
Sep 09 15:50:13.523744 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.523698    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b322ad0-1ed9-48d3-aa78-ca72234b34b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz\" (UID: \"4b322ad0-1ed9-48d3-aa78-ca72234b34b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"
Sep 09 15:50:13.523977 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.523792    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/710b20fc-778a-4b93-a5d4-e4fb116a384c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst\" (UID: \"710b20fc-778a-4b93-a5d4-e4fb116a384c\") " pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"
Sep 09 15:50:13.523977 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.523924    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d22pj\" (UniqueName: \"kubernetes.io/projected/710b20fc-778a-4b93-a5d4-e4fb116a384c-kube-api-access-d22pj\") pod \"payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst\" (UID: \"710b20fc-778a-4b93-a5d4-e4fb116a384c\") " pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"
Sep 09 15:50:13.523977 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.523950    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fqz8\" (UniqueName: \"kubernetes.io/projected/4b322ad0-1ed9-48d3-aa78-ca72234b34b6-kube-api-access-9fqz8\") pod \"payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz\" (UID: \"4b322ad0-1ed9-48d3-aa78-ca72234b34b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"
Sep 09 15:50:13.524639 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.524614    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/710b20fc-778a-4b93-a5d4-e4fb116a384c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst\" (UID: \"710b20fc-778a-4b93-a5d4-e4fb116a384c\") " pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"
Sep 09 15:50:13.524639 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.524624    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b322ad0-1ed9-48d3-aa78-ca72234b34b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz\" (UID: \"4b322ad0-1ed9-48d3-aa78-ca72234b34b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"
Sep 09 15:50:13.532587 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.532561    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d22pj\" (UniqueName: \"kubernetes.io/projected/710b20fc-778a-4b93-a5d4-e4fb116a384c-kube-api-access-d22pj\") pod \"payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst\" (UID: \"710b20fc-778a-4b93-a5d4-e4fb116a384c\") " pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"
Sep 09 15:50:13.533133 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.533116    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fqz8\" (UniqueName: \"kubernetes.io/projected/4b322ad0-1ed9-48d3-aa78-ca72234b34b6-kube-api-access-9fqz8\") pod \"payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz\" (UID: \"4b322ad0-1ed9-48d3-aa78-ca72234b34b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"
Sep 09 15:50:13.637616 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.637530    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"
Sep 09 15:50:13.646624 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.646606    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"
Sep 09 15:50:13.921410 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.921378    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"]
Sep 09 15:50:13.923259 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:50:13.923233    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b322ad0_1ed9_48d3_aa78_ca72234b34b6.slice/crio-e18edc5f19b9e48c3799a2ab584a4d08373b0c8133971fbd08eddf1f0f112ea2 WatchSource:0}: Error finding container e18edc5f19b9e48c3799a2ab584a4d08373b0c8133971fbd08eddf1f0f112ea2: Status 404 returned error can't find the container with id e18edc5f19b9e48c3799a2ab584a4d08373b0c8133971fbd08eddf1f0f112ea2
Sep 09 15:50:13.933182 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:13.933160    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"]
Sep 09 15:50:13.937423 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:50:13.937383    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod710b20fc_778a_4b93_a5d4_e4fb116a384c.slice/crio-f8b3c8ec40a90bbf197752cdb1f22c00043fb3907701a5cdb5ed1ecbe3204a79 WatchSource:0}: Error finding container f8b3c8ec40a90bbf197752cdb1f22c00043fb3907701a5cdb5ed1ecbe3204a79: Status 404 returned error can't find the container with id f8b3c8ec40a90bbf197752cdb1f22c00043fb3907701a5cdb5ed1ecbe3204a79
Sep 09 15:50:14.428611 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:14.428573    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst" event={"ID":"710b20fc-778a-4b93-a5d4-e4fb116a384c","Type":"ContainerStarted","Data":"4f778fccefbdbb616efe8bcee32d22a62743b9f1d327941cebd1515fbf443f2b"}
Sep 09 15:50:14.429125 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:14.428642    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst" event={"ID":"710b20fc-778a-4b93-a5d4-e4fb116a384c","Type":"ContainerStarted","Data":"f8b3c8ec40a90bbf197752cdb1f22c00043fb3907701a5cdb5ed1ecbe3204a79"}
Sep 09 15:50:14.429125 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:14.428679    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"
Sep 09 15:50:14.430602 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:14.430570    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz" event={"ID":"4b322ad0-1ed9-48d3-aa78-ca72234b34b6","Type":"ContainerStarted","Data":"be3b0dde53e47b20beb9519fb8c26c79c7dc86b48e4e8e7e33c62821f7fb7887"}
Sep 09 15:50:14.430749 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:14.430627    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz" event={"ID":"4b322ad0-1ed9-48d3-aa78-ca72234b34b6","Type":"ContainerStarted","Data":"e18edc5f19b9e48c3799a2ab584a4d08373b0c8133971fbd08eddf1f0f112ea2"}
Sep 09 15:50:14.430749 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:14.430657    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"
Sep 09 15:50:14.446332 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:14.446283    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst" podStartSLOduration=1.446267024 podStartE2EDuration="1.446267024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:50:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:50:14.444327567 +0000 UTC m=+1798.634530343" watchObservedRunningTime="2026-09-09 15:50:14.446267024 +0000 UTC m=+1798.636469772"
Sep 09 15:50:14.460250 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:14.460189    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz" podStartSLOduration=1.460172176 podStartE2EDuration="1.460172176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:50:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:50:14.459029101 +0000 UTC m=+1798.649231874" watchObservedRunningTime="2026-09-09 15:50:14.460172176 +0000 UTC m=+1798.650374924"
Sep 09 15:50:25.439363 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:25.439329    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"
Sep 09 15:50:25.439805 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:25.439536    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"
Sep 09 15:50:36.595132 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:36.595099    2574 generic.go:356] "Generic (PLEG): container finished" podID="12b0578c-9bab-4836-afe9-64df8ce627ad" containerID="4298ab36b9593aad463ff4fa12a4ec5458b5103d4132c060b8a4c982c63e5139" exitCode=0
Sep 09 15:50:36.595668 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:36.595180    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb" event={"ID":"12b0578c-9bab-4836-afe9-64df8ce627ad","Type":"ContainerDied","Data":"4298ab36b9593aad463ff4fa12a4ec5458b5103d4132c060b8a4c982c63e5139"}
Sep 09 15:50:36.595774 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:36.595755    2574 scope.go:117] "RemoveContainer" containerID="4298ab36b9593aad463ff4fa12a4ec5458b5103d4132c060b8a4c982c63e5139"
Sep 09 15:50:36.597100 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:36.597068    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:50:36.597214 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:36.597140    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:50:36.597214 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:36.597177    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:50:37.612379 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:37.612326    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb" event={"ID":"12b0578c-9bab-4836-afe9-64df8ce627ad","Type":"ContainerStarted","Data":"0c72d49c02d0b9247c0be89df4b6f6df460215f3b3faaec3d1880f01e5c3eaa0"}
Sep 09 15:50:38.008168 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:38.008126    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:38.009122 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:38.009085    2574 patch_prober.go:28] interesting pod/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 09 15:50:38.009263 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:38.009151    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb" podUID="12b0578c-9bab-4836-afe9-64df8ce627ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 09 15:50:38.793914 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:38.793872    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:50:39.008022 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:39.007976    2574 patch_prober.go:28] interesting pod/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 09 15:50:39.008223 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:39.008056    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb" podUID="12b0578c-9bab-4836-afe9-64df8ce627ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 09 15:50:40.007884 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:40.007821    2574 patch_prober.go:28] interesting pod/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 09 15:50:40.008533 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:40.008497    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb" podUID="12b0578c-9bab-4836-afe9-64df8ce627ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 09 15:50:40.388402 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:40.388318    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:41.008493 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:41.008441    2574 patch_prober.go:28] interesting pod/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 09 15:50:41.009053 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:41.008536    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb" podUID="12b0578c-9bab-4836-afe9-64df8ce627ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 09 15:50:42.007533 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:42.007490    2574 patch_prober.go:28] interesting pod/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 09 15:50:42.007905 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:42.007869    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb" podUID="12b0578c-9bab-4836-afe9-64df8ce627ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 09 15:50:43.007815 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:43.007770    2574 patch_prober.go:28] interesting pod/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 09 15:50:43.008333 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:43.007871    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb" podUID="12b0578c-9bab-4836-afe9-64df8ce627ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 09 15:50:43.470279 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:43.470246    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"]
Sep 09 15:50:43.475239 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:43.475218    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"
Sep 09 15:50:43.477914 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:43.477890    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-ce9689-dockercfg-dvp9c\""
Sep 09 15:50:43.478026 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:43.477982    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-ce9689\""
Sep 09 15:50:43.482955 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:43.482925    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"]
Sep 09 15:50:43.549169 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:43.549123    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eccb9634-dde1-49b4-a402-b2aa557b5d5f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm\" (UID: \"eccb9634-dde1-49b4-a402-b2aa557b5d5f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"
Sep 09 15:50:43.549369 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:43.549348    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhd2g\" (UniqueName: \"kubernetes.io/projected/eccb9634-dde1-49b4-a402-b2aa557b5d5f-kube-api-access-lhd2g\") pod \"payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm\" (UID: \"eccb9634-dde1-49b4-a402-b2aa557b5d5f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"
Sep 09 15:50:43.650869 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:43.650805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhd2g\" (UniqueName: \"kubernetes.io/projected/eccb9634-dde1-49b4-a402-b2aa557b5d5f-kube-api-access-lhd2g\") pod \"payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm\" (UID: \"eccb9634-dde1-49b4-a402-b2aa557b5d5f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"
Sep 09 15:50:43.651087 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:43.650900    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eccb9634-dde1-49b4-a402-b2aa557b5d5f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm\" (UID: \"eccb9634-dde1-49b4-a402-b2aa557b5d5f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"
Sep 09 15:50:43.651604 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:43.651585    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eccb9634-dde1-49b4-a402-b2aa557b5d5f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm\" (UID: \"eccb9634-dde1-49b4-a402-b2aa557b5d5f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"
Sep 09 15:50:43.659742 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:43.659713    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhd2g\" (UniqueName: \"kubernetes.io/projected/eccb9634-dde1-49b4-a402-b2aa557b5d5f-kube-api-access-lhd2g\") pod \"payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm\" (UID: \"eccb9634-dde1-49b4-a402-b2aa557b5d5f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"
Sep 09 15:50:43.789201 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:43.789111    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"
Sep 09 15:50:44.012420 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:44.012389    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:44.013424 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:44.013400    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:50:44.074448 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:44.074411    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"]
Sep 09 15:50:44.074610 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:50:44.074525    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeccb9634_dde1_49b4_a402_b2aa557b5d5f.slice/crio-d0371c68a35f5c9eadbd8daebf5f364809679e151365bd330b2165c8a180a58d WatchSource:0}: Error finding container d0371c68a35f5c9eadbd8daebf5f364809679e151365bd330b2165c8a180a58d: Status 404 returned error can't find the container with id d0371c68a35f5c9eadbd8daebf5f364809679e151365bd330b2165c8a180a58d
Sep 09 15:50:44.674610 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:44.674573    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm" event={"ID":"eccb9634-dde1-49b4-a402-b2aa557b5d5f","Type":"ContainerStarted","Data":"67a7e829e21ec890359df1bec79fff7d8f1e5b4b6f66c6358796becbaa49bf73"}
Sep 09 15:50:44.674772 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:44.674627    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm" event={"ID":"eccb9634-dde1-49b4-a402-b2aa557b5d5f","Type":"ContainerStarted","Data":"d0371c68a35f5c9eadbd8daebf5f364809679e151365bd330b2165c8a180a58d"}
Sep 09 15:50:44.674772 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:44.674667    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"
Sep 09 15:50:44.692540 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:44.692482    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm" podStartSLOduration=1.6924622820000002 podStartE2EDuration="1.692462282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:50:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:50:44.690518152 +0000 UTC m=+1828.880720913" watchObservedRunningTime="2026-09-09 15:50:44.692462282 +0000 UTC m=+1828.882665084"
Sep 09 15:50:55.683669 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:50:55.683637    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"
Sep 09 15:51:15.693522 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:15.693482    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:51:16.645599 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:16.645566    2574 scope.go:117] "RemoveContainer" containerID="cc13298e2ed9d74c08030a57d52bdabc3f522f9a062e69aef89f49e5ad23a63c"
Sep 09 15:51:26.328686 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.328645    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"]
Sep 09 15:51:26.329592 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.328985    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst" podUID="710b20fc-778a-4b93-a5d4-e4fb116a384c" containerName="payload-processing" containerID="cri-o://4f778fccefbdbb616efe8bcee32d22a62743b9f1d327941cebd1515fbf443f2b" gracePeriod=30
Sep 09 15:51:26.331248 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.331221    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"]
Sep 09 15:51:26.331465 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.331441    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz" podUID="4b322ad0-1ed9-48d3-aa78-ca72234b34b6" containerName="payload-pre-processing" containerID="cri-o://be3b0dde53e47b20beb9519fb8c26c79c7dc86b48e4e8e7e33c62821f7fb7887" gracePeriod=30
Sep 09 15:51:26.636173 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.636147    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"
Sep 09 15:51:26.639378 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.639350    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"
Sep 09 15:51:26.813648 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.813611    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/710b20fc-778a-4b93-a5d4-e4fb116a384c-plugins-config-volume\") pod \"710b20fc-778a-4b93-a5d4-e4fb116a384c\" (UID: \"710b20fc-778a-4b93-a5d4-e4fb116a384c\") "
Sep 09 15:51:26.813886 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.813808    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fqz8\" (UniqueName: \"kubernetes.io/projected/4b322ad0-1ed9-48d3-aa78-ca72234b34b6-kube-api-access-9fqz8\") pod \"4b322ad0-1ed9-48d3-aa78-ca72234b34b6\" (UID: \"4b322ad0-1ed9-48d3-aa78-ca72234b34b6\") "
Sep 09 15:51:26.813886 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.813838    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d22pj\" (UniqueName: \"kubernetes.io/projected/710b20fc-778a-4b93-a5d4-e4fb116a384c-kube-api-access-d22pj\") pod \"710b20fc-778a-4b93-a5d4-e4fb116a384c\" (UID: \"710b20fc-778a-4b93-a5d4-e4fb116a384c\") "
Sep 09 15:51:26.814018 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.813918    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b322ad0-1ed9-48d3-aa78-ca72234b34b6-plugins-config-volume\") pod \"4b322ad0-1ed9-48d3-aa78-ca72234b34b6\" (UID: \"4b322ad0-1ed9-48d3-aa78-ca72234b34b6\") "
Sep 09 15:51:26.814141 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.814108    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/710b20fc-778a-4b93-a5d4-e4fb116a384c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "710b20fc-778a-4b93-a5d4-e4fb116a384c" (UID: "710b20fc-778a-4b93-a5d4-e4fb116a384c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:51:26.814284 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.814257    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b322ad0-1ed9-48d3-aa78-ca72234b34b6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4b322ad0-1ed9-48d3-aa78-ca72234b34b6" (UID: "4b322ad0-1ed9-48d3-aa78-ca72234b34b6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:51:26.814380 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.814355    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b322ad0-1ed9-48d3-aa78-ca72234b34b6-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:51:26.814448 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.814381    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/710b20fc-778a-4b93-a5d4-e4fb116a384c-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:51:26.816511 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.816473    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b322ad0-1ed9-48d3-aa78-ca72234b34b6-kube-api-access-9fqz8" (OuterVolumeSpecName: "kube-api-access-9fqz8") pod "4b322ad0-1ed9-48d3-aa78-ca72234b34b6" (UID: "4b322ad0-1ed9-48d3-aa78-ca72234b34b6"). InnerVolumeSpecName "kube-api-access-9fqz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:51:26.817054 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.817020    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/710b20fc-778a-4b93-a5d4-e4fb116a384c-kube-api-access-d22pj" (OuterVolumeSpecName: "kube-api-access-d22pj") pod "710b20fc-778a-4b93-a5d4-e4fb116a384c" (UID: "710b20fc-778a-4b93-a5d4-e4fb116a384c"). InnerVolumeSpecName "kube-api-access-d22pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:51:26.915082 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.915006    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fqz8\" (UniqueName: \"kubernetes.io/projected/4b322ad0-1ed9-48d3-aa78-ca72234b34b6-kube-api-access-9fqz8\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:51:26.915082 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.915034    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d22pj\" (UniqueName: \"kubernetes.io/projected/710b20fc-778a-4b93-a5d4-e4fb116a384c-kube-api-access-d22pj\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:51:26.955005 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.954969    2574 generic.go:356] "Generic (PLEG): container finished" podID="710b20fc-778a-4b93-a5d4-e4fb116a384c" containerID="4f778fccefbdbb616efe8bcee32d22a62743b9f1d327941cebd1515fbf443f2b" exitCode=0
Sep 09 15:51:26.955205 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.955020    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"
Sep 09 15:51:26.955205 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.955049    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst" event={"ID":"710b20fc-778a-4b93-a5d4-e4fb116a384c","Type":"ContainerDied","Data":"4f778fccefbdbb616efe8bcee32d22a62743b9f1d327941cebd1515fbf443f2b"}
Sep 09 15:51:26.955205 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.955102    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst" event={"ID":"710b20fc-778a-4b93-a5d4-e4fb116a384c","Type":"ContainerDied","Data":"f8b3c8ec40a90bbf197752cdb1f22c00043fb3907701a5cdb5ed1ecbe3204a79"}
Sep 09 15:51:26.955205 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.955125    2574 scope.go:117] "RemoveContainer" containerID="4f778fccefbdbb616efe8bcee32d22a62743b9f1d327941cebd1515fbf443f2b"
Sep 09 15:51:26.956736 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.956708    2574 generic.go:356] "Generic (PLEG): container finished" podID="4b322ad0-1ed9-48d3-aa78-ca72234b34b6" containerID="be3b0dde53e47b20beb9519fb8c26c79c7dc86b48e4e8e7e33c62821f7fb7887" exitCode=0
Sep 09 15:51:26.956870 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.956752    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"
Sep 09 15:51:26.956952 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.956869    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz" event={"ID":"4b322ad0-1ed9-48d3-aa78-ca72234b34b6","Type":"ContainerDied","Data":"be3b0dde53e47b20beb9519fb8c26c79c7dc86b48e4e8e7e33c62821f7fb7887"}
Sep 09 15:51:26.956952 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.956924    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz" event={"ID":"4b322ad0-1ed9-48d3-aa78-ca72234b34b6","Type":"ContainerDied","Data":"e18edc5f19b9e48c3799a2ab584a4d08373b0c8133971fbd08eddf1f0f112ea2"}
Sep 09 15:51:26.967003 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.966984    2574 scope.go:117] "RemoveContainer" containerID="4f778fccefbdbb616efe8bcee32d22a62743b9f1d327941cebd1515fbf443f2b"
Sep 09 15:51:26.967399 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:51:26.967371    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f778fccefbdbb616efe8bcee32d22a62743b9f1d327941cebd1515fbf443f2b\": container with ID starting with 4f778fccefbdbb616efe8bcee32d22a62743b9f1d327941cebd1515fbf443f2b not found: ID does not exist" containerID="4f778fccefbdbb616efe8bcee32d22a62743b9f1d327941cebd1515fbf443f2b"
Sep 09 15:51:26.967495 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.967411    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f778fccefbdbb616efe8bcee32d22a62743b9f1d327941cebd1515fbf443f2b"} err="failed to get container status \"4f778fccefbdbb616efe8bcee32d22a62743b9f1d327941cebd1515fbf443f2b\": rpc error: code = NotFound desc = could not find container \"4f778fccefbdbb616efe8bcee32d22a62743b9f1d327941cebd1515fbf443f2b\": container with ID starting with 4f778fccefbdbb616efe8bcee32d22a62743b9f1d327941cebd1515fbf443f2b not found: ID does not exist"
Sep 09 15:51:26.967495 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.967434    2574 scope.go:117] "RemoveContainer" containerID="be3b0dde53e47b20beb9519fb8c26c79c7dc86b48e4e8e7e33c62821f7fb7887"
Sep 09 15:51:26.977779 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.977763    2574 scope.go:117] "RemoveContainer" containerID="be3b0dde53e47b20beb9519fb8c26c79c7dc86b48e4e8e7e33c62821f7fb7887"
Sep 09 15:51:26.978098 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:51:26.978078    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be3b0dde53e47b20beb9519fb8c26c79c7dc86b48e4e8e7e33c62821f7fb7887\": container with ID starting with be3b0dde53e47b20beb9519fb8c26c79c7dc86b48e4e8e7e33c62821f7fb7887 not found: ID does not exist" containerID="be3b0dde53e47b20beb9519fb8c26c79c7dc86b48e4e8e7e33c62821f7fb7887"
Sep 09 15:51:26.978148 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.978106    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be3b0dde53e47b20beb9519fb8c26c79c7dc86b48e4e8e7e33c62821f7fb7887"} err="failed to get container status \"be3b0dde53e47b20beb9519fb8c26c79c7dc86b48e4e8e7e33c62821f7fb7887\": rpc error: code = NotFound desc = could not find container \"be3b0dde53e47b20beb9519fb8c26c79c7dc86b48e4e8e7e33c62821f7fb7887\": container with ID starting with be3b0dde53e47b20beb9519fb8c26c79c7dc86b48e4e8e7e33c62821f7fb7887 not found: ID does not exist"
Sep 09 15:51:26.983639 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.983616    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"]
Sep 09 15:51:26.988876 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:26.988854    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3ac2fa-6d5f9d76c8-m9bkz"]
Sep 09 15:51:27.002152 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:27.002122    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"]
Sep 09 15:51:27.007313 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:27.007289    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3ac2fa-77c6c87879-slrst"]
Sep 09 15:51:28.321331 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:28.321299    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b322ad0-1ed9-48d3-aa78-ca72234b34b6" path="/var/lib/kubelet/pods/4b322ad0-1ed9-48d3-aa78-ca72234b34b6/volumes"
Sep 09 15:51:28.321766 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:28.321750    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="710b20fc-778a-4b93-a5d4-e4fb116a384c" path="/var/lib/kubelet/pods/710b20fc-778a-4b93-a5d4-e4fb116a384c/volumes"
Sep 09 15:51:32.912545 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:32.912514    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"]
Sep 09 15:51:32.913079 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:32.912734    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb" podUID="12b0578c-9bab-4836-afe9-64df8ce627ad" containerName="istio-proxy" containerID="cri-o://0c72d49c02d0b9247c0be89df4b6f6df460215f3b3faaec3d1880f01e5c3eaa0" gracePeriod=30
Sep 09 15:51:38.049594 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.049561    2574 generic.go:356] "Generic (PLEG): container finished" podID="12b0578c-9bab-4836-afe9-64df8ce627ad" containerID="0c72d49c02d0b9247c0be89df4b6f6df460215f3b3faaec3d1880f01e5c3eaa0" exitCode=0
Sep 09 15:51:38.050012 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.049636    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb" event={"ID":"12b0578c-9bab-4836-afe9-64df8ce627ad","Type":"ContainerDied","Data":"0c72d49c02d0b9247c0be89df4b6f6df460215f3b3faaec3d1880f01e5c3eaa0"}
Sep 09 15:51:38.050012 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.049705    2574 scope.go:117] "RemoveContainer" containerID="4298ab36b9593aad463ff4fa12a4ec5458b5103d4132c060b8a4c982c63e5139"
Sep 09 15:51:38.178687 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.178631    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:51:38.239971 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.239932    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-workload-certs\") pod \"12b0578c-9bab-4836-afe9-64df8ce627ad\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") "
Sep 09 15:51:38.240184 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.240046    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-credential-socket\") pod \"12b0578c-9bab-4836-afe9-64df8ce627ad\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") "
Sep 09 15:51:38.240184 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.240076    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhvdp\" (UniqueName: \"kubernetes.io/projected/12b0578c-9bab-4836-afe9-64df8ce627ad-kube-api-access-lhvdp\") pod \"12b0578c-9bab-4836-afe9-64df8ce627ad\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") "
Sep 09 15:51:38.240184 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.240116    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-envoy\") pod \"12b0578c-9bab-4836-afe9-64df8ce627ad\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") "
Sep 09 15:51:38.240395 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.240245    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12b0578c-9bab-4836-afe9-64df8ce627ad-istiod-ca-cert\") pod \"12b0578c-9bab-4836-afe9-64df8ce627ad\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") "
Sep 09 15:51:38.240395 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.240325    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-podinfo\") pod \"12b0578c-9bab-4836-afe9-64df8ce627ad\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") "
Sep 09 15:51:38.240395 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.240356    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-data\") pod \"12b0578c-9bab-4836-afe9-64df8ce627ad\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") "
Sep 09 15:51:38.240395 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.240241    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "12b0578c-9bab-4836-afe9-64df8ce627ad" (UID: "12b0578c-9bab-4836-afe9-64df8ce627ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:51:38.240395 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.240357    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "12b0578c-9bab-4836-afe9-64df8ce627ad" (UID: "12b0578c-9bab-4836-afe9-64df8ce627ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:51:38.240395 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.240394    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-token\") pod \"12b0578c-9bab-4836-afe9-64df8ce627ad\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") "
Sep 09 15:51:38.240710 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.240464    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-workload-socket\") pod \"12b0578c-9bab-4836-afe9-64df8ce627ad\" (UID: \"12b0578c-9bab-4836-afe9-64df8ce627ad\") "
Sep 09 15:51:38.240710 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.240602    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12b0578c-9bab-4836-afe9-64df8ce627ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "12b0578c-9bab-4836-afe9-64df8ce627ad" (UID: "12b0578c-9bab-4836-afe9-64df8ce627ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:51:38.240925 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.240868    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "12b0578c-9bab-4836-afe9-64df8ce627ad" (UID: "12b0578c-9bab-4836-afe9-64df8ce627ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:51:38.240925 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.240668    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "12b0578c-9bab-4836-afe9-64df8ce627ad" (UID: "12b0578c-9bab-4836-afe9-64df8ce627ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:51:38.241161 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.241097    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-credential-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:51:38.241231 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.241168    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12b0578c-9bab-4836-afe9-64df8ce627ad-istiod-ca-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:51:38.241231 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.241185    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-workload-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:51:38.241231 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.241198    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-workload-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:51:38.242647 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.242625    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "12b0578c-9bab-4836-afe9-64df8ce627ad" (UID: "12b0578c-9bab-4836-afe9-64df8ce627ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 15:51:38.242759 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.242665    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "12b0578c-9bab-4836-afe9-64df8ce627ad" (UID: "12b0578c-9bab-4836-afe9-64df8ce627ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:51:38.242875 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.242827    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12b0578c-9bab-4836-afe9-64df8ce627ad-kube-api-access-lhvdp" (OuterVolumeSpecName: "kube-api-access-lhvdp") pod "12b0578c-9bab-4836-afe9-64df8ce627ad" (UID: "12b0578c-9bab-4836-afe9-64df8ce627ad"). InnerVolumeSpecName "kube-api-access-lhvdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:51:38.242928 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.242895    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "12b0578c-9bab-4836-afe9-64df8ce627ad" (UID: "12b0578c-9bab-4836-afe9-64df8ce627ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:51:38.342590 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.342562    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-podinfo\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:51:38.342590 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.342587    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-data\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:51:38.342760 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.342597    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-token\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:51:38.342760 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.342609    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhvdp\" (UniqueName: \"kubernetes.io/projected/12b0578c-9bab-4836-afe9-64df8ce627ad-kube-api-access-lhvdp\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:51:38.342760 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:38.342617    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12b0578c-9bab-4836-afe9-64df8ce627ad-istio-envoy\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:51:39.057653 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:39.057624    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"
Sep 09 15:51:39.058127 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:39.057667    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb" event={"ID":"12b0578c-9bab-4836-afe9-64df8ce627ad","Type":"ContainerDied","Data":"f766db07b3c2148f14a7025c0932f494242e07b8acc435556ce471322fa09004"}
Sep 09 15:51:39.058127 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:39.057728    2574 scope.go:117] "RemoveContainer" containerID="0c72d49c02d0b9247c0be89df4b6f6df460215f3b3faaec3d1880f01e5c3eaa0"
Sep 09 15:51:39.077406 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:39.077373    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"]
Sep 09 15:51:39.080783 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:39.080752    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-3ac2fa-openshift-default-6f7b7f7f56-2rdgb"]
Sep 09 15:51:40.321230 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:40.321194    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12b0578c-9bab-4836-afe9-64df8ce627ad" path="/var/lib/kubelet/pods/12b0578c-9bab-4836-afe9-64df8ce627ad/volumes"
Sep 09 15:51:41.499733 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:41.499697    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:51:48.914681 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:48.914640    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"]
Sep 09 15:51:48.915181 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:48.914928    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm" podUID="eccb9634-dde1-49b4-a402-b2aa557b5d5f" containerName="payload-pre-processing" containerID="cri-o://67a7e829e21ec890359df1bec79fff7d8f1e5b4b6f66c6358796becbaa49bf73" gracePeriod=30
Sep 09 15:51:49.130501 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:49.130468    2574 generic.go:356] "Generic (PLEG): container finished" podID="eccb9634-dde1-49b4-a402-b2aa557b5d5f" containerID="67a7e829e21ec890359df1bec79fff7d8f1e5b4b6f66c6358796becbaa49bf73" exitCode=0
Sep 09 15:51:49.130669 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:49.130530    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm" event={"ID":"eccb9634-dde1-49b4-a402-b2aa557b5d5f","Type":"ContainerDied","Data":"67a7e829e21ec890359df1bec79fff7d8f1e5b4b6f66c6358796becbaa49bf73"}
Sep 09 15:51:49.182409 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:49.182387    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"
Sep 09 15:51:49.359203 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:49.359164    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eccb9634-dde1-49b4-a402-b2aa557b5d5f-plugins-config-volume\") pod \"eccb9634-dde1-49b4-a402-b2aa557b5d5f\" (UID: \"eccb9634-dde1-49b4-a402-b2aa557b5d5f\") "
Sep 09 15:51:49.359415 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:49.359292    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhd2g\" (UniqueName: \"kubernetes.io/projected/eccb9634-dde1-49b4-a402-b2aa557b5d5f-kube-api-access-lhd2g\") pod \"eccb9634-dde1-49b4-a402-b2aa557b5d5f\" (UID: \"eccb9634-dde1-49b4-a402-b2aa557b5d5f\") "
Sep 09 15:51:49.359619 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:49.359589    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eccb9634-dde1-49b4-a402-b2aa557b5d5f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eccb9634-dde1-49b4-a402-b2aa557b5d5f" (UID: "eccb9634-dde1-49b4-a402-b2aa557b5d5f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:51:49.361627 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:49.361599    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eccb9634-dde1-49b4-a402-b2aa557b5d5f-kube-api-access-lhd2g" (OuterVolumeSpecName: "kube-api-access-lhd2g") pod "eccb9634-dde1-49b4-a402-b2aa557b5d5f" (UID: "eccb9634-dde1-49b4-a402-b2aa557b5d5f"). InnerVolumeSpecName "kube-api-access-lhd2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:51:49.461337 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:49.461290    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eccb9634-dde1-49b4-a402-b2aa557b5d5f-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:51:49.461337 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:49.461334    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhd2g\" (UniqueName: \"kubernetes.io/projected/eccb9634-dde1-49b4-a402-b2aa557b5d5f-kube-api-access-lhd2g\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:51:50.138554 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:50.138509    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm" event={"ID":"eccb9634-dde1-49b4-a402-b2aa557b5d5f","Type":"ContainerDied","Data":"d0371c68a35f5c9eadbd8daebf5f364809679e151365bd330b2165c8a180a58d"}
Sep 09 15:51:50.138554 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:50.138533    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"
Sep 09 15:51:50.139067 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:50.138571    2574 scope.go:117] "RemoveContainer" containerID="67a7e829e21ec890359df1bec79fff7d8f1e5b4b6f66c6358796becbaa49bf73"
Sep 09 15:51:50.161255 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:50.161223    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"]
Sep 09 15:51:50.164559 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:50.164534    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ce9689-646c64474b-w22gm"]
Sep 09 15:51:50.320627 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:51:50.320591    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eccb9634-dde1-49b4-a402-b2aa557b5d5f" path="/var/lib/kubelet/pods/eccb9634-dde1-49b4-a402-b2aa557b5d5f/volumes"
Sep 09 15:52:06.174466 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.174433    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"]
Sep 09 15:52:06.175429 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.175353    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd" podUID="c4231318-06eb-4c6a-b579-577254bf1e04" containerName="maas-api" containerID="cri-o://1376ac11ca219ebff9df6fa41136c579027aa626847417fedbdb9975474ad469" gracePeriod=30
Sep 09 15:52:06.208559 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.208531    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ce3053-29816145-gljk5"]
Sep 09 15:52:06.211710 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.211685    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ce3053-29816145-gljk5"]
Sep 09 15:52:06.232942 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.232907    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"]
Sep 09 15:52:06.233197 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.233151    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj" podUID="95478527-65df-46ca-9f93-90bc70449016" containerName="payload-processing" containerID="cri-o://a61a3a399debd5c2114c222065b7794ee7817d3c00ca1b1ed19e1291211fdcd1" gracePeriod=30
Sep 09 15:52:06.320956 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.320924    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="532fb71d-af21-4233-b007-985b12035973" path="/var/lib/kubelet/pods/532fb71d-af21-4233-b007-985b12035973/volumes"
Sep 09 15:52:06.527269 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.527242    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:52:06.531119 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.531096    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"
Sep 09 15:52:06.637685 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.637649    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj8fc\" (UniqueName: \"kubernetes.io/projected/c4231318-06eb-4c6a-b579-577254bf1e04-kube-api-access-lj8fc\") pod \"c4231318-06eb-4c6a-b579-577254bf1e04\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") "
Sep 09 15:52:06.637940 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.637730    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4231318-06eb-4c6a-b579-577254bf1e04-openshift-service-ca\") pod \"c4231318-06eb-4c6a-b579-577254bf1e04\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") "
Sep 09 15:52:06.637940 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.637814    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95478527-65df-46ca-9f93-90bc70449016-plugins-config-volume\") pod \"95478527-65df-46ca-9f93-90bc70449016\" (UID: \"95478527-65df-46ca-9f93-90bc70449016\") "
Sep 09 15:52:06.637940 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.637898    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj76g\" (UniqueName: \"kubernetes.io/projected/95478527-65df-46ca-9f93-90bc70449016-kube-api-access-dj76g\") pod \"95478527-65df-46ca-9f93-90bc70449016\" (UID: \"95478527-65df-46ca-9f93-90bc70449016\") "
Sep 09 15:52:06.637940 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.637930    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4231318-06eb-4c6a-b579-577254bf1e04-maas-api-tls\") pod \"c4231318-06eb-4c6a-b579-577254bf1e04\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") "
Sep 09 15:52:06.638206 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.637985    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4231318-06eb-4c6a-b579-577254bf1e04-metrics-certs\") pod \"c4231318-06eb-4c6a-b579-577254bf1e04\" (UID: \"c4231318-06eb-4c6a-b579-577254bf1e04\") "
Sep 09 15:52:06.638271 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.638223    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4231318-06eb-4c6a-b579-577254bf1e04-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c4231318-06eb-4c6a-b579-577254bf1e04" (UID: "c4231318-06eb-4c6a-b579-577254bf1e04"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:52:06.638386 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.638360    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4231318-06eb-4c6a-b579-577254bf1e04-openshift-service-ca\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:06.638900 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.638867    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95478527-65df-46ca-9f93-90bc70449016-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "95478527-65df-46ca-9f93-90bc70449016" (UID: "95478527-65df-46ca-9f93-90bc70449016"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:52:06.640971 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.640942    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95478527-65df-46ca-9f93-90bc70449016-kube-api-access-dj76g" (OuterVolumeSpecName: "kube-api-access-dj76g") pod "95478527-65df-46ca-9f93-90bc70449016" (UID: "95478527-65df-46ca-9f93-90bc70449016"). InnerVolumeSpecName "kube-api-access-dj76g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:52:06.641082 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.641010    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4231318-06eb-4c6a-b579-577254bf1e04-kube-api-access-lj8fc" (OuterVolumeSpecName: "kube-api-access-lj8fc") pod "c4231318-06eb-4c6a-b579-577254bf1e04" (UID: "c4231318-06eb-4c6a-b579-577254bf1e04"). InnerVolumeSpecName "kube-api-access-lj8fc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:52:06.641125 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.641098    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4231318-06eb-4c6a-b579-577254bf1e04-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c4231318-06eb-4c6a-b579-577254bf1e04" (UID: "c4231318-06eb-4c6a-b579-577254bf1e04"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:52:06.641281 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.641261    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4231318-06eb-4c6a-b579-577254bf1e04-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c4231318-06eb-4c6a-b579-577254bf1e04" (UID: "c4231318-06eb-4c6a-b579-577254bf1e04"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:52:06.739378 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.739337    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95478527-65df-46ca-9f93-90bc70449016-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:06.739378 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.739371    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj76g\" (UniqueName: \"kubernetes.io/projected/95478527-65df-46ca-9f93-90bc70449016-kube-api-access-dj76g\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:06.739378 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.739384    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4231318-06eb-4c6a-b579-577254bf1e04-maas-api-tls\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:06.739673 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.739393    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4231318-06eb-4c6a-b579-577254bf1e04-metrics-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:06.739673 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:06.739401    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj8fc\" (UniqueName: \"kubernetes.io/projected/c4231318-06eb-4c6a-b579-577254bf1e04-kube-api-access-lj8fc\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:07.254238 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.254196    2574 generic.go:356] "Generic (PLEG): container finished" podID="95478527-65df-46ca-9f93-90bc70449016" containerID="a61a3a399debd5c2114c222065b7794ee7817d3c00ca1b1ed19e1291211fdcd1" exitCode=0
Sep 09 15:52:07.254710 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.254248    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"
Sep 09 15:52:07.254710 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.254291    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj" event={"ID":"95478527-65df-46ca-9f93-90bc70449016","Type":"ContainerDied","Data":"a61a3a399debd5c2114c222065b7794ee7817d3c00ca1b1ed19e1291211fdcd1"}
Sep 09 15:52:07.254710 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.254345    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj" event={"ID":"95478527-65df-46ca-9f93-90bc70449016","Type":"ContainerDied","Data":"728703451b24c14c9eb4508a8a6a4f4053448b4fe7d28bbc7a23770c2b56d5dd"}
Sep 09 15:52:07.254710 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.254368    2574 scope.go:117] "RemoveContainer" containerID="a61a3a399debd5c2114c222065b7794ee7817d3c00ca1b1ed19e1291211fdcd1"
Sep 09 15:52:07.255801 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.255775    2574 generic.go:356] "Generic (PLEG): container finished" podID="c4231318-06eb-4c6a-b579-577254bf1e04" containerID="1376ac11ca219ebff9df6fa41136c579027aa626847417fedbdb9975474ad469" exitCode=0
Sep 09 15:52:07.255943 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.255918    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd" event={"ID":"c4231318-06eb-4c6a-b579-577254bf1e04","Type":"ContainerDied","Data":"1376ac11ca219ebff9df6fa41136c579027aa626847417fedbdb9975474ad469"}
Sep 09 15:52:07.256036 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.255981    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd" event={"ID":"c4231318-06eb-4c6a-b579-577254bf1e04","Type":"ContainerDied","Data":"c56d895044a478c481d6b22a0c7068f7e564aa19b710c94b8dda996dc8294db5"}
Sep 09 15:52:07.256107 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.255931    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"
Sep 09 15:52:07.266210 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.266193    2574 scope.go:117] "RemoveContainer" containerID="a61a3a399debd5c2114c222065b7794ee7817d3c00ca1b1ed19e1291211fdcd1"
Sep 09 15:52:07.266581 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:52:07.266538    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a61a3a399debd5c2114c222065b7794ee7817d3c00ca1b1ed19e1291211fdcd1\": container with ID starting with a61a3a399debd5c2114c222065b7794ee7817d3c00ca1b1ed19e1291211fdcd1 not found: ID does not exist" containerID="a61a3a399debd5c2114c222065b7794ee7817d3c00ca1b1ed19e1291211fdcd1"
Sep 09 15:52:07.266696 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.266573    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a61a3a399debd5c2114c222065b7794ee7817d3c00ca1b1ed19e1291211fdcd1"} err="failed to get container status \"a61a3a399debd5c2114c222065b7794ee7817d3c00ca1b1ed19e1291211fdcd1\": rpc error: code = NotFound desc = could not find container \"a61a3a399debd5c2114c222065b7794ee7817d3c00ca1b1ed19e1291211fdcd1\": container with ID starting with a61a3a399debd5c2114c222065b7794ee7817d3c00ca1b1ed19e1291211fdcd1 not found: ID does not exist"
Sep 09 15:52:07.266696 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.266598    2574 scope.go:117] "RemoveContainer" containerID="1376ac11ca219ebff9df6fa41136c579027aa626847417fedbdb9975474ad469"
Sep 09 15:52:07.275831 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.275810    2574 scope.go:117] "RemoveContainer" containerID="1376ac11ca219ebff9df6fa41136c579027aa626847417fedbdb9975474ad469"
Sep 09 15:52:07.276156 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:52:07.276136    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1376ac11ca219ebff9df6fa41136c579027aa626847417fedbdb9975474ad469\": container with ID starting with 1376ac11ca219ebff9df6fa41136c579027aa626847417fedbdb9975474ad469 not found: ID does not exist" containerID="1376ac11ca219ebff9df6fa41136c579027aa626847417fedbdb9975474ad469"
Sep 09 15:52:07.276235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.276164    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1376ac11ca219ebff9df6fa41136c579027aa626847417fedbdb9975474ad469"} err="failed to get container status \"1376ac11ca219ebff9df6fa41136c579027aa626847417fedbdb9975474ad469\": rpc error: code = NotFound desc = could not find container \"1376ac11ca219ebff9df6fa41136c579027aa626847417fedbdb9975474ad469\": container with ID starting with 1376ac11ca219ebff9df6fa41136c579027aa626847417fedbdb9975474ad469 not found: ID does not exist"
Sep 09 15:52:07.278243 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.278222    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"]
Sep 09 15:52:07.283859 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.283823    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ce3053-7cc75dc487-hdkjj"]
Sep 09 15:52:07.294499 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.294474    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"]
Sep 09 15:52:07.297835 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:07.297812    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce3053-67d7cbbb57-wfncd"]
Sep 09 15:52:08.320782 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:08.320748    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95478527-65df-46ca-9f93-90bc70449016" path="/var/lib/kubelet/pods/95478527-65df-46ca-9f93-90bc70449016/volumes"
Sep 09 15:52:08.321202 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:08.321186    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4231318-06eb-4c6a-b579-577254bf1e04" path="/var/lib/kubelet/pods/c4231318-06eb-4c6a-b579-577254bf1e04/volumes"
Sep 09 15:52:12.711993 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:12.711954    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"]
Sep 09 15:52:12.712464 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:12.712267    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98" podUID="7e6f3664-fb97-42ac-be4b-3fba79e73e08" containerName="istio-proxy" containerID="cri-o://a835018262e21fba0ccbf6da79092dd85c8ee392820cfcdd73e966958c7643bc" gracePeriod=30
Sep 09 15:52:15.605331 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:15.600311    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:52:16.670023 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:16.669995    2574 scope.go:117] "RemoveContainer" containerID="7bbae5a84b4404e44cd2d229771e7efa2a06e2d250d4a8647fea23198c0fb165"
Sep 09 15:52:17.976678 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:17.976615    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:52:18.058033 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.057994    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-envoy\") pod \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") "
Sep 09 15:52:18.058235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.058068    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-workload-socket\") pod \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") "
Sep 09 15:52:18.058235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.058092    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-data\") pod \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") "
Sep 09 15:52:18.058235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.058112    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-workload-certs\") pod \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") "
Sep 09 15:52:18.058235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.058140    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnjtz\" (UniqueName: \"kubernetes.io/projected/7e6f3664-fb97-42ac-be4b-3fba79e73e08-kube-api-access-fnjtz\") pod \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") "
Sep 09 15:52:18.058235 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.058213    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-podinfo\") pod \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") "
Sep 09 15:52:18.058543 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.058260    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istiod-ca-cert\") pod \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") "
Sep 09 15:52:18.058543 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.058296    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-token\") pod \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") "
Sep 09 15:52:18.058543 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.058329    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-credential-socket\") pod \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\" (UID: \"7e6f3664-fb97-42ac-be4b-3fba79e73e08\") "
Sep 09 15:52:18.058543 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.058427    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7e6f3664-fb97-42ac-be4b-3fba79e73e08" (UID: "7e6f3664-fb97-42ac-be4b-3fba79e73e08"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:52:18.058543 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.058438    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7e6f3664-fb97-42ac-be4b-3fba79e73e08" (UID: "7e6f3664-fb97-42ac-be4b-3fba79e73e08"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:52:18.058543 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.058453    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-data" (OuterVolumeSpecName: "istio-data") pod "7e6f3664-fb97-42ac-be4b-3fba79e73e08" (UID: "7e6f3664-fb97-42ac-be4b-3fba79e73e08"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:52:18.059055 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.058722    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7e6f3664-fb97-42ac-be4b-3fba79e73e08" (UID: "7e6f3664-fb97-42ac-be4b-3fba79e73e08"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:52:18.059055 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.058757    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-workload-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:18.059055 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.058779    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-data\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:18.059055 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.058793    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-workload-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:18.059055 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.058805    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7e6f3664-fb97-42ac-be4b-3fba79e73e08" (UID: "7e6f3664-fb97-42ac-be4b-3fba79e73e08"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:52:18.060594 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.060563    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7e6f3664-fb97-42ac-be4b-3fba79e73e08" (UID: "7e6f3664-fb97-42ac-be4b-3fba79e73e08"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:52:18.060705 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.060612    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-token" (OuterVolumeSpecName: "istio-token") pod "7e6f3664-fb97-42ac-be4b-3fba79e73e08" (UID: "7e6f3664-fb97-42ac-be4b-3fba79e73e08"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:52:18.061052 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.061033    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7e6f3664-fb97-42ac-be4b-3fba79e73e08" (UID: "7e6f3664-fb97-42ac-be4b-3fba79e73e08"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 15:52:18.061107 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.061068    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e6f3664-fb97-42ac-be4b-3fba79e73e08-kube-api-access-fnjtz" (OuterVolumeSpecName: "kube-api-access-fnjtz") pod "7e6f3664-fb97-42ac-be4b-3fba79e73e08" (UID: "7e6f3664-fb97-42ac-be4b-3fba79e73e08"). InnerVolumeSpecName "kube-api-access-fnjtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:52:18.159959 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.159833    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnjtz\" (UniqueName: \"kubernetes.io/projected/7e6f3664-fb97-42ac-be4b-3fba79e73e08-kube-api-access-fnjtz\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:18.160102 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.159966    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-podinfo\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:18.160102 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.159983    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istiod-ca-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:18.160102 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.159996    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-token\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:18.160102 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.160010    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-credential-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:18.160102 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.160024    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e6f3664-fb97-42ac-be4b-3fba79e73e08-istio-envoy\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:18.330126 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.330094    2574 generic.go:356] "Generic (PLEG): container finished" podID="7e6f3664-fb97-42ac-be4b-3fba79e73e08" containerID="a835018262e21fba0ccbf6da79092dd85c8ee392820cfcdd73e966958c7643bc" exitCode=0
Sep 09 15:52:18.330239 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.330146    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"
Sep 09 15:52:18.330239 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.330175    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98" event={"ID":"7e6f3664-fb97-42ac-be4b-3fba79e73e08","Type":"ContainerDied","Data":"a835018262e21fba0ccbf6da79092dd85c8ee392820cfcdd73e966958c7643bc"}
Sep 09 15:52:18.330239 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.330237    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98" event={"ID":"7e6f3664-fb97-42ac-be4b-3fba79e73e08","Type":"ContainerDied","Data":"67c38d665e408e9aef4e7d4ab1ec43f18bd726625e3e1ac857647387ce028199"}
Sep 09 15:52:18.330361 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.330260    2574 scope.go:117] "RemoveContainer" containerID="a835018262e21fba0ccbf6da79092dd85c8ee392820cfcdd73e966958c7643bc"
Sep 09 15:52:18.342500 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.342479    2574 scope.go:117] "RemoveContainer" containerID="44588b74c23498d9771ee3b6b8c7e41b6c10d9b3d5b72c33abdb22cc60fb85f6"
Sep 09 15:52:18.349341 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.349309    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"]
Sep 09 15:52:18.353284 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.353263    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ce3053-openshift-default-7bcb549488-r7j98"]
Sep 09 15:52:18.353363 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.353261    2574 scope.go:117] "RemoveContainer" containerID="a835018262e21fba0ccbf6da79092dd85c8ee392820cfcdd73e966958c7643bc"
Sep 09 15:52:18.353597 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:52:18.353577    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a835018262e21fba0ccbf6da79092dd85c8ee392820cfcdd73e966958c7643bc\": container with ID starting with a835018262e21fba0ccbf6da79092dd85c8ee392820cfcdd73e966958c7643bc not found: ID does not exist" containerID="a835018262e21fba0ccbf6da79092dd85c8ee392820cfcdd73e966958c7643bc"
Sep 09 15:52:18.353668 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.353610    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a835018262e21fba0ccbf6da79092dd85c8ee392820cfcdd73e966958c7643bc"} err="failed to get container status \"a835018262e21fba0ccbf6da79092dd85c8ee392820cfcdd73e966958c7643bc\": rpc error: code = NotFound desc = could not find container \"a835018262e21fba0ccbf6da79092dd85c8ee392820cfcdd73e966958c7643bc\": container with ID starting with a835018262e21fba0ccbf6da79092dd85c8ee392820cfcdd73e966958c7643bc not found: ID does not exist"
Sep 09 15:52:18.353668 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.353635    2574 scope.go:117] "RemoveContainer" containerID="44588b74c23498d9771ee3b6b8c7e41b6c10d9b3d5b72c33abdb22cc60fb85f6"
Sep 09 15:52:18.353961 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:52:18.353939    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44588b74c23498d9771ee3b6b8c7e41b6c10d9b3d5b72c33abdb22cc60fb85f6\": container with ID starting with 44588b74c23498d9771ee3b6b8c7e41b6c10d9b3d5b72c33abdb22cc60fb85f6 not found: ID does not exist" containerID="44588b74c23498d9771ee3b6b8c7e41b6c10d9b3d5b72c33abdb22cc60fb85f6"
Sep 09 15:52:18.354001 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:18.353971    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44588b74c23498d9771ee3b6b8c7e41b6c10d9b3d5b72c33abdb22cc60fb85f6"} err="failed to get container status \"44588b74c23498d9771ee3b6b8c7e41b6c10d9b3d5b72c33abdb22cc60fb85f6\": rpc error: code = NotFound desc = could not find container \"44588b74c23498d9771ee3b6b8c7e41b6c10d9b3d5b72c33abdb22cc60fb85f6\": container with ID starting with 44588b74c23498d9771ee3b6b8c7e41b6c10d9b3d5b72c33abdb22cc60fb85f6 not found: ID does not exist"
Sep 09 15:52:20.320322 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:20.320274    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e6f3664-fb97-42ac-be4b-3fba79e73e08" path="/var/lib/kubelet/pods/7e6f3664-fb97-42ac-be4b-3fba79e73e08/volumes"
Sep 09 15:52:23.549328 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:23.549299    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"]
Sep 09 15:52:23.549759 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:23.549517    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w" podUID="f5f3cd29-6a52-4fde-9bf8-8199729d4d19" containerName="payload-pre-processing" containerID="cri-o://14b453b5fb61ca580c962e21a82c511aafbe5ff1fd473cca5cc923a1107a1e3f" gracePeriod=30
Sep 09 15:52:23.817999 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:23.817971    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"
Sep 09 15:52:23.919838 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:23.919802    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pp7t\" (UniqueName: \"kubernetes.io/projected/f5f3cd29-6a52-4fde-9bf8-8199729d4d19-kube-api-access-5pp7t\") pod \"f5f3cd29-6a52-4fde-9bf8-8199729d4d19\" (UID: \"f5f3cd29-6a52-4fde-9bf8-8199729d4d19\") "
Sep 09 15:52:23.920074 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:23.919952    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5f3cd29-6a52-4fde-9bf8-8199729d4d19-plugins-config-volume\") pod \"f5f3cd29-6a52-4fde-9bf8-8199729d4d19\" (UID: \"f5f3cd29-6a52-4fde-9bf8-8199729d4d19\") "
Sep 09 15:52:23.920316 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:23.920290    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5f3cd29-6a52-4fde-9bf8-8199729d4d19-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f5f3cd29-6a52-4fde-9bf8-8199729d4d19" (UID: "f5f3cd29-6a52-4fde-9bf8-8199729d4d19"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:52:23.922154 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:23.922129    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5f3cd29-6a52-4fde-9bf8-8199729d4d19-kube-api-access-5pp7t" (OuterVolumeSpecName: "kube-api-access-5pp7t") pod "f5f3cd29-6a52-4fde-9bf8-8199729d4d19" (UID: "f5f3cd29-6a52-4fde-9bf8-8199729d4d19"). InnerVolumeSpecName "kube-api-access-5pp7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:52:24.021343 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:24.021301    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5f3cd29-6a52-4fde-9bf8-8199729d4d19-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:24.021343 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:24.021334    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pp7t\" (UniqueName: \"kubernetes.io/projected/f5f3cd29-6a52-4fde-9bf8-8199729d4d19-kube-api-access-5pp7t\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:52:24.367377 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:24.367339    2574 generic.go:356] "Generic (PLEG): container finished" podID="f5f3cd29-6a52-4fde-9bf8-8199729d4d19" containerID="14b453b5fb61ca580c962e21a82c511aafbe5ff1fd473cca5cc923a1107a1e3f" exitCode=0
Sep 09 15:52:24.367568 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:24.367385    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"
Sep 09 15:52:24.367568 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:24.367433    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w" event={"ID":"f5f3cd29-6a52-4fde-9bf8-8199729d4d19","Type":"ContainerDied","Data":"14b453b5fb61ca580c962e21a82c511aafbe5ff1fd473cca5cc923a1107a1e3f"}
Sep 09 15:52:24.367568 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:24.367492    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w" event={"ID":"f5f3cd29-6a52-4fde-9bf8-8199729d4d19","Type":"ContainerDied","Data":"d6adad478d9697dfcb5cfc1fcad5a3ab760077b4746c6f30b48eb26e0f8c77dc"}
Sep 09 15:52:24.367568 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:24.367521    2574 scope.go:117] "RemoveContainer" containerID="14b453b5fb61ca580c962e21a82c511aafbe5ff1fd473cca5cc923a1107a1e3f"
Sep 09 15:52:24.377649 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:24.377628    2574 scope.go:117] "RemoveContainer" containerID="14b453b5fb61ca580c962e21a82c511aafbe5ff1fd473cca5cc923a1107a1e3f"
Sep 09 15:52:24.378101 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:52:24.378074    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14b453b5fb61ca580c962e21a82c511aafbe5ff1fd473cca5cc923a1107a1e3f\": container with ID starting with 14b453b5fb61ca580c962e21a82c511aafbe5ff1fd473cca5cc923a1107a1e3f not found: ID does not exist" containerID="14b453b5fb61ca580c962e21a82c511aafbe5ff1fd473cca5cc923a1107a1e3f"
Sep 09 15:52:24.378195 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:24.378112    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14b453b5fb61ca580c962e21a82c511aafbe5ff1fd473cca5cc923a1107a1e3f"} err="failed to get container status \"14b453b5fb61ca580c962e21a82c511aafbe5ff1fd473cca5cc923a1107a1e3f\": rpc error: code = NotFound desc = could not find container \"14b453b5fb61ca580c962e21a82c511aafbe5ff1fd473cca5cc923a1107a1e3f\": container with ID starting with 14b453b5fb61ca580c962e21a82c511aafbe5ff1fd473cca5cc923a1107a1e3f not found: ID does not exist"
Sep 09 15:52:24.387445 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:24.387418    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"]
Sep 09 15:52:24.391172 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:24.391149    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-081ed3-5fdc4bf674-qf49w"]
Sep 09 15:52:26.321355 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:26.321315    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5f3cd29-6a52-4fde-9bf8-8199729d4d19" path="/var/lib/kubelet/pods/f5f3cd29-6a52-4fde-9bf8-8199729d4d19/volumes"
Sep 09 15:52:43.596400 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:52:43.596363    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:53:08.297336 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:53:08.297292    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:53:28.000626 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:53:28.000588    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:53:52.393554 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:53:52.393521    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:54:03.472298 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:03.472265    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"]
Sep 09 15:54:15.213227 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:15.213184    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:54:18.494320 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.494254    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd" podUID="de88fbbe-7606-4ae7-b86a-51d3463322e2" containerName="main" containerID="cri-o://8dc98d9322564a65ac16dbb39929405a60ec76b6c66464a8ffbac35ad4d8fc6a" gracePeriod=45
Sep 09 15:54:18.747061 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.746998    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:54:18.882577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.882542    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f78qr\" (UniqueName: \"kubernetes.io/projected/de88fbbe-7606-4ae7-b86a-51d3463322e2-kube-api-access-f78qr\") pod \"de88fbbe-7606-4ae7-b86a-51d3463322e2\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") "
Sep 09 15:54:18.882763 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.882599    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-model-cache\") pod \"de88fbbe-7606-4ae7-b86a-51d3463322e2\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") "
Sep 09 15:54:18.882763 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.882682    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-tmp-dir\") pod \"de88fbbe-7606-4ae7-b86a-51d3463322e2\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") "
Sep 09 15:54:18.882763 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.882729    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-dshm\") pod \"de88fbbe-7606-4ae7-b86a-51d3463322e2\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") "
Sep 09 15:54:18.882976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.882769    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-home\") pod \"de88fbbe-7606-4ae7-b86a-51d3463322e2\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") "
Sep 09 15:54:18.882976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.882835    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de88fbbe-7606-4ae7-b86a-51d3463322e2-tls-certs\") pod \"de88fbbe-7606-4ae7-b86a-51d3463322e2\" (UID: \"de88fbbe-7606-4ae7-b86a-51d3463322e2\") "
Sep 09 15:54:18.882976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.882930    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-model-cache" (OuterVolumeSpecName: "model-cache") pod "de88fbbe-7606-4ae7-b86a-51d3463322e2" (UID: "de88fbbe-7606-4ae7-b86a-51d3463322e2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:54:18.883126 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.882985    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "de88fbbe-7606-4ae7-b86a-51d3463322e2" (UID: "de88fbbe-7606-4ae7-b86a-51d3463322e2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:54:18.883177 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.883148    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-home" (OuterVolumeSpecName: "home") pod "de88fbbe-7606-4ae7-b86a-51d3463322e2" (UID: "de88fbbe-7606-4ae7-b86a-51d3463322e2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:54:18.883332 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.883255    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-model-cache\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:54:18.883332 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.883278    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-tmp-dir\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:54:18.883332 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.883291    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-home\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:54:18.885140 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.885113    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-dshm" (OuterVolumeSpecName: "dshm") pod "de88fbbe-7606-4ae7-b86a-51d3463322e2" (UID: "de88fbbe-7606-4ae7-b86a-51d3463322e2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:54:18.885245 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.885164    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de88fbbe-7606-4ae7-b86a-51d3463322e2-kube-api-access-f78qr" (OuterVolumeSpecName: "kube-api-access-f78qr") pod "de88fbbe-7606-4ae7-b86a-51d3463322e2" (UID: "de88fbbe-7606-4ae7-b86a-51d3463322e2"). InnerVolumeSpecName "kube-api-access-f78qr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:54:18.885481 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.885461    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de88fbbe-7606-4ae7-b86a-51d3463322e2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "de88fbbe-7606-4ae7-b86a-51d3463322e2" (UID: "de88fbbe-7606-4ae7-b86a-51d3463322e2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:54:18.983813 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.983776    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de88fbbe-7606-4ae7-b86a-51d3463322e2-tls-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:54:18.983813 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.983808    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f78qr\" (UniqueName: \"kubernetes.io/projected/de88fbbe-7606-4ae7-b86a-51d3463322e2-kube-api-access-f78qr\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:54:18.983813 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:18.983819    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de88fbbe-7606-4ae7-b86a-51d3463322e2-dshm\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:54:19.059742 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:19.059646    2574 generic.go:356] "Generic (PLEG): container finished" podID="de88fbbe-7606-4ae7-b86a-51d3463322e2" containerID="8dc98d9322564a65ac16dbb39929405a60ec76b6c66464a8ffbac35ad4d8fc6a" exitCode=0
Sep 09 15:54:19.059742 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:19.059706    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd" event={"ID":"de88fbbe-7606-4ae7-b86a-51d3463322e2","Type":"ContainerDied","Data":"8dc98d9322564a65ac16dbb39929405a60ec76b6c66464a8ffbac35ad4d8fc6a"}
Sep 09 15:54:19.059742 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:19.059734    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd" event={"ID":"de88fbbe-7606-4ae7-b86a-51d3463322e2","Type":"ContainerDied","Data":"6ec2674ef9b30de9d373605d2079fe3d8ff888f4420aa531c34d93fcd30ffc3b"}
Sep 09 15:54:19.060064 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:19.059751    2574 scope.go:117] "RemoveContainer" containerID="8dc98d9322564a65ac16dbb39929405a60ec76b6c66464a8ffbac35ad4d8fc6a"
Sep 09 15:54:19.060064 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:19.059704    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"
Sep 09 15:54:19.070167 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:19.070145    2574 scope.go:117] "RemoveContainer" containerID="8dc98d9322564a65ac16dbb39929405a60ec76b6c66464a8ffbac35ad4d8fc6a"
Sep 09 15:54:19.070509 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:54:19.070490    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dc98d9322564a65ac16dbb39929405a60ec76b6c66464a8ffbac35ad4d8fc6a\": container with ID starting with 8dc98d9322564a65ac16dbb39929405a60ec76b6c66464a8ffbac35ad4d8fc6a not found: ID does not exist" containerID="8dc98d9322564a65ac16dbb39929405a60ec76b6c66464a8ffbac35ad4d8fc6a"
Sep 09 15:54:19.070563 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:19.070520    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dc98d9322564a65ac16dbb39929405a60ec76b6c66464a8ffbac35ad4d8fc6a"} err="failed to get container status \"8dc98d9322564a65ac16dbb39929405a60ec76b6c66464a8ffbac35ad4d8fc6a\": rpc error: code = NotFound desc = could not find container \"8dc98d9322564a65ac16dbb39929405a60ec76b6c66464a8ffbac35ad4d8fc6a\": container with ID starting with 8dc98d9322564a65ac16dbb39929405a60ec76b6c66464a8ffbac35ad4d8fc6a not found: ID does not exist"
Sep 09 15:54:19.081794 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:19.081766    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"]
Sep 09 15:54:19.087786 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:19.087758    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-1e15c8/distinct-w4-1e15c8-kserve-6564f86b96-xhjvd"]
Sep 09 15:54:20.321692 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:20.321654    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de88fbbe-7606-4ae7-b86a-51d3463322e2" path="/var/lib/kubelet/pods/de88fbbe-7606-4ae7-b86a-51d3463322e2/volumes"
Sep 09 15:54:31.895900 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:31.895861    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:54:53.990791 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:54:53.990754    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:55:09.098559 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:55:09.098523    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:55:21.691399 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:55:21.691357    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:55:34.890904 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:55:34.890861    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:55:45.795665 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:55:45.795630    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:56:01.997771 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:56:01.997726    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:56:15.492010 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:56:15.491968    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:56:26.103827 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:56:26.103782    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:56:41.610435 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:56:41.610397    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:57:02.646403 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.646360    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"]
Sep 09 15:57:02.647071 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647050    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5f3cd29-6a52-4fde-9bf8-8199729d4d19" containerName="payload-pre-processing"
Sep 09 15:57:02.647152 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647077    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5f3cd29-6a52-4fde-9bf8-8199729d4d19" containerName="payload-pre-processing"
Sep 09 15:57:02.647152 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647096    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de88fbbe-7606-4ae7-b86a-51d3463322e2" containerName="main"
Sep 09 15:57:02.647152 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647105    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="de88fbbe-7606-4ae7-b86a-51d3463322e2" containerName="main"
Sep 09 15:57:02.647152 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647117    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4231318-06eb-4c6a-b579-577254bf1e04" containerName="maas-api"
Sep 09 15:57:02.647152 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647126    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4231318-06eb-4c6a-b579-577254bf1e04" containerName="maas-api"
Sep 09 15:57:02.647152 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647138    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="710b20fc-778a-4b93-a5d4-e4fb116a384c" containerName="payload-processing"
Sep 09 15:57:02.647152 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647146    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="710b20fc-778a-4b93-a5d4-e4fb116a384c" containerName="payload-processing"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647157    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eccb9634-dde1-49b4-a402-b2aa557b5d5f" containerName="payload-pre-processing"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647166    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="eccb9634-dde1-49b4-a402-b2aa557b5d5f" containerName="payload-pre-processing"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647191    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95478527-65df-46ca-9f93-90bc70449016" containerName="payload-processing"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647199    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="95478527-65df-46ca-9f93-90bc70449016" containerName="payload-processing"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647210    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e6f3664-fb97-42ac-be4b-3fba79e73e08" containerName="istio-proxy"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647218    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e6f3664-fb97-42ac-be4b-3fba79e73e08" containerName="istio-proxy"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647241    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12b0578c-9bab-4836-afe9-64df8ce627ad" containerName="istio-proxy"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647250    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="12b0578c-9bab-4836-afe9-64df8ce627ad" containerName="istio-proxy"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647269    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b322ad0-1ed9-48d3-aa78-ca72234b34b6" containerName="payload-pre-processing"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647277    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b322ad0-1ed9-48d3-aa78-ca72234b34b6" containerName="payload-pre-processing"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647292    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e6f3664-fb97-42ac-be4b-3fba79e73e08" containerName="istio-proxy"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647300    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e6f3664-fb97-42ac-be4b-3fba79e73e08" containerName="istio-proxy"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647401    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="710b20fc-778a-4b93-a5d4-e4fb116a384c" containerName="payload-processing"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647414    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="12b0578c-9bab-4836-afe9-64df8ce627ad" containerName="istio-proxy"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647423    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="eccb9634-dde1-49b4-a402-b2aa557b5d5f" containerName="payload-pre-processing"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647433    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b322ad0-1ed9-48d3-aa78-ca72234b34b6" containerName="payload-pre-processing"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647443    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="de88fbbe-7606-4ae7-b86a-51d3463322e2" containerName="main"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647453    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="95478527-65df-46ca-9f93-90bc70449016" containerName="payload-processing"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647463    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e6f3664-fb97-42ac-be4b-3fba79e73e08" containerName="istio-proxy"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647472    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4231318-06eb-4c6a-b579-577254bf1e04" containerName="maas-api"
Sep 09 15:57:02.647477 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.647481    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5f3cd29-6a52-4fde-9bf8-8199729d4d19" containerName="payload-pre-processing"
Sep 09 15:57:02.654686 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.654660    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.659652 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.659625    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-a2b442-openshift-default-dockercfg-mxm5x\""
Sep 09 15:57:02.663382 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.663357    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"]
Sep 09 15:57:02.698034 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.697998    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-workload-certs\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.698184 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.698129    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-workload-socket\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.698184 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.698165    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sj64\" (UniqueName: \"kubernetes.io/projected/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-kube-api-access-2sj64\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.698268 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.698231    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-token\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.698268 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.698252    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-credential-socket\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.698335 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.698267    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-podinfo\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.698335 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.698292    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-data\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.698335 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.698319    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-envoy\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.698454 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.698335    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istiod-ca-cert\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.799046 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.799005    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-token\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.799046 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.799048    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-credential-socket\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.799298 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.799064    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-podinfo\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.799298 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.799090    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-data\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.799298 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.799148    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-envoy\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.799298 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.799194    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istiod-ca-cert\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.799298 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.799242    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-workload-certs\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.799585 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.799348    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-workload-socket\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.799585 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.799391    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sj64\" (UniqueName: \"kubernetes.io/projected/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-kube-api-access-2sj64\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.799585 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.799464    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-data\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.800025 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.799989    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istiod-ca-cert\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.800174 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.800127    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-credential-socket\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.800257 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.800240    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-workload-socket\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.800316 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.800289    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-workload-certs\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.802050 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.802018    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-podinfo\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.802200 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.802181    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-envoy\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.807246 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.807215    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-token\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.807916 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.807890    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sj64\" (UniqueName: \"kubernetes.io/projected/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-kube-api-access-2sj64\") pod \"e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") " pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:02.969798 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:02.969732    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:03.266781 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:03.266750    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"]
Sep 09 15:57:03.267585 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:57:03.267560    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab49b0f_96ec_4e6b_b1f0_99f81ef3d373.slice/crio-ce25a5ef590c4a3fa0488eb848fa05f850bc29277509503817c46d2fff325c06 WatchSource:0}: Error finding container ce25a5ef590c4a3fa0488eb848fa05f850bc29277509503817c46d2fff325c06: Status 404 returned error can't find the container with id ce25a5ef590c4a3fa0488eb848fa05f850bc29277509503817c46d2fff325c06
Sep 09 15:57:03.270151 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:03.270105    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:57:03.270228 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:03.270211    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:57:03.270276 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:03.270260    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:57:04.039770 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:04.039734    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl" event={"ID":"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373","Type":"ContainerStarted","Data":"06809f0cfc900b15d230239119a980838bb0473bcb13bad05d746aa25418d035"}
Sep 09 15:57:04.040186 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:04.039791    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl" event={"ID":"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373","Type":"ContainerStarted","Data":"ce25a5ef590c4a3fa0488eb848fa05f850bc29277509503817c46d2fff325c06"}
Sep 09 15:57:04.062068 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:04.062011    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl" podStartSLOduration=2.061990912 podStartE2EDuration="2.061990912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:57:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:57:04.059320732 +0000 UTC m=+2208.249523502" watchObservedRunningTime="2026-09-09 15:57:04.061990912 +0000 UTC m=+2208.252193661"
Sep 09 15:57:04.970330 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:04.970294    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:04.975786 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:04.975758    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:05.045718 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:05.045685    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:05.046655 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:05.046637    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:13.498895 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:13.498854    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:57:24.168473 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:24.168439    2574 generic.go:356] "Generic (PLEG): container finished" podID="8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" containerID="06809f0cfc900b15d230239119a980838bb0473bcb13bad05d746aa25418d035" exitCode=0
Sep 09 15:57:24.168922 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:24.168525    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl" event={"ID":"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373","Type":"ContainerDied","Data":"06809f0cfc900b15d230239119a980838bb0473bcb13bad05d746aa25418d035"}
Sep 09 15:57:24.169028 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:24.169013    2574 scope.go:117] "RemoveContainer" containerID="06809f0cfc900b15d230239119a980838bb0473bcb13bad05d746aa25418d035"
Sep 09 15:57:24.170182 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:24.170149    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:57:24.170302 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:24.170242    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:57:24.170302 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:24.170294    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 09 15:57:25.177393 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:25.177348    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl" event={"ID":"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373","Type":"ContainerStarted","Data":"17cca6fddbc0e42936985821c252e032bde9efa23ffa540cddc33030489e1127"}
Sep 09 15:57:25.970313 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:25.970269    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:25.970495 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:25.970445    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 09 15:57:25.970577 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:25.970504    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl" podUID="8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 09 15:57:26.970085 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:26.970039    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 09 15:57:26.970557 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:26.970107    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl" podUID="8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 09 15:57:27.971167 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:27.971128    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 09 15:57:27.971560 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:27.971186    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl" podUID="8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 09 15:57:28.970395 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:28.970356    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 09 15:57:28.970601 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:28.970422    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl" podUID="8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 09 15:57:29.970355 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:29.970316    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 09 15:57:29.970757 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:29.970376    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl" podUID="8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 09 15:57:30.974884 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:30.974830    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:30.975334 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:30.975254    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:30.976002 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:30.975980    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 15:57:48.502009 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:57:48.501910    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:58:01.590284 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:01.590244    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:58:13.576188 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.576138    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"]
Sep 09 15:58:13.576607 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.576592    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12b0578c-9bab-4836-afe9-64df8ce627ad" containerName="istio-proxy"
Sep 09 15:58:13.576653 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.576608    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="12b0578c-9bab-4836-afe9-64df8ce627ad" containerName="istio-proxy"
Sep 09 15:58:13.576702 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.576691    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e6f3664-fb97-42ac-be4b-3fba79e73e08" containerName="istio-proxy"
Sep 09 15:58:13.576755 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.576710    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="12b0578c-9bab-4836-afe9-64df8ce627ad" containerName="istio-proxy"
Sep 09 15:58:13.580295 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.580278    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"
Sep 09 15:58:13.582971 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.582949    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-c6ae87\""
Sep 09 15:58:13.591974 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.591946    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"]
Sep 09 15:58:13.612974 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.612935    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"]
Sep 09 15:58:13.616630 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.616603    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"
Sep 09 15:58:13.619489 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.619458    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-c6ae87-dockercfg-g26w5\""
Sep 09 15:58:13.626089 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.626059    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"]
Sep 09 15:58:13.633644 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.633610    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55065c5d-a8cd-4a07-9ff7-ea8df64a0670-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v\" (UID: \"55065c5d-a8cd-4a07-9ff7-ea8df64a0670\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"
Sep 09 15:58:13.633948 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.633710    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x4pj\" (UniqueName: \"kubernetes.io/projected/55065c5d-a8cd-4a07-9ff7-ea8df64a0670-kube-api-access-8x4pj\") pod \"payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v\" (UID: \"55065c5d-a8cd-4a07-9ff7-ea8df64a0670\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"
Sep 09 15:58:13.735094 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.735030    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x4pj\" (UniqueName: \"kubernetes.io/projected/55065c5d-a8cd-4a07-9ff7-ea8df64a0670-kube-api-access-8x4pj\") pod \"payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v\" (UID: \"55065c5d-a8cd-4a07-9ff7-ea8df64a0670\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"
Sep 09 15:58:13.735500 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.735463    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf396080-9870-47d0-bd0d-d5b13c011fbb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql\" (UID: \"bf396080-9870-47d0-bd0d-d5b13c011fbb\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"
Sep 09 15:58:13.735673 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.735649    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55065c5d-a8cd-4a07-9ff7-ea8df64a0670-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v\" (UID: \"55065c5d-a8cd-4a07-9ff7-ea8df64a0670\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"
Sep 09 15:58:13.735807 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.735699    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvnlj\" (UniqueName: \"kubernetes.io/projected/bf396080-9870-47d0-bd0d-d5b13c011fbb-kube-api-access-dvnlj\") pod \"payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql\" (UID: \"bf396080-9870-47d0-bd0d-d5b13c011fbb\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"
Sep 09 15:58:13.736714 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.736689    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55065c5d-a8cd-4a07-9ff7-ea8df64a0670-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v\" (UID: \"55065c5d-a8cd-4a07-9ff7-ea8df64a0670\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"
Sep 09 15:58:13.744290 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.744267    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x4pj\" (UniqueName: \"kubernetes.io/projected/55065c5d-a8cd-4a07-9ff7-ea8df64a0670-kube-api-access-8x4pj\") pod \"payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v\" (UID: \"55065c5d-a8cd-4a07-9ff7-ea8df64a0670\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"
Sep 09 15:58:13.837493 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.837396    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf396080-9870-47d0-bd0d-d5b13c011fbb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql\" (UID: \"bf396080-9870-47d0-bd0d-d5b13c011fbb\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"
Sep 09 15:58:13.837493 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.837487    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvnlj\" (UniqueName: \"kubernetes.io/projected/bf396080-9870-47d0-bd0d-d5b13c011fbb-kube-api-access-dvnlj\") pod \"payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql\" (UID: \"bf396080-9870-47d0-bd0d-d5b13c011fbb\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"
Sep 09 15:58:13.838194 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.838173    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf396080-9870-47d0-bd0d-d5b13c011fbb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql\" (UID: \"bf396080-9870-47d0-bd0d-d5b13c011fbb\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"
Sep 09 15:58:13.845416 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.845390    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvnlj\" (UniqueName: \"kubernetes.io/projected/bf396080-9870-47d0-bd0d-d5b13c011fbb-kube-api-access-dvnlj\") pod \"payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql\" (UID: \"bf396080-9870-47d0-bd0d-d5b13c011fbb\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"
Sep 09 15:58:13.892598 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.892552    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"
Sep 09 15:58:13.930052 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:13.930019    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"
Sep 09 15:58:14.173697 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:14.173663    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"]
Sep 09 15:58:14.174948 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:58:14.174921    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55065c5d_a8cd_4a07_9ff7_ea8df64a0670.slice/crio-cd4e6ae285b157778b868e859607278ec5d7cf51c8b6ddc2ca2af69800d434e7 WatchSource:0}: Error finding container cd4e6ae285b157778b868e859607278ec5d7cf51c8b6ddc2ca2af69800d434e7: Status 404 returned error can't find the container with id cd4e6ae285b157778b868e859607278ec5d7cf51c8b6ddc2ca2af69800d434e7
Sep 09 15:58:14.211713 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:14.211688    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"]
Sep 09 15:58:14.213747 ip-10-0-140-68 kubenswrapper[2574]: W0909 15:58:14.213708    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf396080_9870_47d0_bd0d_d5b13c011fbb.slice/crio-7b279976bb82b144f827c5cd4f2cdfd49fd18f7a4d13ea212db77f754271ea16 WatchSource:0}: Error finding container 7b279976bb82b144f827c5cd4f2cdfd49fd18f7a4d13ea212db77f754271ea16: Status 404 returned error can't find the container with id 7b279976bb82b144f827c5cd4f2cdfd49fd18f7a4d13ea212db77f754271ea16
Sep 09 15:58:14.487072 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:14.487029    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v" event={"ID":"55065c5d-a8cd-4a07-9ff7-ea8df64a0670","Type":"ContainerStarted","Data":"d4db7c9668b41f40bb232713ce553559148ca2923479c3764afeed7ebab27cbc"}
Sep 09 15:58:14.487283 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:14.487092    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v" event={"ID":"55065c5d-a8cd-4a07-9ff7-ea8df64a0670","Type":"ContainerStarted","Data":"cd4e6ae285b157778b868e859607278ec5d7cf51c8b6ddc2ca2af69800d434e7"}
Sep 09 15:58:14.487283 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:14.487135    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"
Sep 09 15:58:14.488941 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:14.488908    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql" event={"ID":"bf396080-9870-47d0-bd0d-d5b13c011fbb","Type":"ContainerStarted","Data":"3f2133e831a6a3a9561e3b45fd86246a18b675ac19d6b462069edd1c6876bc62"}
Sep 09 15:58:14.489067 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:14.488973    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"
Sep 09 15:58:14.489067 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:14.488996    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql" event={"ID":"bf396080-9870-47d0-bd0d-d5b13c011fbb","Type":"ContainerStarted","Data":"7b279976bb82b144f827c5cd4f2cdfd49fd18f7a4d13ea212db77f754271ea16"}
Sep 09 15:58:14.504622 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:14.504568    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v" podStartSLOduration=1.5045468020000001 podStartE2EDuration="1.504546802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:58:14.502733672 +0000 UTC m=+2278.692936440" watchObservedRunningTime="2026-09-09 15:58:14.504546802 +0000 UTC m=+2278.694749557"
Sep 09 15:58:14.523522 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:14.523461    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql" podStartSLOduration=1.523444725 podStartE2EDuration="1.523444725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:58:14.520176565 +0000 UTC m=+2278.710379335" watchObservedRunningTime="2026-09-09 15:58:14.523444725 +0000 UTC m=+2278.713647474"
Sep 09 15:58:21.900882 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:21.900824    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:58:25.497779 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:25.497743    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"
Sep 09 15:58:25.498186 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:25.497820    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"
Sep 09 15:58:43.712970 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:43.712932    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"]
Sep 09 15:58:43.713456 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:43.713318    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql" podUID="bf396080-9870-47d0-bd0d-d5b13c011fbb" containerName="payload-processing" containerID="cri-o://3f2133e831a6a3a9561e3b45fd86246a18b675ac19d6b462069edd1c6876bc62" gracePeriod=30
Sep 09 15:58:43.723369 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:43.723336    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"]
Sep 09 15:58:43.723869 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:43.723796    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v" podUID="55065c5d-a8cd-4a07-9ff7-ea8df64a0670" containerName="payload-pre-processing" containerID="cri-o://d4db7c9668b41f40bb232713ce553559148ca2923479c3764afeed7ebab27cbc" gracePeriod=30
Sep 09 15:58:44.018268 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.018242    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"
Sep 09 15:58:44.021034 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.021015    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"
Sep 09 15:58:44.051615 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.050775    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvnlj\" (UniqueName: \"kubernetes.io/projected/bf396080-9870-47d0-bd0d-d5b13c011fbb-kube-api-access-dvnlj\") pod \"bf396080-9870-47d0-bd0d-d5b13c011fbb\" (UID: \"bf396080-9870-47d0-bd0d-d5b13c011fbb\") "
Sep 09 15:58:44.051615 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.050827    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55065c5d-a8cd-4a07-9ff7-ea8df64a0670-plugins-config-volume\") pod \"55065c5d-a8cd-4a07-9ff7-ea8df64a0670\" (UID: \"55065c5d-a8cd-4a07-9ff7-ea8df64a0670\") "
Sep 09 15:58:44.051615 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.050936    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf396080-9870-47d0-bd0d-d5b13c011fbb-plugins-config-volume\") pod \"bf396080-9870-47d0-bd0d-d5b13c011fbb\" (UID: \"bf396080-9870-47d0-bd0d-d5b13c011fbb\") "
Sep 09 15:58:44.051615 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.050985    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x4pj\" (UniqueName: \"kubernetes.io/projected/55065c5d-a8cd-4a07-9ff7-ea8df64a0670-kube-api-access-8x4pj\") pod \"55065c5d-a8cd-4a07-9ff7-ea8df64a0670\" (UID: \"55065c5d-a8cd-4a07-9ff7-ea8df64a0670\") "
Sep 09 15:58:44.052813 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.052769    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf396080-9870-47d0-bd0d-d5b13c011fbb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bf396080-9870-47d0-bd0d-d5b13c011fbb" (UID: "bf396080-9870-47d0-bd0d-d5b13c011fbb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:58:44.053126 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.053096    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55065c5d-a8cd-4a07-9ff7-ea8df64a0670-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "55065c5d-a8cd-4a07-9ff7-ea8df64a0670" (UID: "55065c5d-a8cd-4a07-9ff7-ea8df64a0670"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:58:44.056098 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.056036    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf396080-9870-47d0-bd0d-d5b13c011fbb-kube-api-access-dvnlj" (OuterVolumeSpecName: "kube-api-access-dvnlj") pod "bf396080-9870-47d0-bd0d-d5b13c011fbb" (UID: "bf396080-9870-47d0-bd0d-d5b13c011fbb"). InnerVolumeSpecName "kube-api-access-dvnlj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:58:44.057252 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.057223    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55065c5d-a8cd-4a07-9ff7-ea8df64a0670-kube-api-access-8x4pj" (OuterVolumeSpecName: "kube-api-access-8x4pj") pod "55065c5d-a8cd-4a07-9ff7-ea8df64a0670" (UID: "55065c5d-a8cd-4a07-9ff7-ea8df64a0670"). InnerVolumeSpecName "kube-api-access-8x4pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:58:44.151976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.151938    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf396080-9870-47d0-bd0d-d5b13c011fbb-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:58:44.151976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.151970    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x4pj\" (UniqueName: \"kubernetes.io/projected/55065c5d-a8cd-4a07-9ff7-ea8df64a0670-kube-api-access-8x4pj\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:58:44.151976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.151979    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvnlj\" (UniqueName: \"kubernetes.io/projected/bf396080-9870-47d0-bd0d-d5b13c011fbb-kube-api-access-dvnlj\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:58:44.151976 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.151987    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55065c5d-a8cd-4a07-9ff7-ea8df64a0670-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 15:58:44.675497 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.675408    2574 generic.go:356] "Generic (PLEG): container finished" podID="bf396080-9870-47d0-bd0d-d5b13c011fbb" containerID="3f2133e831a6a3a9561e3b45fd86246a18b675ac19d6b462069edd1c6876bc62" exitCode=0
Sep 09 15:58:44.675497 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.675451    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"
Sep 09 15:58:44.675727 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.675489    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql" event={"ID":"bf396080-9870-47d0-bd0d-d5b13c011fbb","Type":"ContainerDied","Data":"3f2133e831a6a3a9561e3b45fd86246a18b675ac19d6b462069edd1c6876bc62"}
Sep 09 15:58:44.675727 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.675545    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql" event={"ID":"bf396080-9870-47d0-bd0d-d5b13c011fbb","Type":"ContainerDied","Data":"7b279976bb82b144f827c5cd4f2cdfd49fd18f7a4d13ea212db77f754271ea16"}
Sep 09 15:58:44.675727 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.675569    2574 scope.go:117] "RemoveContainer" containerID="3f2133e831a6a3a9561e3b45fd86246a18b675ac19d6b462069edd1c6876bc62"
Sep 09 15:58:44.677265 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.677237    2574 generic.go:356] "Generic (PLEG): container finished" podID="55065c5d-a8cd-4a07-9ff7-ea8df64a0670" containerID="d4db7c9668b41f40bb232713ce553559148ca2923479c3764afeed7ebab27cbc" exitCode=0
Sep 09 15:58:44.677398 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.677278    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v" event={"ID":"55065c5d-a8cd-4a07-9ff7-ea8df64a0670","Type":"ContainerDied","Data":"d4db7c9668b41f40bb232713ce553559148ca2923479c3764afeed7ebab27cbc"}
Sep 09 15:58:44.677398 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.677286    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"
Sep 09 15:58:44.677398 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.677321    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v" event={"ID":"55065c5d-a8cd-4a07-9ff7-ea8df64a0670","Type":"ContainerDied","Data":"cd4e6ae285b157778b868e859607278ec5d7cf51c8b6ddc2ca2af69800d434e7"}
Sep 09 15:58:44.685918 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.685892    2574 scope.go:117] "RemoveContainer" containerID="3f2133e831a6a3a9561e3b45fd86246a18b675ac19d6b462069edd1c6876bc62"
Sep 09 15:58:44.686258 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:58:44.686237    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f2133e831a6a3a9561e3b45fd86246a18b675ac19d6b462069edd1c6876bc62\": container with ID starting with 3f2133e831a6a3a9561e3b45fd86246a18b675ac19d6b462069edd1c6876bc62 not found: ID does not exist" containerID="3f2133e831a6a3a9561e3b45fd86246a18b675ac19d6b462069edd1c6876bc62"
Sep 09 15:58:44.686318 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.686267    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f2133e831a6a3a9561e3b45fd86246a18b675ac19d6b462069edd1c6876bc62"} err="failed to get container status \"3f2133e831a6a3a9561e3b45fd86246a18b675ac19d6b462069edd1c6876bc62\": rpc error: code = NotFound desc = could not find container \"3f2133e831a6a3a9561e3b45fd86246a18b675ac19d6b462069edd1c6876bc62\": container with ID starting with 3f2133e831a6a3a9561e3b45fd86246a18b675ac19d6b462069edd1c6876bc62 not found: ID does not exist"
Sep 09 15:58:44.686318 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.686286    2574 scope.go:117] "RemoveContainer" containerID="d4db7c9668b41f40bb232713ce553559148ca2923479c3764afeed7ebab27cbc"
Sep 09 15:58:44.696040 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.696013    2574 scope.go:117] "RemoveContainer" containerID="d4db7c9668b41f40bb232713ce553559148ca2923479c3764afeed7ebab27cbc"
Sep 09 15:58:44.696411 ip-10-0-140-68 kubenswrapper[2574]: E0909 15:58:44.696394    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4db7c9668b41f40bb232713ce553559148ca2923479c3764afeed7ebab27cbc\": container with ID starting with d4db7c9668b41f40bb232713ce553559148ca2923479c3764afeed7ebab27cbc not found: ID does not exist" containerID="d4db7c9668b41f40bb232713ce553559148ca2923479c3764afeed7ebab27cbc"
Sep 09 15:58:44.696481 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.696418    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4db7c9668b41f40bb232713ce553559148ca2923479c3764afeed7ebab27cbc"} err="failed to get container status \"d4db7c9668b41f40bb232713ce553559148ca2923479c3764afeed7ebab27cbc\": rpc error: code = NotFound desc = could not find container \"d4db7c9668b41f40bb232713ce553559148ca2923479c3764afeed7ebab27cbc\": container with ID starting with d4db7c9668b41f40bb232713ce553559148ca2923479c3764afeed7ebab27cbc not found: ID does not exist"
Sep 09 15:58:44.697680 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.697666    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"]
Sep 09 15:58:44.700409 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.700387    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c6ae87-5b466d79f4-kzs9v"]
Sep 09 15:58:44.707975 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.707953    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"]
Sep 09 15:58:44.712548 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:44.712524    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c6ae87-c7fbcd85f-hq9ql"]
Sep 09 15:58:46.321864 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:46.321807    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55065c5d-a8cd-4a07-9ff7-ea8df64a0670" path="/var/lib/kubelet/pods/55065c5d-a8cd-4a07-9ff7-ea8df64a0670/volumes"
Sep 09 15:58:46.322237 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:46.322198    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf396080-9870-47d0-bd0d-d5b13c011fbb" path="/var/lib/kubelet/pods/bf396080-9870-47d0-bd0d-d5b13c011fbb/volumes"
Sep 09 15:58:48.203552 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:58:48.203509    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:59:07.491027 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:59:07.490939    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 15:59:20.204281 ip-10-0-140-68 kubenswrapper[2574]: I0909 15:59:20.204241    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:00:00.142330 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:00.142287    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-450a51-29816160-mx4dz"]
Sep 09 16:00:00.142960 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:00.142940    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf396080-9870-47d0-bd0d-d5b13c011fbb" containerName="payload-processing"
Sep 09 16:00:00.143060 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:00.142963    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf396080-9870-47d0-bd0d-d5b13c011fbb" containerName="payload-processing"
Sep 09 16:00:00.143060 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:00.142994    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55065c5d-a8cd-4a07-9ff7-ea8df64a0670" containerName="payload-pre-processing"
Sep 09 16:00:00.143060 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:00.143003    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="55065c5d-a8cd-4a07-9ff7-ea8df64a0670" containerName="payload-pre-processing"
Sep 09 16:00:00.143227 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:00.143121    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="55065c5d-a8cd-4a07-9ff7-ea8df64a0670" containerName="payload-pre-processing"
Sep 09 16:00:00.143227 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:00.143140    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf396080-9870-47d0-bd0d-d5b13c011fbb" containerName="payload-processing"
Sep 09 16:00:00.146268 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:00.146245    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-450a51-29816160-mx4dz"
Sep 09 16:00:00.148728 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:00.148697    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2zlsf\""
Sep 09 16:00:00.154793 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:00.154767    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-450a51-29816160-mx4dz"]
Sep 09 16:00:00.163707 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:00.163672    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-450a51-29816160-mx4dz"
Sep 09 16:00:00.447264 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:00.447222    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-450a51-29816160-mx4dz"]
Sep 09 16:00:00.447881 ip-10-0-140-68 kubenswrapper[2574]: W0909 16:00:00.447834    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82a8b12_306c_47a8_bdcb_3b06ee17c0cc.slice/crio-8a58a12d8ca1662bc4f39ce717776e532676318a6321d95388113701517c33f4 WatchSource:0}: Error finding container 8a58a12d8ca1662bc4f39ce717776e532676318a6321d95388113701517c33f4: Status 404 returned error can't find the container with id 8a58a12d8ca1662bc4f39ce717776e532676318a6321d95388113701517c33f4
Sep 09 16:00:01.150035 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:01.149948    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-450a51-29816160-mx4dz" event={"ID":"f82a8b12-306c-47a8-bdcb-3b06ee17c0cc","Type":"ContainerStarted","Data":"e15107637808bb2e05070795022ab4be572d512a5c6ebdd1a2c95f8640a3f421"}
Sep 09 16:00:01.150035 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:01.150002    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-450a51-29816160-mx4dz" event={"ID":"f82a8b12-306c-47a8-bdcb-3b06ee17c0cc","Type":"ContainerStarted","Data":"8a58a12d8ca1662bc4f39ce717776e532676318a6321d95388113701517c33f4"}
Sep 09 16:00:01.168368 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:01.168314    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-450a51-29816160-mx4dz" podStartSLOduration=1.168295533 podStartE2EDuration="1.168295533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:00:01.167024851 +0000 UTC m=+2385.357227617" watchObservedRunningTime="2026-09-09 16:00:01.168295533 +0000 UTC m=+2385.358498281"
Sep 09 16:00:02.157387 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:02.157343    2574 generic.go:356] "Generic (PLEG): container finished" podID="f82a8b12-306c-47a8-bdcb-3b06ee17c0cc" containerID="e15107637808bb2e05070795022ab4be572d512a5c6ebdd1a2c95f8640a3f421" exitCode=0
Sep 09 16:00:02.157782 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:02.157416    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-450a51-29816160-mx4dz" event={"ID":"f82a8b12-306c-47a8-bdcb-3b06ee17c0cc","Type":"ContainerDied","Data":"e15107637808bb2e05070795022ab4be572d512a5c6ebdd1a2c95f8640a3f421"}
Sep 09 16:00:03.312479 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:03.312437    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-450a51-29816160-mx4dz"
Sep 09 16:00:04.173883 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:04.173836    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-450a51-29816160-mx4dz"
Sep 09 16:00:04.174075 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:04.173852    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-450a51-29816160-mx4dz" event={"ID":"f82a8b12-306c-47a8-bdcb-3b06ee17c0cc","Type":"ContainerDied","Data":"8a58a12d8ca1662bc4f39ce717776e532676318a6321d95388113701517c33f4"}
Sep 09 16:00:04.174075 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:04.173983    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a58a12d8ca1662bc4f39ce717776e532676318a6321d95388113701517c33f4"
Sep 09 16:00:17.505793 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:17.505753    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:00:21.151144 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:21.151106    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"]
Sep 09 16:00:21.151542 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:21.151386    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl" podUID="8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" containerName="istio-proxy" containerID="cri-o://17cca6fddbc0e42936985821c252e032bde9efa23ffa540cddc33030489e1127" gracePeriod=30
Sep 09 16:00:26.314283 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.314237    2574 generic.go:356] "Generic (PLEG): container finished" podID="8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" containerID="17cca6fddbc0e42936985821c252e032bde9efa23ffa540cddc33030489e1127" exitCode=0
Sep 09 16:00:26.320942 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.320898    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl" event={"ID":"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373","Type":"ContainerDied","Data":"17cca6fddbc0e42936985821c252e032bde9efa23ffa540cddc33030489e1127"}
Sep 09 16:00:26.321101 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.321054    2574 scope.go:117] "RemoveContainer" containerID="06809f0cfc900b15d230239119a980838bb0473bcb13bad05d746aa25418d035"
Sep 09 16:00:26.413102 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.413078    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 16:00:26.582549 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.582513    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-podinfo\") pod \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") "
Sep 09 16:00:26.582724 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.582557    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-token\") pod \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") "
Sep 09 16:00:26.582724 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.582585    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-workload-socket\") pod \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") "
Sep 09 16:00:26.582724 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.582639    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istiod-ca-cert\") pod \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") "
Sep 09 16:00:26.582724 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.582674    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-credential-socket\") pod \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") "
Sep 09 16:00:26.582959 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.582736    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-workload-certs\") pod \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") "
Sep 09 16:00:26.582959 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.582769    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-data\") pod \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") "
Sep 09 16:00:26.582959 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.582802    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-envoy\") pod \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") "
Sep 09 16:00:26.582959 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.582857    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sj64\" (UniqueName: \"kubernetes.io/projected/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-kube-api-access-2sj64\") pod \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\" (UID: \"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373\") "
Sep 09 16:00:26.583177 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.582992    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" (UID: "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:00:26.583177 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.583026    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" (UID: "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:00:26.583177 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.583049    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" (UID: "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:00:26.583177 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.583074    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" (UID: "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:00:26.583406 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.583199    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-data" (OuterVolumeSpecName: "istio-data") pod "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" (UID: "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:00:26.583406 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.583373    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-workload-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:26.583406 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.583394    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istiod-ca-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:26.583573 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.583410    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-credential-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:26.583573 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.583423    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-workload-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:26.583573 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.583437    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-data\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:26.585003 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.584975    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" (UID: "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:00:26.585149 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.585086    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" (UID: "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:00:26.585149 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.585091    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-token" (OuterVolumeSpecName: "istio-token") pod "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" (UID: "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:00:26.585255 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.585159    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-kube-api-access-2sj64" (OuterVolumeSpecName: "kube-api-access-2sj64") pod "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" (UID: "8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373"). InnerVolumeSpecName "kube-api-access-2sj64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:00:26.684078 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.684031    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-envoy\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:26.684078 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.684067    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sj64\" (UniqueName: \"kubernetes.io/projected/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-kube-api-access-2sj64\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:26.684078 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.684083    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-podinfo\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:26.684328 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:26.684096    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373-istio-token\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:27.322026 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:27.321995    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"
Sep 09 16:00:27.322397 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:27.322041    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl" event={"ID":"8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373","Type":"ContainerDied","Data":"ce25a5ef590c4a3fa0488eb848fa05f850bc29277509503817c46d2fff325c06"}
Sep 09 16:00:27.322397 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:27.322092    2574 scope.go:117] "RemoveContainer" containerID="17cca6fddbc0e42936985821c252e032bde9efa23ffa540cddc33030489e1127"
Sep 09 16:00:27.345549 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:27.345517    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"]
Sep 09 16:00:27.349282 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:27.349256    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-a2b442-openshift-default-6b58988c6b-snlgl"]
Sep 09 16:00:28.321546 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:28.321511    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" path="/var/lib/kubelet/pods/8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373/volumes"
Sep 09 16:00:32.007896 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.007831    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-450a51-29816160-mx4dz"]
Sep 09 16:00:32.010542 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.010513    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-450a51-29816160-mx4dz"]
Sep 09 16:00:32.031147 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.031116    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"]
Sep 09 16:00:32.031355 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.031329    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7" podUID="cd37fc58-1503-4604-9936-674e15616390" containerName="payload-processing" containerID="cri-o://1554ea973d82adc7b78d0f1842f44aa3b83f66f4d3e80eaf9c7e8efa1006efca" gracePeriod=30
Sep 09 16:00:32.038769 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.038739    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"]
Sep 09 16:00:32.039043 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.039013    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl" podUID="988f996b-28e3-4f78-b53a-32d097fb8e0d" containerName="payload-pre-processing" containerID="cri-o://c7fa9104ba6c69697d18f67c59e8551282f661ad9f42b74bb9da9a15b7787797" gracePeriod=30
Sep 09 16:00:32.321172 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.321141    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f82a8b12-306c-47a8-bdcb-3b06ee17c0cc" path="/var/lib/kubelet/pods/f82a8b12-306c-47a8-bdcb-3b06ee17c0cc/volumes"
Sep 09 16:00:32.331950 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.331917    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"
Sep 09 16:00:32.337970 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.337939    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"
Sep 09 16:00:32.353741 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.353710    2574 generic.go:356] "Generic (PLEG): container finished" podID="988f996b-28e3-4f78-b53a-32d097fb8e0d" containerID="c7fa9104ba6c69697d18f67c59e8551282f661ad9f42b74bb9da9a15b7787797" exitCode=0
Sep 09 16:00:32.353909 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.353750    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"
Sep 09 16:00:32.353909 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.353766    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl" event={"ID":"988f996b-28e3-4f78-b53a-32d097fb8e0d","Type":"ContainerDied","Data":"c7fa9104ba6c69697d18f67c59e8551282f661ad9f42b74bb9da9a15b7787797"}
Sep 09 16:00:32.353909 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.353812    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl" event={"ID":"988f996b-28e3-4f78-b53a-32d097fb8e0d","Type":"ContainerDied","Data":"372618253efd9926b9b145f5ac5f6a2124dc3cff1090da46a94d9688d6ec5f8a"}
Sep 09 16:00:32.353909 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.353863    2574 scope.go:117] "RemoveContainer" containerID="c7fa9104ba6c69697d18f67c59e8551282f661ad9f42b74bb9da9a15b7787797"
Sep 09 16:00:32.356241 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.356216    2574 generic.go:356] "Generic (PLEG): container finished" podID="cd37fc58-1503-4604-9936-674e15616390" containerID="1554ea973d82adc7b78d0f1842f44aa3b83f66f4d3e80eaf9c7e8efa1006efca" exitCode=0
Sep 09 16:00:32.356345 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.356284    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7" event={"ID":"cd37fc58-1503-4604-9936-674e15616390","Type":"ContainerDied","Data":"1554ea973d82adc7b78d0f1842f44aa3b83f66f4d3e80eaf9c7e8efa1006efca"}
Sep 09 16:00:32.356402 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.356346    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7" event={"ID":"cd37fc58-1503-4604-9936-674e15616390","Type":"ContainerDied","Data":"47b7bb6a453a7224bdb0c3f510ee42fccf26792b0b9e94706ea8f8ac0ef4eaf7"}
Sep 09 16:00:32.356443 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.356409    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"
Sep 09 16:00:32.365153 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.365127    2574 scope.go:117] "RemoveContainer" containerID="c7fa9104ba6c69697d18f67c59e8551282f661ad9f42b74bb9da9a15b7787797"
Sep 09 16:00:32.365712 ip-10-0-140-68 kubenswrapper[2574]: E0909 16:00:32.365470    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7fa9104ba6c69697d18f67c59e8551282f661ad9f42b74bb9da9a15b7787797\": container with ID starting with c7fa9104ba6c69697d18f67c59e8551282f661ad9f42b74bb9da9a15b7787797 not found: ID does not exist" containerID="c7fa9104ba6c69697d18f67c59e8551282f661ad9f42b74bb9da9a15b7787797"
Sep 09 16:00:32.365712 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.365500    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7fa9104ba6c69697d18f67c59e8551282f661ad9f42b74bb9da9a15b7787797"} err="failed to get container status \"c7fa9104ba6c69697d18f67c59e8551282f661ad9f42b74bb9da9a15b7787797\": rpc error: code = NotFound desc = could not find container \"c7fa9104ba6c69697d18f67c59e8551282f661ad9f42b74bb9da9a15b7787797\": container with ID starting with c7fa9104ba6c69697d18f67c59e8551282f661ad9f42b74bb9da9a15b7787797 not found: ID does not exist"
Sep 09 16:00:32.365712 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.365522    2574 scope.go:117] "RemoveContainer" containerID="1554ea973d82adc7b78d0f1842f44aa3b83f66f4d3e80eaf9c7e8efa1006efca"
Sep 09 16:00:32.385644 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.385621    2574 scope.go:117] "RemoveContainer" containerID="1554ea973d82adc7b78d0f1842f44aa3b83f66f4d3e80eaf9c7e8efa1006efca"
Sep 09 16:00:32.386199 ip-10-0-140-68 kubenswrapper[2574]: E0909 16:00:32.386173    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1554ea973d82adc7b78d0f1842f44aa3b83f66f4d3e80eaf9c7e8efa1006efca\": container with ID starting with 1554ea973d82adc7b78d0f1842f44aa3b83f66f4d3e80eaf9c7e8efa1006efca not found: ID does not exist" containerID="1554ea973d82adc7b78d0f1842f44aa3b83f66f4d3e80eaf9c7e8efa1006efca"
Sep 09 16:00:32.386317 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.386211    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1554ea973d82adc7b78d0f1842f44aa3b83f66f4d3e80eaf9c7e8efa1006efca"} err="failed to get container status \"1554ea973d82adc7b78d0f1842f44aa3b83f66f4d3e80eaf9c7e8efa1006efca\": rpc error: code = NotFound desc = could not find container \"1554ea973d82adc7b78d0f1842f44aa3b83f66f4d3e80eaf9c7e8efa1006efca\": container with ID starting with 1554ea973d82adc7b78d0f1842f44aa3b83f66f4d3e80eaf9c7e8efa1006efca not found: ID does not exist"
Sep 09 16:00:32.438260 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.438228    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q7gh\" (UniqueName: \"kubernetes.io/projected/cd37fc58-1503-4604-9936-674e15616390-kube-api-access-7q7gh\") pod \"cd37fc58-1503-4604-9936-674e15616390\" (UID: \"cd37fc58-1503-4604-9936-674e15616390\") "
Sep 09 16:00:32.438454 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.438303    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/988f996b-28e3-4f78-b53a-32d097fb8e0d-plugins-config-volume\") pod \"988f996b-28e3-4f78-b53a-32d097fb8e0d\" (UID: \"988f996b-28e3-4f78-b53a-32d097fb8e0d\") "
Sep 09 16:00:32.438454 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.438366    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fz6tx\" (UniqueName: \"kubernetes.io/projected/988f996b-28e3-4f78-b53a-32d097fb8e0d-kube-api-access-fz6tx\") pod \"988f996b-28e3-4f78-b53a-32d097fb8e0d\" (UID: \"988f996b-28e3-4f78-b53a-32d097fb8e0d\") "
Sep 09 16:00:32.438454 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.438444    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd37fc58-1503-4604-9936-674e15616390-plugins-config-volume\") pod \"cd37fc58-1503-4604-9936-674e15616390\" (UID: \"cd37fc58-1503-4604-9936-674e15616390\") "
Sep 09 16:00:32.438802 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.438753    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/988f996b-28e3-4f78-b53a-32d097fb8e0d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "988f996b-28e3-4f78-b53a-32d097fb8e0d" (UID: "988f996b-28e3-4f78-b53a-32d097fb8e0d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:00:32.438988 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.438824    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd37fc58-1503-4604-9936-674e15616390-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cd37fc58-1503-4604-9936-674e15616390" (UID: "cd37fc58-1503-4604-9936-674e15616390"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:00:32.439066 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.439011    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/988f996b-28e3-4f78-b53a-32d097fb8e0d-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:32.439066 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.439032    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd37fc58-1503-4604-9936-674e15616390-plugins-config-volume\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:32.440679 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.440651    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd37fc58-1503-4604-9936-674e15616390-kube-api-access-7q7gh" (OuterVolumeSpecName: "kube-api-access-7q7gh") pod "cd37fc58-1503-4604-9936-674e15616390" (UID: "cd37fc58-1503-4604-9936-674e15616390"). InnerVolumeSpecName "kube-api-access-7q7gh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:00:32.440779 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.440701    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/988f996b-28e3-4f78-b53a-32d097fb8e0d-kube-api-access-fz6tx" (OuterVolumeSpecName: "kube-api-access-fz6tx") pod "988f996b-28e3-4f78-b53a-32d097fb8e0d" (UID: "988f996b-28e3-4f78-b53a-32d097fb8e0d"). InnerVolumeSpecName "kube-api-access-fz6tx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:00:32.540330 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.540293    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q7gh\" (UniqueName: \"kubernetes.io/projected/cd37fc58-1503-4604-9936-674e15616390-kube-api-access-7q7gh\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:32.540330 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.540331    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz6tx\" (UniqueName: \"kubernetes.io/projected/988f996b-28e3-4f78-b53a-32d097fb8e0d-kube-api-access-fz6tx\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:32.680963 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.680933    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"]
Sep 09 16:00:32.684670 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.684642    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-450a51-6d4658cd78-nkfgl"]
Sep 09 16:00:32.696514 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.696484    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"]
Sep 09 16:00:32.700315 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:32.700291    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-450a51-74748c8c5-fmwc7"]
Sep 09 16:00:34.320364 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:34.320328    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="988f996b-28e3-4f78-b53a-32d097fb8e0d" path="/var/lib/kubelet/pods/988f996b-28e3-4f78-b53a-32d097fb8e0d/volumes"
Sep 09 16:00:34.320751 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:34.320718    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd37fc58-1503-4604-9936-674e15616390" path="/var/lib/kubelet/pods/cd37fc58-1503-4604-9936-674e15616390/volumes"
Sep 09 16:00:34.897502 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:34.897458    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:00:38.670202 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:38.670115    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"]
Sep 09 16:00:38.670778 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:38.670330    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn" podUID="53b263f5-7aef-4517-9317-910bf4183e3a" containerName="istio-proxy" containerID="cri-o://d4e30ef00cea19bda3baf59a381dc15eddfc73e0d4b955151d28c732e05b09d2" gracePeriod=30
Sep 09 16:00:41.014977 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:41.014931    2574 patch_prober.go:28] interesting pod/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 16:00:41.015368 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:41.015015    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn" podUID="53b263f5-7aef-4517-9317-910bf4183e3a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 16:00:43.927276 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:43.927252    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 16:00:44.050721 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.050686    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-istio-data\") pod \"53b263f5-7aef-4517-9317-910bf4183e3a\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") "
Sep 09 16:00:44.050721 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.050732    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53b263f5-7aef-4517-9317-910bf4183e3a-istio-podinfo\") pod \"53b263f5-7aef-4517-9317-910bf4183e3a\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") "
Sep 09 16:00:44.051028 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.050754    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53b263f5-7aef-4517-9317-910bf4183e3a-istio-token\") pod \"53b263f5-7aef-4517-9317-910bf4183e3a\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") "
Sep 09 16:00:44.051028 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.050790    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-credential-socket\") pod \"53b263f5-7aef-4517-9317-910bf4183e3a\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") "
Sep 09 16:00:44.051028 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.050865    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-workload-socket\") pod \"53b263f5-7aef-4517-9317-910bf4183e3a\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") "
Sep 09 16:00:44.051028 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.050893    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lpks\" (UniqueName: \"kubernetes.io/projected/53b263f5-7aef-4517-9317-910bf4183e3a-kube-api-access-4lpks\") pod \"53b263f5-7aef-4517-9317-910bf4183e3a\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") "
Sep 09 16:00:44.051028 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.050932    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-workload-certs\") pod \"53b263f5-7aef-4517-9317-910bf4183e3a\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") "
Sep 09 16:00:44.051028 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.050960    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-istio-envoy\") pod \"53b263f5-7aef-4517-9317-910bf4183e3a\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") "
Sep 09 16:00:44.051028 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.051021    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53b263f5-7aef-4517-9317-910bf4183e3a-istiod-ca-cert\") pod \"53b263f5-7aef-4517-9317-910bf4183e3a\" (UID: \"53b263f5-7aef-4517-9317-910bf4183e3a\") "
Sep 09 16:00:44.051394 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.051076    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-istio-data" (OuterVolumeSpecName: "istio-data") pod "53b263f5-7aef-4517-9317-910bf4183e3a" (UID: "53b263f5-7aef-4517-9317-910bf4183e3a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:00:44.051394 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.051193    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "53b263f5-7aef-4517-9317-910bf4183e3a" (UID: "53b263f5-7aef-4517-9317-910bf4183e3a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:00:44.051394 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.051256    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "53b263f5-7aef-4517-9317-910bf4183e3a" (UID: "53b263f5-7aef-4517-9317-910bf4183e3a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:00:44.051573 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.051387    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "53b263f5-7aef-4517-9317-910bf4183e3a" (UID: "53b263f5-7aef-4517-9317-910bf4183e3a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:00:44.051573 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.051446    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-istio-data\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:44.051573 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.051465    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-credential-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:44.051573 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.051479    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-workload-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:44.051811 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.051668    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b263f5-7aef-4517-9317-910bf4183e3a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "53b263f5-7aef-4517-9317-910bf4183e3a" (UID: "53b263f5-7aef-4517-9317-910bf4183e3a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:00:44.053273 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.053248    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53b263f5-7aef-4517-9317-910bf4183e3a-istio-token" (OuterVolumeSpecName: "istio-token") pod "53b263f5-7aef-4517-9317-910bf4183e3a" (UID: "53b263f5-7aef-4517-9317-910bf4183e3a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:00:44.053423 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.053393    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53b263f5-7aef-4517-9317-910bf4183e3a-kube-api-access-4lpks" (OuterVolumeSpecName: "kube-api-access-4lpks") pod "53b263f5-7aef-4517-9317-910bf4183e3a" (UID: "53b263f5-7aef-4517-9317-910bf4183e3a"). InnerVolumeSpecName "kube-api-access-4lpks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:00:44.053759 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.053731    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "53b263f5-7aef-4517-9317-910bf4183e3a" (UID: "53b263f5-7aef-4517-9317-910bf4183e3a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:00:44.053759 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.053734    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/53b263f5-7aef-4517-9317-910bf4183e3a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "53b263f5-7aef-4517-9317-910bf4183e3a" (UID: "53b263f5-7aef-4517-9317-910bf4183e3a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:00:44.152168 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.152123    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53b263f5-7aef-4517-9317-910bf4183e3a-istio-podinfo\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:44.152168 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.152160    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53b263f5-7aef-4517-9317-910bf4183e3a-istio-token\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:44.152168 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.152168    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lpks\" (UniqueName: \"kubernetes.io/projected/53b263f5-7aef-4517-9317-910bf4183e3a-kube-api-access-4lpks\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:44.152168 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.152178    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-workload-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:44.152447 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.152188    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53b263f5-7aef-4517-9317-910bf4183e3a-istio-envoy\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:44.152447 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.152195    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53b263f5-7aef-4517-9317-910bf4183e3a-istiod-ca-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:44.429447 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.429412    2574 generic.go:356] "Generic (PLEG): container finished" podID="53b263f5-7aef-4517-9317-910bf4183e3a" containerID="d4e30ef00cea19bda3baf59a381dc15eddfc73e0d4b955151d28c732e05b09d2" exitCode=0
Sep 09 16:00:44.429629 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.429461    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"
Sep 09 16:00:44.429629 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.429497    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn" event={"ID":"53b263f5-7aef-4517-9317-910bf4183e3a","Type":"ContainerDied","Data":"d4e30ef00cea19bda3baf59a381dc15eddfc73e0d4b955151d28c732e05b09d2"}
Sep 09 16:00:44.429629 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.429560    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn" event={"ID":"53b263f5-7aef-4517-9317-910bf4183e3a","Type":"ContainerDied","Data":"964d63d09553b354898a5e4b3565d23e1efc5fa9574e60680c4756fac20a3650"}
Sep 09 16:00:44.429629 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.429587    2574 scope.go:117] "RemoveContainer" containerID="d4e30ef00cea19bda3baf59a381dc15eddfc73e0d4b955151d28c732e05b09d2"
Sep 09 16:00:44.439380 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.439359    2574 scope.go:117] "RemoveContainer" containerID="8f45a38f98b02c119ab53ffcda3be1b1a3672072224503cd676c834f1d7f85cb"
Sep 09 16:00:44.448439 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.448413    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"]
Sep 09 16:00:44.458726 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.452940    2574 scope.go:117] "RemoveContainer" containerID="d4e30ef00cea19bda3baf59a381dc15eddfc73e0d4b955151d28c732e05b09d2"
Sep 09 16:00:44.458726 ip-10-0-140-68 kubenswrapper[2574]: E0909 16:00:44.453357    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4e30ef00cea19bda3baf59a381dc15eddfc73e0d4b955151d28c732e05b09d2\": container with ID starting with d4e30ef00cea19bda3baf59a381dc15eddfc73e0d4b955151d28c732e05b09d2 not found: ID does not exist" containerID="d4e30ef00cea19bda3baf59a381dc15eddfc73e0d4b955151d28c732e05b09d2"
Sep 09 16:00:44.458726 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.453402    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4e30ef00cea19bda3baf59a381dc15eddfc73e0d4b955151d28c732e05b09d2"} err="failed to get container status \"d4e30ef00cea19bda3baf59a381dc15eddfc73e0d4b955151d28c732e05b09d2\": rpc error: code = NotFound desc = could not find container \"d4e30ef00cea19bda3baf59a381dc15eddfc73e0d4b955151d28c732e05b09d2\": container with ID starting with d4e30ef00cea19bda3baf59a381dc15eddfc73e0d4b955151d28c732e05b09d2 not found: ID does not exist"
Sep 09 16:00:44.458726 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.453426    2574 scope.go:117] "RemoveContainer" containerID="8f45a38f98b02c119ab53ffcda3be1b1a3672072224503cd676c834f1d7f85cb"
Sep 09 16:00:44.458726 ip-10-0-140-68 kubenswrapper[2574]: E0909 16:00:44.453759    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f45a38f98b02c119ab53ffcda3be1b1a3672072224503cd676c834f1d7f85cb\": container with ID starting with 8f45a38f98b02c119ab53ffcda3be1b1a3672072224503cd676c834f1d7f85cb not found: ID does not exist" containerID="8f45a38f98b02c119ab53ffcda3be1b1a3672072224503cd676c834f1d7f85cb"
Sep 09 16:00:44.458726 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.453805    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f45a38f98b02c119ab53ffcda3be1b1a3672072224503cd676c834f1d7f85cb"} err="failed to get container status \"8f45a38f98b02c119ab53ffcda3be1b1a3672072224503cd676c834f1d7f85cb\": rpc error: code = NotFound desc = could not find container \"8f45a38f98b02c119ab53ffcda3be1b1a3672072224503cd676c834f1d7f85cb\": container with ID starting with 8f45a38f98b02c119ab53ffcda3be1b1a3672072224503cd676c834f1d7f85cb not found: ID does not exist"
Sep 09 16:00:44.458726 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:44.455788    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-450a51-openshift-default-757bd66bc6-jxlzn"]
Sep 09 16:00:46.320465 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:46.320432    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53b263f5-7aef-4517-9317-910bf4183e3a" path="/var/lib/kubelet/pods/53b263f5-7aef-4517-9317-910bf4183e3a/volumes"
Sep 09 16:00:49.593538 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:49.593499    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"]
Sep 09 16:00:49.594361 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:49.594322    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn" podUID="a06df2ca-fa09-41df-aeea-8927ba8e3823" containerName="maas-api" containerID="cri-o://90d28ee8742bc323cb18e5320801310127ecb2fdd48906979b9ae5433924ae84" gracePeriod=30
Sep 09 16:00:49.853357 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:49.853294    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 16:00:49.909801 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:49.909755    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a06df2ca-fa09-41df-aeea-8927ba8e3823-metrics-certs\") pod \"a06df2ca-fa09-41df-aeea-8927ba8e3823\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") "
Sep 09 16:00:49.909801 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:49.909809    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh2ph\" (UniqueName: \"kubernetes.io/projected/a06df2ca-fa09-41df-aeea-8927ba8e3823-kube-api-access-sh2ph\") pod \"a06df2ca-fa09-41df-aeea-8927ba8e3823\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") "
Sep 09 16:00:49.910028 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:49.909888    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a06df2ca-fa09-41df-aeea-8927ba8e3823-openshift-service-ca\") pod \"a06df2ca-fa09-41df-aeea-8927ba8e3823\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") "
Sep 09 16:00:49.910028 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:49.909954    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a06df2ca-fa09-41df-aeea-8927ba8e3823-maas-api-tls\") pod \"a06df2ca-fa09-41df-aeea-8927ba8e3823\" (UID: \"a06df2ca-fa09-41df-aeea-8927ba8e3823\") "
Sep 09 16:00:49.910252 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:49.910223    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a06df2ca-fa09-41df-aeea-8927ba8e3823-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a06df2ca-fa09-41df-aeea-8927ba8e3823" (UID: "a06df2ca-fa09-41df-aeea-8927ba8e3823"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:00:49.912136 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:49.912111    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a06df2ca-fa09-41df-aeea-8927ba8e3823-kube-api-access-sh2ph" (OuterVolumeSpecName: "kube-api-access-sh2ph") pod "a06df2ca-fa09-41df-aeea-8927ba8e3823" (UID: "a06df2ca-fa09-41df-aeea-8927ba8e3823"). InnerVolumeSpecName "kube-api-access-sh2ph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:00:49.912257 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:49.912184    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a06df2ca-fa09-41df-aeea-8927ba8e3823-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a06df2ca-fa09-41df-aeea-8927ba8e3823" (UID: "a06df2ca-fa09-41df-aeea-8927ba8e3823"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:00:49.912325 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:49.912297    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a06df2ca-fa09-41df-aeea-8927ba8e3823-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a06df2ca-fa09-41df-aeea-8927ba8e3823" (UID: "a06df2ca-fa09-41df-aeea-8927ba8e3823"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:00:50.011048 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:50.011002    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a06df2ca-fa09-41df-aeea-8927ba8e3823-metrics-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:50.011048 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:50.011040    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh2ph\" (UniqueName: \"kubernetes.io/projected/a06df2ca-fa09-41df-aeea-8927ba8e3823-kube-api-access-sh2ph\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:50.011048 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:50.011055    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a06df2ca-fa09-41df-aeea-8927ba8e3823-openshift-service-ca\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:50.011307 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:50.011068    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a06df2ca-fa09-41df-aeea-8927ba8e3823-maas-api-tls\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:00:50.467195 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:50.467154    2574 generic.go:356] "Generic (PLEG): container finished" podID="a06df2ca-fa09-41df-aeea-8927ba8e3823" containerID="90d28ee8742bc323cb18e5320801310127ecb2fdd48906979b9ae5433924ae84" exitCode=0
Sep 09 16:00:50.467195 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:50.467198    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"
Sep 09 16:00:50.467405 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:50.467246    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn" event={"ID":"a06df2ca-fa09-41df-aeea-8927ba8e3823","Type":"ContainerDied","Data":"90d28ee8742bc323cb18e5320801310127ecb2fdd48906979b9ae5433924ae84"}
Sep 09 16:00:50.467405 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:50.467300    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn" event={"ID":"a06df2ca-fa09-41df-aeea-8927ba8e3823","Type":"ContainerDied","Data":"91841e1fbd486c5f1649457e1b4235bb64deea7abdb0ddae80399f9684aa351a"}
Sep 09 16:00:50.467405 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:50.467321    2574 scope.go:117] "RemoveContainer" containerID="90d28ee8742bc323cb18e5320801310127ecb2fdd48906979b9ae5433924ae84"
Sep 09 16:00:50.476884 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:50.476863    2574 scope.go:117] "RemoveContainer" containerID="90d28ee8742bc323cb18e5320801310127ecb2fdd48906979b9ae5433924ae84"
Sep 09 16:00:50.477185 ip-10-0-140-68 kubenswrapper[2574]: E0909 16:00:50.477169    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90d28ee8742bc323cb18e5320801310127ecb2fdd48906979b9ae5433924ae84\": container with ID starting with 90d28ee8742bc323cb18e5320801310127ecb2fdd48906979b9ae5433924ae84 not found: ID does not exist" containerID="90d28ee8742bc323cb18e5320801310127ecb2fdd48906979b9ae5433924ae84"
Sep 09 16:00:50.477239 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:50.477194    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90d28ee8742bc323cb18e5320801310127ecb2fdd48906979b9ae5433924ae84"} err="failed to get container status \"90d28ee8742bc323cb18e5320801310127ecb2fdd48906979b9ae5433924ae84\": rpc error: code = NotFound desc = could not find container \"90d28ee8742bc323cb18e5320801310127ecb2fdd48906979b9ae5433924ae84\": container with ID starting with 90d28ee8742bc323cb18e5320801310127ecb2fdd48906979b9ae5433924ae84 not found: ID does not exist"
Sep 09 16:00:50.493262 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:50.493229    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"]
Sep 09 16:00:50.497966 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:50.497935    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-482dce-57688b4758-vqhfn"]
Sep 09 16:00:52.296645 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:52.296608    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:00:52.320853 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:52.320808    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a06df2ca-fa09-41df-aeea-8927ba8e3823" path="/var/lib/kubelet/pods/a06df2ca-fa09-41df-aeea-8927ba8e3823/volumes"
Sep 09 16:00:56.264987 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:56.264952    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"]
Sep 09 16:00:56.265413 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:00:56.265199    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7" podUID="ee1747e8-e331-4cde-b6b0-55957aa87f1a" containerName="istio-proxy" containerID="cri-o://68703de05f6f65a35b6e97f6c13a638930273d7896a3e0ea383d3f54c574511b" gracePeriod=30
Sep 09 16:01:00.493261 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:00.493227    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:01:01.141616 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.141575    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 16:01:01.141785 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.141658    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7" podUID="ee1747e8-e331-4cde-b6b0-55957aa87f1a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 16:01:01.514768 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.514742    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 16:01:01.531651 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.531622    2574 generic.go:356] "Generic (PLEG): container finished" podID="ee1747e8-e331-4cde-b6b0-55957aa87f1a" containerID="68703de05f6f65a35b6e97f6c13a638930273d7896a3e0ea383d3f54c574511b" exitCode=0
Sep 09 16:01:01.531816 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.531688    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"
Sep 09 16:01:01.531816 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.531710    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7" event={"ID":"ee1747e8-e331-4cde-b6b0-55957aa87f1a","Type":"ContainerDied","Data":"68703de05f6f65a35b6e97f6c13a638930273d7896a3e0ea383d3f54c574511b"}
Sep 09 16:01:01.531816 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.531763    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7" event={"ID":"ee1747e8-e331-4cde-b6b0-55957aa87f1a","Type":"ContainerDied","Data":"336d159837de58b9ffcf68a10e9ef368457d4d2f0e7eb39e237cf60a2cf06aa4"}
Sep 09 16:01:01.531816 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.531786    2574 scope.go:117] "RemoveContainer" containerID="68703de05f6f65a35b6e97f6c13a638930273d7896a3e0ea383d3f54c574511b"
Sep 09 16:01:01.547872 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.547809    2574 scope.go:117] "RemoveContainer" containerID="dd691f776d410dffdfd913ad5757e5b255d1bf13828305a02ddca964ccadaf2d"
Sep 09 16:01:01.559512 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.559491    2574 scope.go:117] "RemoveContainer" containerID="68703de05f6f65a35b6e97f6c13a638930273d7896a3e0ea383d3f54c574511b"
Sep 09 16:01:01.559945 ip-10-0-140-68 kubenswrapper[2574]: E0909 16:01:01.559924    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68703de05f6f65a35b6e97f6c13a638930273d7896a3e0ea383d3f54c574511b\": container with ID starting with 68703de05f6f65a35b6e97f6c13a638930273d7896a3e0ea383d3f54c574511b not found: ID does not exist" containerID="68703de05f6f65a35b6e97f6c13a638930273d7896a3e0ea383d3f54c574511b"
Sep 09 16:01:01.560041 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.559956    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68703de05f6f65a35b6e97f6c13a638930273d7896a3e0ea383d3f54c574511b"} err="failed to get container status \"68703de05f6f65a35b6e97f6c13a638930273d7896a3e0ea383d3f54c574511b\": rpc error: code = NotFound desc = could not find container \"68703de05f6f65a35b6e97f6c13a638930273d7896a3e0ea383d3f54c574511b\": container with ID starting with 68703de05f6f65a35b6e97f6c13a638930273d7896a3e0ea383d3f54c574511b not found: ID does not exist"
Sep 09 16:01:01.560041 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.559981    2574 scope.go:117] "RemoveContainer" containerID="dd691f776d410dffdfd913ad5757e5b255d1bf13828305a02ddca964ccadaf2d"
Sep 09 16:01:01.560361 ip-10-0-140-68 kubenswrapper[2574]: E0909 16:01:01.560338    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd691f776d410dffdfd913ad5757e5b255d1bf13828305a02ddca964ccadaf2d\": container with ID starting with dd691f776d410dffdfd913ad5757e5b255d1bf13828305a02ddca964ccadaf2d not found: ID does not exist" containerID="dd691f776d410dffdfd913ad5757e5b255d1bf13828305a02ddca964ccadaf2d"
Sep 09 16:01:01.560484 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.560365    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd691f776d410dffdfd913ad5757e5b255d1bf13828305a02ddca964ccadaf2d"} err="failed to get container status \"dd691f776d410dffdfd913ad5757e5b255d1bf13828305a02ddca964ccadaf2d\": rpc error: code = NotFound desc = could not find container \"dd691f776d410dffdfd913ad5757e5b255d1bf13828305a02ddca964ccadaf2d\": container with ID starting with dd691f776d410dffdfd913ad5757e5b255d1bf13828305a02ddca964ccadaf2d not found: ID does not exist"
Sep 09 16:01:01.630664 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.630626    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hglvk\" (UniqueName: \"kubernetes.io/projected/ee1747e8-e331-4cde-b6b0-55957aa87f1a-kube-api-access-hglvk\") pod \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") "
Sep 09 16:01:01.630664 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.630682    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-data\") pod \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") "
Sep 09 16:01:01.630962 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.630723    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-envoy\") pod \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") "
Sep 09 16:01:01.630962 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.630773    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-workload-socket\") pod \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") "
Sep 09 16:01:01.630962 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.630809    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-podinfo\") pod \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") "
Sep 09 16:01:01.630962 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.630829    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istiod-ca-cert\") pod \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") "
Sep 09 16:01:01.630962 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.630885    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-token\") pod \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") "
Sep 09 16:01:01.630962 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.630908    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-workload-certs\") pod \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") "
Sep 09 16:01:01.631260 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.631085    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee1747e8-e331-4cde-b6b0-55957aa87f1a" (UID: "ee1747e8-e331-4cde-b6b0-55957aa87f1a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:01:01.631260 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.631094    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee1747e8-e331-4cde-b6b0-55957aa87f1a" (UID: "ee1747e8-e331-4cde-b6b0-55957aa87f1a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:01:01.631260 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.631182    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee1747e8-e331-4cde-b6b0-55957aa87f1a" (UID: "ee1747e8-e331-4cde-b6b0-55957aa87f1a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:01:01.631260 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.631232    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-credential-socket\") pod \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\" (UID: \"ee1747e8-e331-4cde-b6b0-55957aa87f1a\") "
Sep 09 16:01:01.631478 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.631321    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee1747e8-e331-4cde-b6b0-55957aa87f1a" (UID: "ee1747e8-e331-4cde-b6b0-55957aa87f1a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:01:01.631536 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.631508    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee1747e8-e331-4cde-b6b0-55957aa87f1a" (UID: "ee1747e8-e331-4cde-b6b0-55957aa87f1a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:01:01.631618 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.631601    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-workload-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:01:01.631680 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.631625    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istiod-ca-cert\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:01:01.631680 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.631640    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-workload-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:01:01.631680 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.631654    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-credential-socket\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:01:01.631680 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.631666    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-data\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:01:01.633298 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.633271    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee1747e8-e331-4cde-b6b0-55957aa87f1a" (UID: "ee1747e8-e331-4cde-b6b0-55957aa87f1a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:01:01.633412 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.633275    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee1747e8-e331-4cde-b6b0-55957aa87f1a-kube-api-access-hglvk" (OuterVolumeSpecName: "kube-api-access-hglvk") pod "ee1747e8-e331-4cde-b6b0-55957aa87f1a" (UID: "ee1747e8-e331-4cde-b6b0-55957aa87f1a"). InnerVolumeSpecName "kube-api-access-hglvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:01:01.633412 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.633325    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee1747e8-e331-4cde-b6b0-55957aa87f1a" (UID: "ee1747e8-e331-4cde-b6b0-55957aa87f1a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:01:01.633412 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.633393    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee1747e8-e331-4cde-b6b0-55957aa87f1a" (UID: "ee1747e8-e331-4cde-b6b0-55957aa87f1a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:01:01.732602 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.732561    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-podinfo\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:01:01.732602 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.732597    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-token\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:01:01.732602 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.732607    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hglvk\" (UniqueName: \"kubernetes.io/projected/ee1747e8-e331-4cde-b6b0-55957aa87f1a-kube-api-access-hglvk\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:01:01.732879 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.732616    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee1747e8-e331-4cde-b6b0-55957aa87f1a-istio-envoy\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:01:01.855918 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.855889    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"]
Sep 09 16:01:01.859884 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:01.859861    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-482dce-openshift-default-6b6dcdfd8b-4tmh7"]
Sep 09 16:01:02.320736 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:01:02.320701    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee1747e8-e331-4cde-b6b0-55957aa87f1a" path="/var/lib/kubelet/pods/ee1747e8-e331-4cde-b6b0-55957aa87f1a/volumes"
Sep 09 16:02:25.196033 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:02:25.195996    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:02:51.489458 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:02:51.489419    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:02:59.502884 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:02:59.502837    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:03:07.694773 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:03:07.694731    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:03:25.292018 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:03:25.291980    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:04:51.099992 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:04:51.099952    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:04:57.800152 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:04:57.800117    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:05:06.789145 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:05:06.789099    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:05:13.088330 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:05:13.088297    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:05:22.395349 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:05:22.395318    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:05:42.103161 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:05:42.103126    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:05:48.410857 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:05:48.410807    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:05:55.498352 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:05:55.498309    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:06:02.709086 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:02.709046    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:06:03.198120 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198091    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"]
Sep 09 16:06:03.198552 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198533    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd37fc58-1503-4604-9936-674e15616390" containerName="payload-processing"
Sep 09 16:06:03.198648 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198556    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd37fc58-1503-4604-9936-674e15616390" containerName="payload-processing"
Sep 09 16:06:03.198648 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198571    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee1747e8-e331-4cde-b6b0-55957aa87f1a" containerName="istio-proxy"
Sep 09 16:06:03.198648 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198579    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee1747e8-e331-4cde-b6b0-55957aa87f1a" containerName="istio-proxy"
Sep 09 16:06:03.198648 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198602    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" containerName="istio-proxy"
Sep 09 16:06:03.198648 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198611    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" containerName="istio-proxy"
Sep 09 16:06:03.198648 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198621    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="988f996b-28e3-4f78-b53a-32d097fb8e0d" containerName="payload-pre-processing"
Sep 09 16:06:03.198648 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198629    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="988f996b-28e3-4f78-b53a-32d097fb8e0d" containerName="payload-pre-processing"
Sep 09 16:06:03.198648 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198639    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a06df2ca-fa09-41df-aeea-8927ba8e3823" containerName="maas-api"
Sep 09 16:06:03.198648 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198646    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a06df2ca-fa09-41df-aeea-8927ba8e3823" containerName="maas-api"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198660    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f82a8b12-306c-47a8-bdcb-3b06ee17c0cc" containerName="cleanup"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198668    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f82a8b12-306c-47a8-bdcb-3b06ee17c0cc" containerName="cleanup"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198682    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53b263f5-7aef-4517-9317-910bf4183e3a" containerName="istio-proxy"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198689    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="53b263f5-7aef-4517-9317-910bf4183e3a" containerName="istio-proxy"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198701    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53b263f5-7aef-4517-9317-910bf4183e3a" containerName="istio-proxy"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198709    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="53b263f5-7aef-4517-9317-910bf4183e3a" containerName="istio-proxy"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198718    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" containerName="istio-proxy"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198727    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" containerName="istio-proxy"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198833    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" containerName="istio-proxy"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198866    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="53b263f5-7aef-4517-9317-910bf4183e3a" containerName="istio-proxy"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198877    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="53b263f5-7aef-4517-9317-910bf4183e3a" containerName="istio-proxy"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198887    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a06df2ca-fa09-41df-aeea-8927ba8e3823" containerName="maas-api"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198897    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee1747e8-e331-4cde-b6b0-55957aa87f1a" containerName="istio-proxy"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198905    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="988f996b-28e3-4f78-b53a-32d097fb8e0d" containerName="payload-pre-processing"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198915    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd37fc58-1503-4604-9936-674e15616390" containerName="payload-processing"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198924    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee1747e8-e331-4cde-b6b0-55957aa87f1a" containerName="istio-proxy"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198931    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ab49b0f-96ec-4e6b-b1f0-99f81ef3d373" containerName="istio-proxy"
Sep 09 16:06:03.199127 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.198941    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f82a8b12-306c-47a8-bdcb-3b06ee17c0cc" containerName="cleanup"
Sep 09 16:06:03.202381 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.202362    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:03.206504 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.206478    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 16:06:03.207772 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.207751    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 16:06:03.207918 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.207775    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 16:06:03.207918 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.207807    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lw9zj\""
Sep 09 16:06:03.208060 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.207933    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 16:06:03.220548 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.220519    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"]
Sep 09 16:06:03.245734 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.245707    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcdef579-8743-4cd5-b834-3421dad1c0c1-metrics-certs\") pod \"maas-api-6d864d7888-rfm6p\" (UID: \"dcdef579-8743-4cd5-b834-3421dad1c0c1\") " pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:03.245876 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.245751    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcdef579-8743-4cd5-b834-3421dad1c0c1-maas-api-tls\") pod \"maas-api-6d864d7888-rfm6p\" (UID: \"dcdef579-8743-4cd5-b834-3421dad1c0c1\") " pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:03.245876 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.245834    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-467mg\" (UniqueName: \"kubernetes.io/projected/dcdef579-8743-4cd5-b834-3421dad1c0c1-kube-api-access-467mg\") pod \"maas-api-6d864d7888-rfm6p\" (UID: \"dcdef579-8743-4cd5-b834-3421dad1c0c1\") " pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:03.245967 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.245907    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcdef579-8743-4cd5-b834-3421dad1c0c1-openshift-service-ca\") pod \"maas-api-6d864d7888-rfm6p\" (UID: \"dcdef579-8743-4cd5-b834-3421dad1c0c1\") " pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:03.347217 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.347186    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcdef579-8743-4cd5-b834-3421dad1c0c1-metrics-certs\") pod \"maas-api-6d864d7888-rfm6p\" (UID: \"dcdef579-8743-4cd5-b834-3421dad1c0c1\") " pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:03.347369 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.347227    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcdef579-8743-4cd5-b834-3421dad1c0c1-maas-api-tls\") pod \"maas-api-6d864d7888-rfm6p\" (UID: \"dcdef579-8743-4cd5-b834-3421dad1c0c1\") " pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:03.347369 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.347264    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-467mg\" (UniqueName: \"kubernetes.io/projected/dcdef579-8743-4cd5-b834-3421dad1c0c1-kube-api-access-467mg\") pod \"maas-api-6d864d7888-rfm6p\" (UID: \"dcdef579-8743-4cd5-b834-3421dad1c0c1\") " pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:03.347369 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.347297    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcdef579-8743-4cd5-b834-3421dad1c0c1-openshift-service-ca\") pod \"maas-api-6d864d7888-rfm6p\" (UID: \"dcdef579-8743-4cd5-b834-3421dad1c0c1\") " pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:03.348074 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.347989    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcdef579-8743-4cd5-b834-3421dad1c0c1-openshift-service-ca\") pod \"maas-api-6d864d7888-rfm6p\" (UID: \"dcdef579-8743-4cd5-b834-3421dad1c0c1\") " pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:03.349997 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.349970    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcdef579-8743-4cd5-b834-3421dad1c0c1-metrics-certs\") pod \"maas-api-6d864d7888-rfm6p\" (UID: \"dcdef579-8743-4cd5-b834-3421dad1c0c1\") " pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:03.350089 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.349968    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcdef579-8743-4cd5-b834-3421dad1c0c1-maas-api-tls\") pod \"maas-api-6d864d7888-rfm6p\" (UID: \"dcdef579-8743-4cd5-b834-3421dad1c0c1\") " pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:03.356191 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.356169    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-467mg\" (UniqueName: \"kubernetes.io/projected/dcdef579-8743-4cd5-b834-3421dad1c0c1-kube-api-access-467mg\") pod \"maas-api-6d864d7888-rfm6p\" (UID: \"dcdef579-8743-4cd5-b834-3421dad1c0c1\") " pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:03.512963 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.512875    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:03.791095 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.789940    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"]
Sep 09 16:06:03.792747 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:03.792720    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:06:04.198589 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:04.198557    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p" event={"ID":"dcdef579-8743-4cd5-b834-3421dad1c0c1","Type":"ContainerStarted","Data":"93d51c9582ab6e492e98f1cbb0ce0ee107e642c725d3e731d8b0e3d51ea191e9"}
Sep 09 16:06:05.205916 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:05.205876    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p" event={"ID":"dcdef579-8743-4cd5-b834-3421dad1c0c1","Type":"ContainerStarted","Data":"fd4eed38590d58992915c3503eccc49c14e4057eebd086c9fb098301a38c1631"}
Sep 09 16:06:05.206306 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:05.206074    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:05.222676 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:05.222629    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p" podStartSLOduration=1.635241052 podStartE2EDuration="2.222615952s" totalImagesPullingTime="587.3749ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:06:05.22240037 +0000 UTC m=+2749.412603119" watchObservedRunningTime="2026-09-09 16:06:05.222615952 +0000 UTC m=+2749.412818701"
Sep 09 16:06:10.687771 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.687735    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"]
Sep 09 16:06:10.688249 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.688027    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p" podUID="dcdef579-8743-4cd5-b834-3421dad1c0c1" containerName="maas-api" containerID="cri-o://fd4eed38590d58992915c3503eccc49c14e4057eebd086c9fb098301a38c1631" gracePeriod=30
Sep 09 16:06:10.694581 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.694557    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:10.719724 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.719700    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"]
Sep 09 16:06:10.720121 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.720108    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee1747e8-e331-4cde-b6b0-55957aa87f1a" containerName="istio-proxy"
Sep 09 16:06:10.720167 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.720124    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee1747e8-e331-4cde-b6b0-55957aa87f1a" containerName="istio-proxy"
Sep 09 16:06:10.723407 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.723391    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"
Sep 09 16:06:10.731786 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.731760    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"]
Sep 09 16:06:10.806209 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.806180    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:06:10.809921 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.809897    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d197ce2-27bd-40c0-9983-f979fbf8472d-openshift-service-ca\") pod \"maas-api-8476d9f544-xl7xr\" (UID: \"6d197ce2-27bd-40c0-9983-f979fbf8472d\") " pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"
Sep 09 16:06:10.810029 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.809934    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d197ce2-27bd-40c0-9983-f979fbf8472d-maas-api-tls\") pod \"maas-api-8476d9f544-xl7xr\" (UID: \"6d197ce2-27bd-40c0-9983-f979fbf8472d\") " pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"
Sep 09 16:06:10.810089 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.810025    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnxqq\" (UniqueName: \"kubernetes.io/projected/6d197ce2-27bd-40c0-9983-f979fbf8472d-kube-api-access-dnxqq\") pod \"maas-api-8476d9f544-xl7xr\" (UID: \"6d197ce2-27bd-40c0-9983-f979fbf8472d\") " pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"
Sep 09 16:06:10.810152 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.810093    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d197ce2-27bd-40c0-9983-f979fbf8472d-metrics-certs\") pod \"maas-api-8476d9f544-xl7xr\" (UID: \"6d197ce2-27bd-40c0-9983-f979fbf8472d\") " pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"
Sep 09 16:06:10.911054 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.911025    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d197ce2-27bd-40c0-9983-f979fbf8472d-metrics-certs\") pod \"maas-api-8476d9f544-xl7xr\" (UID: \"6d197ce2-27bd-40c0-9983-f979fbf8472d\") " pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"
Sep 09 16:06:10.911235 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.911079    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d197ce2-27bd-40c0-9983-f979fbf8472d-openshift-service-ca\") pod \"maas-api-8476d9f544-xl7xr\" (UID: \"6d197ce2-27bd-40c0-9983-f979fbf8472d\") " pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"
Sep 09 16:06:10.911235 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.911096    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d197ce2-27bd-40c0-9983-f979fbf8472d-maas-api-tls\") pod \"maas-api-8476d9f544-xl7xr\" (UID: \"6d197ce2-27bd-40c0-9983-f979fbf8472d\") " pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"
Sep 09 16:06:10.911235 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.911162    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnxqq\" (UniqueName: \"kubernetes.io/projected/6d197ce2-27bd-40c0-9983-f979fbf8472d-kube-api-access-dnxqq\") pod \"maas-api-8476d9f544-xl7xr\" (UID: \"6d197ce2-27bd-40c0-9983-f979fbf8472d\") " pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"
Sep 09 16:06:10.911896 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.911821    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d197ce2-27bd-40c0-9983-f979fbf8472d-openshift-service-ca\") pod \"maas-api-8476d9f544-xl7xr\" (UID: \"6d197ce2-27bd-40c0-9983-f979fbf8472d\") " pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"
Sep 09 16:06:10.914094 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.914066    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d197ce2-27bd-40c0-9983-f979fbf8472d-metrics-certs\") pod \"maas-api-8476d9f544-xl7xr\" (UID: \"6d197ce2-27bd-40c0-9983-f979fbf8472d\") " pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"
Sep 09 16:06:10.914877 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.914445    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d197ce2-27bd-40c0-9983-f979fbf8472d-maas-api-tls\") pod \"maas-api-8476d9f544-xl7xr\" (UID: \"6d197ce2-27bd-40c0-9983-f979fbf8472d\") " pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"
Sep 09 16:06:10.919334 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.919312    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnxqq\" (UniqueName: \"kubernetes.io/projected/6d197ce2-27bd-40c0-9983-f979fbf8472d-kube-api-access-dnxqq\") pod \"maas-api-8476d9f544-xl7xr\" (UID: \"6d197ce2-27bd-40c0-9983-f979fbf8472d\") " pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"
Sep 09 16:06:10.941053 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:10.941006    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:11.011977 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.011949    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcdef579-8743-4cd5-b834-3421dad1c0c1-openshift-service-ca\") pod \"dcdef579-8743-4cd5-b834-3421dad1c0c1\" (UID: \"dcdef579-8743-4cd5-b834-3421dad1c0c1\") "
Sep 09 16:06:11.012117 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.011993    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcdef579-8743-4cd5-b834-3421dad1c0c1-maas-api-tls\") pod \"dcdef579-8743-4cd5-b834-3421dad1c0c1\" (UID: \"dcdef579-8743-4cd5-b834-3421dad1c0c1\") "
Sep 09 16:06:11.012117 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.012030    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-467mg\" (UniqueName: \"kubernetes.io/projected/dcdef579-8743-4cd5-b834-3421dad1c0c1-kube-api-access-467mg\") pod \"dcdef579-8743-4cd5-b834-3421dad1c0c1\" (UID: \"dcdef579-8743-4cd5-b834-3421dad1c0c1\") "
Sep 09 16:06:11.012117 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.012070    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcdef579-8743-4cd5-b834-3421dad1c0c1-metrics-certs\") pod \"dcdef579-8743-4cd5-b834-3421dad1c0c1\" (UID: \"dcdef579-8743-4cd5-b834-3421dad1c0c1\") "
Sep 09 16:06:11.012285 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.012252    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcdef579-8743-4cd5-b834-3421dad1c0c1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dcdef579-8743-4cd5-b834-3421dad1c0c1" (UID: "dcdef579-8743-4cd5-b834-3421dad1c0c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:06:11.014280 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.014250    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcdef579-8743-4cd5-b834-3421dad1c0c1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dcdef579-8743-4cd5-b834-3421dad1c0c1" (UID: "dcdef579-8743-4cd5-b834-3421dad1c0c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:06:11.014377 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.014331    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcdef579-8743-4cd5-b834-3421dad1c0c1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dcdef579-8743-4cd5-b834-3421dad1c0c1" (UID: "dcdef579-8743-4cd5-b834-3421dad1c0c1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:06:11.014377 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.014335    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcdef579-8743-4cd5-b834-3421dad1c0c1-kube-api-access-467mg" (OuterVolumeSpecName: "kube-api-access-467mg") pod "dcdef579-8743-4cd5-b834-3421dad1c0c1" (UID: "dcdef579-8743-4cd5-b834-3421dad1c0c1"). InnerVolumeSpecName "kube-api-access-467mg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:06:11.086003 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.085976    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"
Sep 09 16:06:11.113343 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.113315    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-467mg\" (UniqueName: \"kubernetes.io/projected/dcdef579-8743-4cd5-b834-3421dad1c0c1-kube-api-access-467mg\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:06:11.113343 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.113342    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcdef579-8743-4cd5-b834-3421dad1c0c1-metrics-certs\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:06:11.113343 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.113362    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcdef579-8743-4cd5-b834-3421dad1c0c1-openshift-service-ca\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:06:11.113606 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.113371    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcdef579-8743-4cd5-b834-3421dad1c0c1-maas-api-tls\") on node \"ip-10-0-140-68.ec2.internal\" DevicePath \"\""
Sep 09 16:06:11.241077 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.240991    2574 generic.go:356] "Generic (PLEG): container finished" podID="dcdef579-8743-4cd5-b834-3421dad1c0c1" containerID="fd4eed38590d58992915c3503eccc49c14e4057eebd086c9fb098301a38c1631" exitCode=0
Sep 09 16:06:11.241077 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.241041    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"
Sep 09 16:06:11.241326 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.241041    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p" event={"ID":"dcdef579-8743-4cd5-b834-3421dad1c0c1","Type":"ContainerDied","Data":"fd4eed38590d58992915c3503eccc49c14e4057eebd086c9fb098301a38c1631"}
Sep 09 16:06:11.241326 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.241167    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p" event={"ID":"dcdef579-8743-4cd5-b834-3421dad1c0c1","Type":"ContainerDied","Data":"93d51c9582ab6e492e98f1cbb0ce0ee107e642c725d3e731d8b0e3d51ea191e9"}
Sep 09 16:06:11.241326 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.241200    2574 scope.go:117] "RemoveContainer" containerID="fd4eed38590d58992915c3503eccc49c14e4057eebd086c9fb098301a38c1631"
Sep 09 16:06:11.251458 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.251434    2574 scope.go:117] "RemoveContainer" containerID="fd4eed38590d58992915c3503eccc49c14e4057eebd086c9fb098301a38c1631"
Sep 09 16:06:11.251739 ip-10-0-140-68 kubenswrapper[2574]: E0909 16:06:11.251699    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd4eed38590d58992915c3503eccc49c14e4057eebd086c9fb098301a38c1631\": container with ID starting with fd4eed38590d58992915c3503eccc49c14e4057eebd086c9fb098301a38c1631 not found: ID does not exist" containerID="fd4eed38590d58992915c3503eccc49c14e4057eebd086c9fb098301a38c1631"
Sep 09 16:06:11.251828 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.251735    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4eed38590d58992915c3503eccc49c14e4057eebd086c9fb098301a38c1631"} err="failed to get container status \"fd4eed38590d58992915c3503eccc49c14e4057eebd086c9fb098301a38c1631\": rpc error: code = NotFound desc = could not find container \"fd4eed38590d58992915c3503eccc49c14e4057eebd086c9fb098301a38c1631\": container with ID starting with fd4eed38590d58992915c3503eccc49c14e4057eebd086c9fb098301a38c1631 not found: ID does not exist"
Sep 09 16:06:11.265248 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.265222    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"]
Sep 09 16:06:11.268552 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.268531    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d864d7888-rfm6p"]
Sep 09 16:06:11.359416 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:11.359395    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"]
Sep 09 16:06:11.361134 ip-10-0-140-68 kubenswrapper[2574]: W0909 16:06:11.361113    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d197ce2_27bd_40c0_9983_f979fbf8472d.slice/crio-b1dd836339d35a28f1abf6f6f45a4131af1a244041da91e2c4c51e9f4824198e WatchSource:0}: Error finding container b1dd836339d35a28f1abf6f6f45a4131af1a244041da91e2c4c51e9f4824198e: Status 404 returned error can't find the container with id b1dd836339d35a28f1abf6f6f45a4131af1a244041da91e2c4c51e9f4824198e
Sep 09 16:06:12.248909 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:12.248874    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr" event={"ID":"6d197ce2-27bd-40c0-9983-f979fbf8472d","Type":"ContainerStarted","Data":"b1dd836339d35a28f1abf6f6f45a4131af1a244041da91e2c4c51e9f4824198e"}
Sep 09 16:06:12.319687 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:12.319657    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcdef579-8743-4cd5-b834-3421dad1c0c1" path="/var/lib/kubelet/pods/dcdef579-8743-4cd5-b834-3421dad1c0c1/volumes"
Sep 09 16:06:13.260687 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:13.260648    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr" event={"ID":"6d197ce2-27bd-40c0-9983-f979fbf8472d","Type":"ContainerStarted","Data":"27ad76c48eeea9abf87c6e142f4e891680797c1d2a69eff58b2964c867e9551c"}
Sep 09 16:06:13.261199 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:13.260753    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"
Sep 09 16:06:13.279479 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:13.279393    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr" podStartSLOduration=1.620101575 podStartE2EDuration="3.279379507s" totalImagesPullingTime="1.659277932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:06:13.277576135 +0000 UTC m=+2757.467778885" watchObservedRunningTime="2026-09-09 16:06:13.279379507 +0000 UTC m=+2757.469582256"
Sep 09 16:06:16.886382 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:16.886349    2574 scope.go:117] "RemoveContainer" containerID="e15107637808bb2e05070795022ab4be572d512a5c6ebdd1a2c95f8640a3f421"
Sep 09 16:06:17.796781 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:17.796748    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:06:19.271858 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:19.271822    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8476d9f544-xl7xr"
Sep 09 16:06:23.691714 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:23.691675    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:06:30.501529 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:30.501497    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2ktvv"]
Sep 09 16:06:38.961024 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:38.960944    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-5tsw6_417d518b-8c18-4c1e-bf46-79ab0ef90c60/manager/0.log"
Sep 09 16:06:39.085540 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:39.085505    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qdzzn_95a7ba5d-3264-4ef3-be20-6f04e40c1cb0/manager/0.log"
Sep 09 16:06:39.587778 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:39.587755    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74fc54996-9d727_35240fa2-cbec-4735-a4f4-9b804ff6cfb6/copy-manifests/0.log"
Sep 09 16:06:39.600507 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:39.600486    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74fc54996-9d727_35240fa2-cbec-4735-a4f4-9b804ff6cfb6/manager/0.log"
Sep 09 16:06:40.313654 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:40.313627    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-8476d9f544-xl7xr_6d197ce2-27bd-40c0-9983-f979fbf8472d/maas-api/0.log"
Sep 09 16:06:41.600397 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:41.600367    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-xxxt6_b12236f1-640f-4e4b-ad58-f1323dd879dc/manager/0.log"
Sep 09 16:06:42.096400 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:42.096366    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-2ktvv_2b71acde-b02e-4f4a-8b00-8f533bfd74fc/limitador/0.log"
Sep 09 16:06:42.713210 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:42.713178    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sg26s_91090671-ce16-4d89-9f82-8076060899b9/discovery/0.log"
Sep 09 16:06:42.824515 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:42.824486    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59598c6787-jdwjg_764d1d35-45d5-4589-8432-9cd88a8ee39e/kube-auth-proxy/0.log"
Sep 09 16:06:43.403889 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:43.403862    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cbf75df6d-qr6fh_c070c187-ebec-4aed-a8dd-333df054bea6/router/0.log"
Sep 09 16:06:43.761261 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:43.761230    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-kzzcs_b4f7f288-6da2-4c49-9bf9-3285c0e0ae2a/main/0.log"
Sep 09 16:06:43.988201 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:43.988168    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-qwfgn_f7e33ed2-8c19-4561-8eaa-a31487be46ff/main/0.log"
Sep 09 16:06:44.220956 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:44.220923    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkg5wt_7b372f44-daac-4181-aa13-e3f4ffe381f6/main/0.log"
Sep 09 16:06:53.730903 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:53.730872    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nbw2j_0bf8b935-52c1-4166-996a-1e656c394bd9/global-pull-secret-syncer/0.log"
Sep 09 16:06:53.808045 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:53.808016    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t4dt5_6acefbe5-6ce3-4172-b5ba-d0e9c0937c54/konnectivity-agent/0.log"
Sep 09 16:06:53.904886 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:53.904861    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-68.ec2.internal_63872a04a76bb538711c93178fe3d471/haproxy/0.log"
Sep 09 16:06:58.095034 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:58.094999    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-xxxt6_b12236f1-640f-4e4b-ad58-f1323dd879dc/manager/0.log"
Sep 09 16:06:58.248960 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:06:58.248935    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-2ktvv_2b71acde-b02e-4f4a-8b00-8f533bfd74fc/limitador/0.log"
Sep 09 16:07:00.302468 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:00.302433    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-pvtjt_c95f93db-0c41-4c15-bcf2-81c504877015/kube-state-metrics/0.log"
Sep 09 16:07:00.322638 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:00.322613    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-pvtjt_c95f93db-0c41-4c15-bcf2-81c504877015/kube-rbac-proxy-main/0.log"
Sep 09 16:07:00.343467 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:00.343443    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-pvtjt_c95f93db-0c41-4c15-bcf2-81c504877015/kube-rbac-proxy-self/0.log"
Sep 09 16:07:00.386316 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:00.386297    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7bfc7d4f49-plnd8_aae52f1a-baea-4236-9a2b-83672d59dd82/metrics-server/0.log"
Sep 09 16:07:00.530905 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:00.530878    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c6kwc_248399ce-c6e1-4668-ba6e-01352cce1a47/node-exporter/0.log"
Sep 09 16:07:00.589828 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:00.589764    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c6kwc_248399ce-c6e1-4668-ba6e-01352cce1a47/kube-rbac-proxy/0.log"
Sep 09 16:07:00.664229 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:00.664208    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c6kwc_248399ce-c6e1-4668-ba6e-01352cce1a47/init-textfile/0.log"
Sep 09 16:07:00.778806 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:00.778781    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-89fpn_0b6a5f22-5f20-4874-920f-1dc4e9293d3a/kube-rbac-proxy-main/0.log"
Sep 09 16:07:00.802347 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:00.802326    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-89fpn_0b6a5f22-5f20-4874-920f-1dc4e9293d3a/kube-rbac-proxy-self/0.log"
Sep 09 16:07:00.826217 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:00.826196    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-89fpn_0b6a5f22-5f20-4874-920f-1dc4e9293d3a/openshift-state-metrics/0.log"
Sep 09 16:07:01.210885 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:01.210860    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59d8c5f7c-wpf72_c3a83b16-b17c-409e-85a9-4d5dd91bd70f/thanos-query/0.log"
Sep 09 16:07:01.231251 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:01.231225    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59d8c5f7c-wpf72_c3a83b16-b17c-409e-85a9-4d5dd91bd70f/kube-rbac-proxy-web/0.log"
Sep 09 16:07:01.251275 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:01.251254    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59d8c5f7c-wpf72_c3a83b16-b17c-409e-85a9-4d5dd91bd70f/kube-rbac-proxy/0.log"
Sep 09 16:07:01.271007 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:01.270980    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59d8c5f7c-wpf72_c3a83b16-b17c-409e-85a9-4d5dd91bd70f/prom-label-proxy/0.log"
Sep 09 16:07:01.292640 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:01.292620    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59d8c5f7c-wpf72_c3a83b16-b17c-409e-85a9-4d5dd91bd70f/kube-rbac-proxy-rules/0.log"
Sep 09 16:07:01.321894 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:01.321877    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59d8c5f7c-wpf72_c3a83b16-b17c-409e-85a9-4d5dd91bd70f/kube-rbac-proxy-metrics/0.log"
Sep 09 16:07:04.264231 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.264202    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85f94786df-d9gg7_a9c522b5-58e3-498d-9f0c-58c459ff6002/console/0.log"
Sep 09 16:07:04.511495 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.511456    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"]
Sep 09 16:07:04.512097 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.512065    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcdef579-8743-4cd5-b834-3421dad1c0c1" containerName="maas-api"
Sep 09 16:07:04.512097 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.512092    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcdef579-8743-4cd5-b834-3421dad1c0c1" containerName="maas-api"
Sep 09 16:07:04.512275 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.512190    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcdef579-8743-4cd5-b834-3421dad1c0c1" containerName="maas-api"
Sep 09 16:07:04.515244 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.515190    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:04.517811 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.517784    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kmsmj\"/\"kube-root-ca.crt\""
Sep 09 16:07:04.518819 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.518801    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kmsmj\"/\"openshift-service-ca.crt\""
Sep 09 16:07:04.518941 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.518808    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kmsmj\"/\"default-dockercfg-2c896\""
Sep 09 16:07:04.525931 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.525911    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"]
Sep 09 16:07:04.578173 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.578136    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9920068e-4e7a-4202-83c0-f0cdb18998b6-podres\") pod \"perf-node-gather-daemonset-nqgd9\" (UID: \"9920068e-4e7a-4202-83c0-f0cdb18998b6\") " pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:04.578354 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.578183    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9920068e-4e7a-4202-83c0-f0cdb18998b6-proc\") pod \"perf-node-gather-daemonset-nqgd9\" (UID: \"9920068e-4e7a-4202-83c0-f0cdb18998b6\") " pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:04.578354 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.578207    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l4gv\" (UniqueName: \"kubernetes.io/projected/9920068e-4e7a-4202-83c0-f0cdb18998b6-kube-api-access-5l4gv\") pod \"perf-node-gather-daemonset-nqgd9\" (UID: \"9920068e-4e7a-4202-83c0-f0cdb18998b6\") " pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:04.578354 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.578339    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9920068e-4e7a-4202-83c0-f0cdb18998b6-lib-modules\") pod \"perf-node-gather-daemonset-nqgd9\" (UID: \"9920068e-4e7a-4202-83c0-f0cdb18998b6\") " pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:04.578503 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.578401    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9920068e-4e7a-4202-83c0-f0cdb18998b6-sys\") pod \"perf-node-gather-daemonset-nqgd9\" (UID: \"9920068e-4e7a-4202-83c0-f0cdb18998b6\") " pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:04.679780 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.679736    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9920068e-4e7a-4202-83c0-f0cdb18998b6-sys\") pod \"perf-node-gather-daemonset-nqgd9\" (UID: \"9920068e-4e7a-4202-83c0-f0cdb18998b6\") " pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:04.679989 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.679796    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9920068e-4e7a-4202-83c0-f0cdb18998b6-podres\") pod \"perf-node-gather-daemonset-nqgd9\" (UID: \"9920068e-4e7a-4202-83c0-f0cdb18998b6\") " pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:04.679989 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.679855    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9920068e-4e7a-4202-83c0-f0cdb18998b6-proc\") pod \"perf-node-gather-daemonset-nqgd9\" (UID: \"9920068e-4e7a-4202-83c0-f0cdb18998b6\") " pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:04.679989 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.679884    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9920068e-4e7a-4202-83c0-f0cdb18998b6-sys\") pod \"perf-node-gather-daemonset-nqgd9\" (UID: \"9920068e-4e7a-4202-83c0-f0cdb18998b6\") " pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:04.679989 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.679885    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l4gv\" (UniqueName: \"kubernetes.io/projected/9920068e-4e7a-4202-83c0-f0cdb18998b6-kube-api-access-5l4gv\") pod \"perf-node-gather-daemonset-nqgd9\" (UID: \"9920068e-4e7a-4202-83c0-f0cdb18998b6\") " pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:04.679989 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.679969    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9920068e-4e7a-4202-83c0-f0cdb18998b6-proc\") pod \"perf-node-gather-daemonset-nqgd9\" (UID: \"9920068e-4e7a-4202-83c0-f0cdb18998b6\") " pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:04.679989 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.679981    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9920068e-4e7a-4202-83c0-f0cdb18998b6-podres\") pod \"perf-node-gather-daemonset-nqgd9\" (UID: \"9920068e-4e7a-4202-83c0-f0cdb18998b6\") " pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:04.680256 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.680040    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9920068e-4e7a-4202-83c0-f0cdb18998b6-lib-modules\") pod \"perf-node-gather-daemonset-nqgd9\" (UID: \"9920068e-4e7a-4202-83c0-f0cdb18998b6\") " pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:04.680256 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.680234    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9920068e-4e7a-4202-83c0-f0cdb18998b6-lib-modules\") pod \"perf-node-gather-daemonset-nqgd9\" (UID: \"9920068e-4e7a-4202-83c0-f0cdb18998b6\") " pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:04.687870 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.687828    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l4gv\" (UniqueName: \"kubernetes.io/projected/9920068e-4e7a-4202-83c0-f0cdb18998b6-kube-api-access-5l4gv\") pod \"perf-node-gather-daemonset-nqgd9\" (UID: \"9920068e-4e7a-4202-83c0-f0cdb18998b6\") " pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:04.825717 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:04.825638    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:05.085111 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:05.085038    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-84lnc_66a08337-e7c8-49a2-a47e-f4f78164e781/volume-data-source-validator/0.log"
Sep 09 16:07:05.096251 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:05.096224    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"]
Sep 09 16:07:05.097985 ip-10-0-140-68 kubenswrapper[2574]: W0909 16:07:05.097959    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9920068e_4e7a_4202_83c0_f0cdb18998b6.slice/crio-c5004ad77e6d1544c6bbd6410223581cc80fcc43cf55d57a474f59e42f64f822 WatchSource:0}: Error finding container c5004ad77e6d1544c6bbd6410223581cc80fcc43cf55d57a474f59e42f64f822: Status 404 returned error can't find the container with id c5004ad77e6d1544c6bbd6410223581cc80fcc43cf55d57a474f59e42f64f822
Sep 09 16:07:05.552231 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:05.552197    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9" event={"ID":"9920068e-4e7a-4202-83c0-f0cdb18998b6","Type":"ContainerStarted","Data":"71ea37df4b2a75dd45d9e97aaefd8f932d593ce21488d146a1f55fc02bc7bae8"}
Sep 09 16:07:05.552707 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:05.552245    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9" event={"ID":"9920068e-4e7a-4202-83c0-f0cdb18998b6","Type":"ContainerStarted","Data":"c5004ad77e6d1544c6bbd6410223581cc80fcc43cf55d57a474f59e42f64f822"}
Sep 09 16:07:05.552707 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:05.552331    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:05.568810 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:05.568763    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9" podStartSLOduration=1.56874934 podStartE2EDuration="1.56874934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:07:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:07:05.567731202 +0000 UTC m=+2809.757933943" watchObservedRunningTime="2026-09-09 16:07:05.56874934 +0000 UTC m=+2809.758952089"
Sep 09 16:07:06.382576 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:06.382549    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vktxv_a49acd86-0f4f-4da1-a9bc-c4cde626c7cd/dns/0.log"
Sep 09 16:07:06.402694 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:06.402656    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vktxv_a49acd86-0f4f-4da1-a9bc-c4cde626c7cd/kube-rbac-proxy/0.log"
Sep 09 16:07:06.426333 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:06.426309    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hvcjr_f944d3c3-de09-4122-9d8e-06c805dc429d/dns-node-resolver/0.log"
Sep 09 16:07:07.066853 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:07.066824    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qzwm8_75b69fbd-fc53-47f8-a9d6-d7627959fe2d/node-ca/0.log"
Sep 09 16:07:08.313598 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:08.313559    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sg26s_91090671-ce16-4d89-9f82-8076060899b9/discovery/0.log"
Sep 09 16:07:08.336240 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:08.336214    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59598c6787-jdwjg_764d1d35-45d5-4589-8432-9cd88a8ee39e/kube-auth-proxy/0.log"
Sep 09 16:07:08.478896 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:08.478859    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cbf75df6d-qr6fh_c070c187-ebec-4aed-a8dd-333df054bea6/router/0.log"
Sep 09 16:07:09.345407 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:09.345378    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5qktk_aef7e653-f35f-4cef-8e0a-42c2fd191106/serve-healthcheck-canary/0.log"
Sep 09 16:07:09.851618 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:09.851584    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-ztdgm_1ca22521-7db4-4b88-86b0-c2f39cc29d06/insights-operator/0.log"
Sep 09 16:07:09.852137 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:09.852115    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-ztdgm_1ca22521-7db4-4b88-86b0-c2f39cc29d06/insights-operator/1.log"
Sep 09 16:07:09.872758 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:09.872732    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dnlpg_50242e37-ff31-411e-889c-8e547eeac38c/kube-rbac-proxy/0.log"
Sep 09 16:07:09.894526 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:09.894507    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dnlpg_50242e37-ff31-411e-889c-8e547eeac38c/exporter/0.log"
Sep 09 16:07:09.915049 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:09.915032    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dnlpg_50242e37-ff31-411e-889c-8e547eeac38c/extractor/0.log"
Sep 09 16:07:11.568546 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:11.568512    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kmsmj/perf-node-gather-daemonset-nqgd9"
Sep 09 16:07:12.277369 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:12.277332    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-5tsw6_417d518b-8c18-4c1e-bf46-79ab0ef90c60/manager/0.log"
Sep 09 16:07:12.557629 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:12.557550    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qdzzn_95a7ba5d-3264-4ef3-be20-6f04e40c1cb0/manager/0.log"
Sep 09 16:07:12.820443 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:12.820357    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74fc54996-9d727_35240fa2-cbec-4735-a4f4-9b804ff6cfb6/manager/0.log"
Sep 09 16:07:12.836523 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:12.836503    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74fc54996-9d727_35240fa2-cbec-4735-a4f4-9b804ff6cfb6/copy-manifests/0.log"
Sep 09 16:07:15.108140 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:15.108111    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sg26s_91090671-ce16-4d89-9f82-8076060899b9/discovery/0.log"
Sep 09 16:07:15.120326 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:15.120299    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59598c6787-jdwjg_764d1d35-45d5-4589-8432-9cd88a8ee39e/kube-auth-proxy/0.log"
Sep 09 16:07:15.219827 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:15.219791    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cbf75df6d-qr6fh_c070c187-ebec-4aed-a8dd-333df054bea6/router/0.log"
Sep 09 16:07:17.127981 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:17.127947    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sg26s_91090671-ce16-4d89-9f82-8076060899b9/discovery/0.log"
Sep 09 16:07:17.143310 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:17.143284    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59598c6787-jdwjg_764d1d35-45d5-4589-8432-9cd88a8ee39e/kube-auth-proxy/0.log"
Sep 09 16:07:17.244678 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:17.244645    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cbf75df6d-qr6fh_c070c187-ebec-4aed-a8dd-333df054bea6/router/0.log"
Sep 09 16:07:20.026926 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:20.026894    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-kwpmk_a4a00a5e-1b35-450a-bc80-ec5836f1fdc2/kube-storage-version-migrator-operator/1.log"
Sep 09 16:07:20.027676 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:20.027657    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-kwpmk_a4a00a5e-1b35-450a-bc80-ec5836f1fdc2/kube-storage-version-migrator-operator/0.log"
Sep 09 16:07:21.302715 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:21.302688    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbvc2_dfc18078-e42b-4475-ae5a-719783979eed/kube-multus-additional-cni-plugins/0.log"
Sep 09 16:07:21.323982 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:21.323959    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbvc2_dfc18078-e42b-4475-ae5a-719783979eed/egress-router-binary-copy/0.log"
Sep 09 16:07:21.343584 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:21.343556    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbvc2_dfc18078-e42b-4475-ae5a-719783979eed/cni-plugins/0.log"
Sep 09 16:07:21.363315 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:21.363289    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbvc2_dfc18078-e42b-4475-ae5a-719783979eed/bond-cni-plugin/0.log"
Sep 09 16:07:21.382972 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:21.382951    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbvc2_dfc18078-e42b-4475-ae5a-719783979eed/routeoverride-cni/0.log"
Sep 09 16:07:21.403078 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:21.403056    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbvc2_dfc18078-e42b-4475-ae5a-719783979eed/whereabouts-cni-bincopy/0.log"
Sep 09 16:07:21.425573 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:21.425554    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbvc2_dfc18078-e42b-4475-ae5a-719783979eed/whereabouts-cni/0.log"
Sep 09 16:07:21.560271 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:21.560189    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vbx2d_8ded534f-da3e-47a3-b873-45b434a8d27f/kube-multus/0.log"
Sep 09 16:07:21.668878 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:21.668833    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zwx9l_bb11cdb7-08b9-46e4-9d53-eb8092841c48/network-metrics-daemon/0.log"
Sep 09 16:07:21.685058 ip-10-0-140-68 kubenswrapper[2574]: I0909 16:07:21.685034    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zwx9l_bb11cdb7-08b9-46e4-9d53-eb8092841c48/kube-rbac-proxy/0.log"