Sep 08 14:55:19.161823 ip-10-0-134-147 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 14:55:19.544185 ip-10-0-134-147 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 14:55:19.544185 ip-10-0-134-147 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 14:55:19.544185 ip-10-0-134-147 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 14:55:19.544185 ip-10-0-134-147 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 14:55:19.544185 ip-10-0-134-147 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 14:55:19.544882 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.544201    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 14:55:19.549395 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549378    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:55:19.549395 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549394    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:55:19.549395 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549398    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549401    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549404    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549407    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549410    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549412    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549416    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549419    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549422    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549424    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549427    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549430    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549432    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549435    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549438    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549442    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549446    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549449    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549453    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549455    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:55:19.549510 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549458    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549461    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549463    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549466    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549469    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549471    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549474    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549488    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549491    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549494    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549497    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549500    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549502    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549505    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549508    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549512    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549515    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549518    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549520    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549523    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:55:19.550013 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549526    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549529    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549531    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549534    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549537    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549539    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549542    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549544    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549547    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549550    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549552    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549562    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549566    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549569    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549571    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549574    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549576    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549579    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549582    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:55:19.550515 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549584    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549587    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549589    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549592    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549594    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549597    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549599    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549603    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549606    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549609    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549612    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549615    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549618    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549620    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549623    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549626    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549628    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549631    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549633    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549638    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:55:19.550999 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549642    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549644    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549648    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549650    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549653    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549655    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549658    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549660    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549662    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549665    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549667    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549670    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549672    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549675    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549678    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549680    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549683    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.549685    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551159    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551167    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:55:19.551475 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551170    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551173    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551176    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551179    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551183    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551186    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551188    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551190    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551193    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551196    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551198    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551201    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551203    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551206    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551210    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551214    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551218    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551221    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551224    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551227    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:55:19.552008 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551230    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551233    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551236    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551239    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551241    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551244    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551248    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551251    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551253    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551256    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551258    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551261    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551263    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551266    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551268    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551272    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551276    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551279    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551281    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:55:19.552514 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551284    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551287    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551289    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551292    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551294    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551297    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551299    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551303    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551305    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551310    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551313    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551316    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551318    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551321    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551324    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551326    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551329    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551331    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551334    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:55:19.553016 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551337    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551340    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551342    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551345    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551348    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551351    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551354    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551356    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551359    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551362    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551364    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551368    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551370    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551373    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551375    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551378    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551380    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551383    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551385    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551388    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:55:19.553503 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551391    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551393    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551395    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551398    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551400    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551403    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551405    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551408    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551411    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551413    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551415    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551418    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551421    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551423    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551426    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551428    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551431    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551433    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551436    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551825    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:55:19.553998 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551831    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551833    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551836    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551845    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551849    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551851    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551854    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551857    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551859    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551863    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551867    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551870    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551873    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551876    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551879    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551882    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551885    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551887    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551891    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:55:19.554491 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551895    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551898    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551901    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551903    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551906    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551908    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551910    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551913    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551916    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551918    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551921    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551923    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551927    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551929    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551932    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551936    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551939    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551942    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551945    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:55:19.554949 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551947    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551950    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551952    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551955    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551958    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551960    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551963    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551966    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551968    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551971    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551973    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551976    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551978    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551980    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551983    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551985    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551988    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551990    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551993    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551995    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:55:19.555415 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.551998    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552001    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552003    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552005    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552008    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552011    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552014    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552016    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552019    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552022    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552024    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552028    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552030    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552033    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552035    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552037    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552040    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552043    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552046    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552048    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:55:19.555911 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552051    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552053    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552056    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552058    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552061    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552063    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552066    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552068    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552071    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552073    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552076    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552078    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552081    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552083    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552085    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552088    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552090    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552093    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552095    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552097    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552184    2580 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 14:55:19.556385 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552229    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552236    2580 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552240    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552245    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552248    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552253    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552257    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552261    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552265    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552268    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552271    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552275    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552278    2580 flags.go:64] FLAG: --cgroup-root=""
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552281    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552284    2580 flags.go:64] FLAG: --client-ca-file=""
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552287    2580 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552290    2580 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552295    2580 flags.go:64] FLAG: --cluster-domain=""
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552297    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552300    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552303    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552307    2580 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552310    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 14:55:19.556981 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552313    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552316    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552319    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552322    2580 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552325    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552328    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552331    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552334    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552338    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552342    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552344    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552347    2580 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552350    2580 flags.go:64] FLAG: --enable-server="true"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552354    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552358    2580 flags.go:64] FLAG: --event-burst="100"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552361    2580 flags.go:64] FLAG: --event-qps="50"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552364    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552367    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552370    2580 flags.go:64] FLAG: --eviction-hard=""
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552374    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552377    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552379    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552382    2580 flags.go:64] FLAG: --eviction-soft=""
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552387    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552390    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 14:55:19.557557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552393    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552396    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552399    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552402    2580 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552405    2580 flags.go:64] FLAG: --feature-gates=""
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552408    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552411    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552414    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552417    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552420    2580 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552423    2580 flags.go:64] FLAG: --help="false"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552426    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-134-147.ec2.internal"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552429    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552432    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552435    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552438    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552442    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552445    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552448    2580 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552450    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552453    2580 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552457    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552460    2580 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552463    2580 flags.go:64] FLAG: --kube-reserved=""
Sep 08 14:55:19.558168 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552465    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552468    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552471    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552474    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552489    2580 flags.go:64] FLAG: --lock-file=""
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552493    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552497    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552500    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552506    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552509    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552512    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552515    2580 flags.go:64] FLAG: --logging-format="text"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552518    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552522    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552525    2580 flags.go:64] FLAG: --manifest-url=""
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552528    2580 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552532    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552535    2580 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552539    2580 flags.go:64] FLAG: --max-pods="110"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552542    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552545    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552547    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552550    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552553    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552556    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 14:55:19.558769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552559    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552566    2580 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552569    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552572    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552575    2580 flags.go:64] FLAG: --pod-cidr=""
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552578    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552584    2580 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552587    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552590    2580 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552593    2580 flags.go:64] FLAG: --port="10250"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552596    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552599    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c2f519857fe0217a"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552602    2580 flags.go:64] FLAG: --qos-reserved=""
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552607    2580 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552610    2580 flags.go:64] FLAG: --register-node="true"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552612    2580 flags.go:64] FLAG: --register-with-taints=""
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552616    2580 flags.go:64] FLAG: --registry-burst="10"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552619    2580 flags.go:64] FLAG: --registry-qps="5"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552622    2580 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552625    2580 flags.go:64] FLAG: --reserved-memory=""
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552628    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552631    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552634    2580 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552637    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552640    2580 flags.go:64] FLAG: --runonce="false"
Sep 08 14:55:19.559390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552643    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552646    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552649    2580 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552652    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552655    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552658    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552661    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552664    2580 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552667    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552670    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552673    2580 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552675    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552678    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552682    2580 flags.go:64] FLAG: --system-cgroups=""
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552687    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552692    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552695    2580 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552698    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552702    2580 flags.go:64] FLAG: --tls-min-version=""
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552706    2580 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552711    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552714    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552717    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552719    2580 flags.go:64] FLAG: --v="2"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552724    2580 flags.go:64] FLAG: --version="false"
Sep 08 14:55:19.560381 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552728    2580 flags.go:64] FLAG: --vmodule=""
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552731    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.552735    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552852    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552855    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552858    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552861    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552864    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552867    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552871    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552874    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552876    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552880    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552884    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552887    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552890    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552892    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552895    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552898    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:55:19.561447 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552901    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552903    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552907    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552910    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552913    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552916    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552918    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552921    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552925    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552927    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552929    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552932    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552935    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552937    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552940    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552943    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552945    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552948    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552951    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552953    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:55:19.562081 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552956    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552958    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552961    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552963    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552966    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552968    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552971    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552973    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552976    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552978    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552981    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552983    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552985    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552988    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552991    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552994    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.552997    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553000    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553002    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553005    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:55:19.562680 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553009    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553012    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553014    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553017    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553020    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553022    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553025    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553028    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553031    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553033    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553036    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553038    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553042    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553044    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553046    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553049    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553051    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553054    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553057    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553059    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:55:19.563632 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553062    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553064    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553067    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553069    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553072    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553074    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553078    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553080    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553083    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553086    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553088    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553091    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553094    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553097    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553099    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553102    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553104    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553108    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553112    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:55:19.564304 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553114    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:55:19.565009 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553117    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:55:19.565009 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553121    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:55:19.565009 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.553124    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:55:19.565009 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.553130    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 14:55:19.565009 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.561729    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 14:55:19.565009 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.561749    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 14:55:19.565009 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.562552    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 14:55:19.565009 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.562568    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 14:55:19.565009 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562680    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:55:19.565009 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562689    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:55:19.565009 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562694    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:55:19.565009 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562698    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:55:19.565009 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562703    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:55:19.565009 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562707    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562711    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562717    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562721    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562726    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562731    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562735    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562740    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562744    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562748    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562753    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562758    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562762    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562766    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562771    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562775    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562779    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562784    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562789    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562794    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:55:19.565613 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562798    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562803    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562807    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562811    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562818    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562822    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562827    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562831    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562838    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562844    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562849    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562854    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562859    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562863    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562867    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562872    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562878    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562884    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562888    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:55:19.566396 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562893    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562898    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562902    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562906    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562910    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562915    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562919    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562923    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562927    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562931    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562935    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562940    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562943    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562947    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562951    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562956    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562960    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562969    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562976    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:55:19.566986 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562981    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562985    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562990    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562995    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.562999    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563003    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563007    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563011    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563016    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563020    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563024    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563029    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563033    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563037    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563041    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563046    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563050    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563054    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563058    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563062    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:55:19.567508 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563067    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:55:19.568011 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563071    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:55:19.568011 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563075    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:55:19.568011 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563079    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:55:19.568011 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563083    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:55:19.568011 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563087    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:55:19.568011 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563091    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:55:19.568011 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563095    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:55:19.568011 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563099    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:55:19.568011 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563103    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:55:19.568011 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563109    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:55:19.568011 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563114    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:55:19.568011 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563119    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:55:19.568011 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563124    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:55:19.568011 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563128    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:55:19.568011 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563132    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:55:19.568407 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.563141    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 14:55:19.568407 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563326    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:55:19.568407 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563333    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:55:19.568407 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563338    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:55:19.568407 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563343    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:55:19.568407 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563347    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:55:19.568407 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563351    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:55:19.568407 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563356    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:55:19.568407 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563360    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:55:19.568407 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563364    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:55:19.568407 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563368    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:55:19.568407 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563372    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:55:19.568407 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563376    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:55:19.568407 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563380    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:55:19.568407 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563384    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563388    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563392    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563397    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563401    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563405    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563409    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563413    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563417    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563421    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563425    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563429    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563433    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563437    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563441    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563446    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563450    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563454    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563459    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563463    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:55:19.568807 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563467    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563471    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563474    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563498    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563503    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563507    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563511    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563515    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563519    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563523    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563528    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563532    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563536    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563540    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563544    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563549    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563553    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563559    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563563    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:55:19.569328 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563567    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563574    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563579    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563584    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563588    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563593    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563597    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563602    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563606    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563611    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563615    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563619    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563623    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563627    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563631    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563635    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563639    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563643    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563647    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:55:19.569809 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563651    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563655    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563659    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563663    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563667    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563671    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563676    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563680    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563687    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563693    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563697    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563702    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563707    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563711    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563716    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563721    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563725    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563729    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563733    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:55:19.570269 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563738    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:55:19.570769 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563745    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:55:19.570769 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563749    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:55:19.570769 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563753    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:55:19.570769 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563758    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:55:19.570769 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563763    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:55:19.570769 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563767    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:55:19.570769 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563772    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:55:19.570769 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:19.563776    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:55:19.570769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.563784    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 14:55:19.570769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.563947    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 14:55:19.570769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.568163    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 14:55:19.570769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.569006    2580 server.go:1019] "Starting client certificate rotation"
Sep 08 14:55:19.570769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.569098    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 14:55:19.570769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.569128    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 14:55:19.571400 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.571386    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 14:55:19.572522 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.572503    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 14:55:19.582125 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.582108    2580 log.go:25] "Validated CRI v1 runtime API"
Sep 08 14:55:19.587501 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.587464    2580 log.go:25] "Validated CRI v1 image API"
Sep 08 14:55:19.588289 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.588275    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 14:55:19.591244 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.591223    2580 fs.go:135] Filesystem UUIDs: map[2a2974dd-cc6a-4bc2-a0c9-bbca90aa5783:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a0c6735d-6833-4bc0-8536-927090e103a9:/dev/nvme0n1p3]
Sep 08 14:55:19.591329 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.591241    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 14:55:19.596516 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.596355    2580 manager.go:216] Machine: {Timestamp:2026-09-08 14:55:19.595043804 +0000 UTC m=+0.322311915 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2867769 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b4499e584cf5202df6b6342298a47 SystemUUID:ec2b4499-e584-cf52-02df-6b6342298a47 BootID:3568e506-5f19-4c01-9ac5-b959258fdd25 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d6:89:3b:15:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d6:89:3b:15:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:6f:53:ce:2a:5e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 14:55:19.596516 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.596503    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 14:55:19.596644 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.596591    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 14:55:19.598900 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.598883    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 14:55:19.599466 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.599437    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 14:55:19.599639 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.599490    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-147.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 14:55:19.600695 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.600683    2580 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 14:55:19.600730 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.600699    2580 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 14:55:19.600730 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.600707    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 14:55:19.601420 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.601410    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 14:55:19.602614 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.602604    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 14:55:19.606938 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.606925    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 14:55:19.607059 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.607050    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 14:55:19.607095 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.607086    2580 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 14:55:19.607125 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.607101    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 14:55:19.607125 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.607120    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 14:55:19.607186 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.607134    2580 kubelet.go:398] "Adding apiserver pod source"
Sep 08 14:55:19.607186 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.607147    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 14:55:19.607743 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.607728    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 14:55:19.607818 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.607748    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 14:55:19.611092 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.611070    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 14:55:19.613319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.613306    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 14:55:19.613367 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.613341    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 14:55:19.613516 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.613506    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 14:55:19.613562 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.613521    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 14:55:19.613562 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.613528    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 14:55:19.613562 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.613533    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 14:55:19.613562 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.613541    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 14:55:19.613562 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.613547    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 14:55:19.614064 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.614055    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 14:55:19.614064 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.614064    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 14:55:19.614124 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.614071    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 14:55:19.614124 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.614077    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 14:55:19.614124 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.614085    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 14:55:19.614124 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.614094    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 14:55:19.614845 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.614832    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 14:55:19.614893 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.614846    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 14:55:19.617773 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.617754    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-147.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 14:55:19.618701 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:19.618678    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-147.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 14:55:19.618764 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:19.618678    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 14:55:19.619062 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.619049    2580 server.go:1268] "Started kubelet"
Sep 08 14:55:19.619116 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.619090    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 14:55:19.619273 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.619198    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 14:55:19.619312 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.619302    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 14:55:19.619958 ip-10-0-134-147 systemd[1]: Started Kubernetes Kubelet.
Sep 08 14:55:19.620386 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.620370    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 14:55:19.621738 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.621714    2580 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 14:55:19.624310 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.624286    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vjgf7"
Sep 08 14:55:19.624601 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.624582    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 14:55:19.625092 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.625077    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 14:55:19.625248 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:19.625230    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 08 14:55:19.626030 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.626014    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 14:55:19.626126 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.626116    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 14:55:19.626265 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.626086    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 14:55:19.626363 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.626349    2580 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 14:55:19.626363 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.626358    2580 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 14:55:19.626593 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.626574    2580 factory.go:55] Registering systemd factory
Sep 08 14:55:19.626593 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.626592    2580 factory.go:223] Registration of the systemd container factory successfully
Sep 08 14:55:19.626861 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.626821    2580 factory.go:153] Registering CRI-O factory
Sep 08 14:55:19.626997 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.626862    2580 factory.go:223] Registration of the crio container factory successfully
Sep 08 14:55:19.627118 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.627103    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 14:55:19.627183 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.627130    2580 factory.go:103] Registering Raw factory
Sep 08 14:55:19.627183 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:19.626093    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-147.ec2.internal.18d3604367eea623  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-147.ec2.internal,UID:ip-10-0-134-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-147.ec2.internal,},FirstTimestamp:2026-09-08 14:55:19.618987555 +0000 UTC m=+0.346255667,LastTimestamp:2026-09-08 14:55:19.618987555 +0000 UTC m=+0.346255667,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-147.ec2.internal,}"
Sep 08 14:55:19.627183 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.627149    2580 manager.go:1196] Started watching for new ooms in manager
Sep 08 14:55:19.627658 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.627642    2580 manager.go:349] Starting recovery of all containers
Sep 08 14:55:19.627987 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:19.627966    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 14:55:19.632700 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.632661    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vjgf7"
Sep 08 14:55:19.633215 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:19.633185    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-147.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 14:55:19.633327 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:19.633306    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 14:55:19.637898 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.637706    2580 manager.go:354] Recovery completed
Sep 08 14:55:19.642845 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.642829    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:55:19.644733 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.644710    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:55:19.644797 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.644742    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:55:19.644797 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.644752    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:55:19.645314 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.645297    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 14:55:19.645314 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.645313    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 14:55:19.645452 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.645332    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 14:55:19.645452 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.645367    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:55:19.646135 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.646119    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:55:19.646218 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.646141    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:55:19.646218 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.646152    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:55:19.647415 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.647398    2580 policy_none.go:49] "None policy: Start"
Sep 08 14:55:19.647539 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.647418    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 14:55:19.647539 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.647431    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 14:55:19.649428 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.649417    2580 policy_none.go:47] "Start"
Sep 08 14:55:19.678211 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.678185    2580 manager.go:337] "Starting Device Plugin manager"
Sep 08 14:55:19.678409 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:19.678234    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 14:55:19.678409 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.678247    2580 server.go:87] "Starting device plugin registration server"
Sep 08 14:55:19.678699 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.678650    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 14:55:19.678699 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.678663    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 14:55:19.706734 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.679089    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 14:55:19.706734 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.679156    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 14:55:19.706734 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.679164    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 14:55:19.706734 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:19.679774    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 14:55:19.706734 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:19.679821    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 08 14:55:19.753494 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.753443    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 14:55:19.754714 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.754700    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 14:55:19.754789 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.754754    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 14:55:19.754789 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.754780    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 14:55:19.754898 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:19.754870    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 14:55:19.757461 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.757439    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:55:19.779371 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.779335    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:55:19.781725 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.781696    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:55:19.781835 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.781734    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:55:19.781835 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.781751    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:55:19.781835 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.781782    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-147.ec2.internal"
Sep 08 14:55:19.790158 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.790137    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-147.ec2.internal"
Sep 08 14:55:19.790207 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:19.790167    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-147.ec2.internal\": node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 08 14:55:19.806104 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:19.806017    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 08 14:55:19.855601 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.855567    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal"]
Sep 08 14:55:19.855706 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.855645    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:55:19.857112 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.857093    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:55:19.857191 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.857126    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:55:19.857191 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.857136    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:55:19.859460 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.859447    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:55:19.859586 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.859571    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 08 14:55:19.859634 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.859611    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:55:19.860249 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.860233    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:55:19.860322 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.860257    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:55:19.860322 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.860269    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:55:19.860322 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.860277    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:55:19.860322 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.860296    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:55:19.860322 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.860305    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:55:19.862539 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.862522    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal"
Sep 08 14:55:19.862614 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.862546    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:55:19.863370 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.863355    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:55:19.863370 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.863377    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:55:19.863498 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.863387    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:55:19.886333 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:19.886307    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-147.ec2.internal\" not found" node="ip-10-0-134-147.ec2.internal"
Sep 08 14:55:19.890627 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:19.890608    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-147.ec2.internal\" not found" node="ip-10-0-134-147.ec2.internal"
Sep 08 14:55:19.907150 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:19.907123    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 08 14:55:19.927919 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.927890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5ded91485376d888c05a9f15df44fd5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal\" (UID: \"b5ded91485376d888c05a9f15df44fd5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 08 14:55:19.927919 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.927921    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ded91485376d888c05a9f15df44fd5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal\" (UID: \"b5ded91485376d888c05a9f15df44fd5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 08 14:55:19.928057 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:19.927945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fe981aef88d6cd2cc7b16faaac99f73-config\") pod \"kube-apiserver-proxy-ip-10-0-134-147.ec2.internal\" (UID: \"1fe981aef88d6cd2cc7b16faaac99f73\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal"
Sep 08 14:55:20.007731 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:20.007702    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 08 14:55:20.028368 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:20.028339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5ded91485376d888c05a9f15df44fd5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal\" (UID: \"b5ded91485376d888c05a9f15df44fd5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 08 14:55:20.028446 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:20.028375    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ded91485376d888c05a9f15df44fd5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal\" (UID: \"b5ded91485376d888c05a9f15df44fd5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 08 14:55:20.028446 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:20.028390    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fe981aef88d6cd2cc7b16faaac99f73-config\") pod \"kube-apiserver-proxy-ip-10-0-134-147.ec2.internal\" (UID: \"1fe981aef88d6cd2cc7b16faaac99f73\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal"
Sep 08 14:55:20.028446 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:20.028443    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ded91485376d888c05a9f15df44fd5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal\" (UID: \"b5ded91485376d888c05a9f15df44fd5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 08 14:55:20.028590 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:20.028452    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5ded91485376d888c05a9f15df44fd5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal\" (UID: \"b5ded91485376d888c05a9f15df44fd5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 08 14:55:20.028590 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:20.028505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fe981aef88d6cd2cc7b16faaac99f73-config\") pod \"kube-apiserver-proxy-ip-10-0-134-147.ec2.internal\" (UID: \"1fe981aef88d6cd2cc7b16faaac99f73\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal"
Sep 08 14:55:20.108751 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:20.108678    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 08 14:55:20.189235 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:20.189201    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 08 14:55:20.193030 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:20.193009    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal"
Sep 08 14:55:20.209777 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:20.209743    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 08 14:55:21.705372 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:21.705324    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 08 14:55:21.805933 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:21.805862    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 08 14:55:21.906429 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:21.906398    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 08 14:55:21.963959 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:21.963925    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 14:55:21.964434 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:21.964108    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 14:55:22.007428 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:22.007402    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 08 14:55:22.031497 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:22.031455    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 14:50:21 +0000 UTC" deadline="2028-05-07 16:46:50.318302912 +0000 UTC"
Sep 08 14:55:22.031497 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:22.031486    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14569h51m28.286820314s"
Sep 08 14:55:22.108392 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:22.108319    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 08 14:55:22.195146 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:22.195128    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:55:22.209152 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:22.209129    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 08 14:55:22.232829 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:22.232806    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:55:22.309791 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:22.309751    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 08 14:55:22.345639 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:22.345613    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:55:22.410349 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:22.410262    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 08 14:55:22.436560 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:22.436538    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:55:22.521125 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:22.521088    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 08 14:55:22.538369 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:22.538349    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 14:55:22.539403 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:22.539389    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal"
Sep 08 14:55:22.549323 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:22.549304    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 14:55:23.003574 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.003540    2580 apiserver.go:52] "Watching apiserver"
Sep 08 14:55:23.016573 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.016536    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 14:55:23.017982 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.017947    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hjhs7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789","openshift-multus/multus-additional-cni-plugins-zp8vb","openshift-multus/network-metrics-daemon-6w52g","openshift-network-operator/iptables-alerter-wqkxw","openshift-ovn-kubernetes/ovnkube-node-8c5lk","kube-system/konnectivity-agent-sl7g8","kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal","openshift-cluster-node-tuning-operator/tuned-86pv2","openshift-dns/node-resolver-qngmr","openshift-image-registry/node-ca-b64k8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal","openshift-multus/multus-k7kj5","openshift-network-diagnostics/network-check-target-fjm4v"]
Sep 08 14:55:23.020434 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.020410    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sl7g8"
Sep 08 14:55:23.020694 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.020561    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 14:55:23.022761 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.022699    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 14:55:23.022761 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.022752    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.022905 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.022777    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cp9q7\""
Sep 08 14:55:23.022905 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.022703    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 14:55:23.024716 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.024695    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 14:55:23.024994 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.024976    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.025189 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.025170    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 14:55:23.025278 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.025198    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rbfbn\""
Sep 08 14:55:23.025389 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.025372    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 14:55:23.025441 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.025414    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 14:55:23.027161 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.027142    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:23.027283 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.027212    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:23.027351 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.027305    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 14:55:23.027351 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.027332    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 14:55:23.027465 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.027366    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rr2gz\""
Sep 08 14:55:23.029316 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.029298    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wqkxw"
Sep 08 14:55:23.031650 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.031629    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 14:55:23.031748 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.031698    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:55:23.031811 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.031629    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cjnkr\""
Sep 08 14:55:23.031898 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.031879    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 14:55:23.032052 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032034    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.032112 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032078    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 14:55:23.032632 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032608    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-var-lib-cni-bin\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.032738 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-var-lib-kubelet\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.032738 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-multus-daemon-config\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.032738 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032695    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcxlc\" (UniqueName: \"kubernetes.io/projected/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-kube-api-access-vcxlc\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.032738 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032721    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-var-lib-cni-multus\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.032983 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-multus-conf-dir\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.032983 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032768    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-system-cni-dir\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.032983 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032803    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-cni-binary-copy\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.032983 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-hostroot\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.032983 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-run-multus-certs\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.032983 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032866    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-etc-kubernetes\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.032983 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8fa1793-9a61-454c-9e42-7a3374e3c0fb-agent-certs\") pod \"konnectivity-agent-sl7g8\" (UID: \"b8fa1793-9a61-454c-9e42-7a3374e3c0fb\") " pod="kube-system/konnectivity-agent-sl7g8"
Sep 08 14:55:23.032983 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032910    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8fa1793-9a61-454c-9e42-7a3374e3c0fb-konnectivity-ca\") pod \"konnectivity-agent-sl7g8\" (UID: \"b8fa1793-9a61-454c-9e42-7a3374e3c0fb\") " pod="kube-system/konnectivity-agent-sl7g8"
Sep 08 14:55:23.032983 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032941    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-multus-cni-dir\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.032983 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.032978    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-cnibin\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.033332 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.033007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-multus-socket-dir-parent\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.033332 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.033030    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-run-k8s-cni-cncf-io\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.033332 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.033079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-run-netns\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.034111 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.034080    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.035397 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.035380    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 14:55:23.035488 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.035463    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 14:55:23.035488 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.035472    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2s8xj\""
Sep 08 14:55:23.035615 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.035589    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 14:55:23.035741 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.035714    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 14:55:23.035813 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.035777    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 14:55:23.035881 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.035857    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 14:55:23.036453 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.036319    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:23.036453 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.036361    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 14:55:23.036453 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.036380    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:23.036453 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.036433    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2rs6k\""
Sep 08 14:55:23.036674 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.036365    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:55:23.038731 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.038714    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.040690 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.040673    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 14:55:23.040936 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.040901    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 14:55:23.041040 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.040955    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 14:55:23.041114 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.041096    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wv8vg\""
Sep 08 14:55:23.041174 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.041124    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qngmr"
Sep 08 14:55:23.043357 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.043335    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xp7gz\""
Sep 08 14:55:23.043706 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.043688    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 14:55:23.043962 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.043947    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 14:55:23.044281 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.044264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b64k8"
Sep 08 14:55:23.046450 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.046432    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:23.046610 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.046499    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:23.046710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.046691    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 14:55:23.046821 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.046707    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 14:55:23.046821 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.046714    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 14:55:23.046948 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.046727    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lxfsf\""
Sep 08 14:55:23.064025 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.064008    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n4pj7"
Sep 08 14:55:23.072121 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.072100    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n4pj7"
Sep 08 14:55:23.122961 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.122927    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 14:55:23.133371 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133337    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsrvj\" (UniqueName: \"kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj\") pod \"network-check-target-fjm4v\" (UID: \"d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6\") " pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:23.133551 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-run-multus-certs\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.133551 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133406    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44mlh\" (UniqueName: \"kubernetes.io/projected/b4afab8c-02d7-4bf5-b246-80ee643292f0-kube-api-access-44mlh\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.133551 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-var-lib-kubelet\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.133551 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhw6d\" (UniqueName: \"kubernetes.io/projected/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-kube-api-access-vhw6d\") pod \"network-metrics-daemon-6w52g\" (UID: \"95e20c4e-8cd2-4ac0-9364-1065c6c8a10b\") " pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:23.133551 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133496    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-run-multus-certs\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.133551 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8fa1793-9a61-454c-9e42-7a3374e3c0fb-agent-certs\") pod \"konnectivity-agent-sl7g8\" (UID: \"b8fa1793-9a61-454c-9e42-7a3374e3c0fb\") " pod="kube-system/konnectivity-agent-sl7g8"
Sep 08 14:55:23.133852 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133568    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-etc-openvswitch\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.133852 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133606    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-ovn-node-metrics-cert\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.133852 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133630    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-ovnkube-script-lib\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.133852 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2fdk\" (UniqueName: \"kubernetes.io/projected/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-kube-api-access-t2fdk\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.133852 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133668    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-sysctl-d\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.133852 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133682    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-run\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.133852 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-socket-dir\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.133852 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-multus-socket-dir-parent\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.133852 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-run-k8s-cni-cncf-io\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.133852 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-var-lib-cni-bin\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-tmp\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133866    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-run-k8s-cni-cncf-io\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133888    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-multus-socket-dir-parent\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133901    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-var-lib-cni-bin\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-var-lib-cni-multus\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4afab8c-02d7-4bf5-b246-80ee643292f0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8fa8fbd-736e-4bf2-a7c7-d9db65334a61-host\") pod \"node-ca-b64k8\" (UID: \"a8fa8fbd-736e-4bf2-a7c7-d9db65334a61\") " pod="openshift-image-registry/node-ca-b64k8"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133978    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8859fc32-64fd-484f-97e3-6256a530f2ee-iptables-alerter-script\") pod \"iptables-alerter-wqkxw\" (UID: \"8859fc32-64fd-484f-97e3-6256a530f2ee\") " pod="openshift-network-operator/iptables-alerter-wqkxw"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.133993    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-var-lib-cni-multus\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134003    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbp9x\" (UniqueName: \"kubernetes.io/projected/8859fc32-64fd-484f-97e3-6256a530f2ee-kube-api-access-xbp9x\") pod \"iptables-alerter-wqkxw\" (UID: \"8859fc32-64fd-484f-97e3-6256a530f2ee\") " pod="openshift-network-operator/iptables-alerter-wqkxw"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-cni-binary-copy\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134068    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-hostroot\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134096    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-hostroot\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8fa1793-9a61-454c-9e42-7a3374e3c0fb-konnectivity-ca\") pod \"konnectivity-agent-sl7g8\" (UID: \"b8fa1793-9a61-454c-9e42-7a3374e3c0fb\") " pod="kube-system/konnectivity-agent-sl7g8"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-sysconfig\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-host\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.134319 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-etc-selinux\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134237    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret\") pod \"global-pull-secret-syncer-hjhs7\" (UID: \"cc66186e-7479-4d5f-8e81-fa0d49a60ef1\") " pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134263    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4afab8c-02d7-4bf5-b246-80ee643292f0-cni-binary-copy\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134264    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-multus-daemon-config\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-kubelet\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134339    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-cni-netd\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134411    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-multus-conf-dir\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134442    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b4afab8c-02d7-4bf5-b246-80ee643292f0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134457    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-multus-conf-dir\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134501    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-node-log\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-lib-modules\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134588    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzjvv\" (UniqueName: \"kubernetes.io/projected/a8fa8fbd-736e-4bf2-a7c7-d9db65334a61-kube-api-access-vzjvv\") pod \"node-ca-b64k8\" (UID: \"a8fa8fbd-736e-4bf2-a7c7-d9db65334a61\") " pod="openshift-image-registry/node-ca-b64k8"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-system-cni-dir\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8fa1793-9a61-454c-9e42-7a3374e3c0fb-konnectivity-ca\") pod \"konnectivity-agent-sl7g8\" (UID: \"b8fa1793-9a61-454c-9e42-7a3374e3c0fb\") " pod="kube-system/konnectivity-agent-sl7g8"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134638    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-systemd-units\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.135029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134681    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-var-lib-openvswitch\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134707    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-run-ovn\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134729    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-kubernetes\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134746    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-system-cni-dir\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134754    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8fa8fbd-736e-4bf2-a7c7-d9db65334a61-serviceca\") pod \"node-ca-b64k8\" (UID: \"a8fa8fbd-736e-4bf2-a7c7-d9db65334a61\") " pod="openshift-image-registry/node-ca-b64k8"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-kubelet-config\") pod \"global-pull-secret-syncer-hjhs7\" (UID: \"cc66186e-7479-4d5f-8e81-fa0d49a60ef1\") " pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-dbus\") pod \"global-pull-secret-syncer-hjhs7\" (UID: \"cc66186e-7479-4d5f-8e81-fa0d49a60ef1\") " pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134816    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-multus-daemon-config\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-cnibin\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-run-systemd\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134889    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-log-socket\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134916    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06b64b48-3059-46f5-bbb9-c29ba4697270-tmp-dir\") pod \"node-resolver-qngmr\" (UID: \"06b64b48-3059-46f5-bbb9-c29ba4697270\") " pod="openshift-dns/node-resolver-qngmr"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134939    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-ovnkube-config\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134963    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-env-overrides\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.134996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vjb7\" (UniqueName: \"kubernetes.io/projected/06b64b48-3059-46f5-bbb9-c29ba4697270-kube-api-access-4vjb7\") pod \"node-resolver-qngmr\" (UID: \"06b64b48-3059-46f5-bbb9-c29ba4697270\") " pod="openshift-dns/node-resolver-qngmr"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135000    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-cnibin\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135023    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4afab8c-02d7-4bf5-b246-80ee643292f0-system-cni-dir\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.135767 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135062    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-modprobe-d\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-sys-fs\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135108    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-cni-binary-copy\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06b64b48-3059-46f5-bbb9-c29ba4697270-hosts-file\") pod \"node-resolver-qngmr\" (UID: \"06b64b48-3059-46f5-bbb9-c29ba4697270\") " pod="openshift-dns/node-resolver-qngmr"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135170    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-etc-kubernetes\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-run-netns\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135231    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-etc-kubernetes\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135237    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-kubelet-dir\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135281    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs\") pod \"network-metrics-daemon-6w52g\" (UID: \"95e20c4e-8cd2-4ac0-9364-1065c6c8a10b\") " pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-multus-cni-dir\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135350    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-slash\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135356    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-multus-cni-dir\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135377    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-systemd\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ppzz\" (UniqueName: \"kubernetes.io/projected/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-kube-api-access-2ppzz\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135444    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-registration-dir\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8859fc32-64fd-484f-97e3-6256a530f2ee-host-slash\") pod \"iptables-alerter-wqkxw\" (UID: \"8859fc32-64fd-484f-97e3-6256a530f2ee\") " pod="openshift-network-operator/iptables-alerter-wqkxw"
Sep 08 14:55:23.136468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135522    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b4afab8c-02d7-4bf5-b246-80ee643292f0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.137130 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-run-netns\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.137130 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135579    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-var-lib-kubelet\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.137130 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135624    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcxlc\" (UniqueName: \"kubernetes.io/projected/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-kube-api-access-vcxlc\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.137130 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135631    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-var-lib-kubelet\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.137130 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135647    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-host-run-netns\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.137130 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135696    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-cni-bin\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.137130 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135819    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-tuned\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.137130 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135857    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-device-dir\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.137130 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135910    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-sys\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.137130 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135947    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4afab8c-02d7-4bf5-b246-80ee643292f0-cnibin\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.137130 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-run-openvswitch\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.137130 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.135995    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-sysctl-conf\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.137130 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.136016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkjd8\" (UniqueName: \"kubernetes.io/projected/7a6bfdbc-f49b-4c50-9116-a37de6a21402-kube-api-access-pkjd8\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.138354 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.138332    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8fa1793-9a61-454c-9e42-7a3374e3c0fb-agent-certs\") pod \"konnectivity-agent-sl7g8\" (UID: \"b8fa1793-9a61-454c-9e42-7a3374e3c0fb\") " pod="kube-system/konnectivity-agent-sl7g8"
Sep 08 14:55:23.143843 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.143797    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcxlc\" (UniqueName: \"kubernetes.io/projected/ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae-kube-api-access-vcxlc\") pod \"multus-k7kj5\" (UID: \"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae\") " pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.154790 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.154751    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal" event={"ID":"b5ded91485376d888c05a9f15df44fd5","Type":"ContainerStarted","Data":"c7bebb5793fa7a3dc04506c9b0ca1501a5d164e9ec2d0fcb6c44a790e345b064"}
Sep 08 14:55:23.206397 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.206365    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:55:23.237185 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b4afab8c-02d7-4bf5-b246-80ee643292f0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.237185 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-cni-bin\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.237425 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-tuned\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.237425 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237239    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-device-dir\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.237425 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237261    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-sys\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.237425 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4afab8c-02d7-4bf5-b246-80ee643292f0-cnibin\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.237425 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237305    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-run-openvswitch\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.237425 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237325    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-sysctl-conf\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.237425 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237330    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-device-dir\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.237425 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237278    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-cni-bin\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.237425 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237371    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4afab8c-02d7-4bf5-b246-80ee643292f0-cnibin\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.237425 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237409    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkjd8\" (UniqueName: \"kubernetes.io/projected/7a6bfdbc-f49b-4c50-9116-a37de6a21402-kube-api-access-pkjd8\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.237425 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237414    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-sys\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.237425 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsrvj\" (UniqueName: \"kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj\") pod \"network-check-target-fjm4v\" (UID: \"d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6\") " pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237414    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-run-openvswitch\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44mlh\" (UniqueName: \"kubernetes.io/projected/b4afab8c-02d7-4bf5-b246-80ee643292f0-kube-api-access-44mlh\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-var-lib-kubelet\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237544    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhw6d\" (UniqueName: \"kubernetes.io/projected/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-kube-api-access-vhw6d\") pod \"network-metrics-daemon-6w52g\" (UID: \"95e20c4e-8cd2-4ac0-9364-1065c6c8a10b\") " pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-etc-openvswitch\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-ovn-node-metrics-cert\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237609    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-var-lib-kubelet\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237473    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-sysctl-conf\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-ovnkube-script-lib\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237655    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-etc-openvswitch\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237693    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2fdk\" (UniqueName: \"kubernetes.io/projected/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-kube-api-access-t2fdk\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-sysctl-d\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-run\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-socket-dir\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237793    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-tmp\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4afab8c-02d7-4bf5-b246-80ee643292f0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.237968 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8fa8fbd-736e-4bf2-a7c7-d9db65334a61-host\") pod \"node-ca-b64k8\" (UID: \"a8fa8fbd-736e-4bf2-a7c7-d9db65334a61\") " pod="openshift-image-registry/node-ca-b64k8"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8859fc32-64fd-484f-97e3-6256a530f2ee-iptables-alerter-script\") pod \"iptables-alerter-wqkxw\" (UID: \"8859fc32-64fd-484f-97e3-6256a530f2ee\") " pod="openshift-network-operator/iptables-alerter-wqkxw"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237882    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbp9x\" (UniqueName: \"kubernetes.io/projected/8859fc32-64fd-484f-97e3-6256a530f2ee-kube-api-access-xbp9x\") pod \"iptables-alerter-wqkxw\" (UID: \"8859fc32-64fd-484f-97e3-6256a530f2ee\") " pod="openshift-network-operator/iptables-alerter-wqkxw"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237891    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-sysctl-d\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-sysconfig\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237935    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-host\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237947    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-run\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237960    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-etc-selinux\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237950    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-sysconfig\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237978    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8fa8fbd-736e-4bf2-a7c7-d9db65334a61-host\") pod \"node-ca-b64k8\" (UID: \"a8fa8fbd-736e-4bf2-a7c7-d9db65334a61\") " pod="openshift-image-registry/node-ca-b64k8"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.237986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret\") pod \"global-pull-secret-syncer-hjhs7\" (UID: \"cc66186e-7479-4d5f-8e81-fa0d49a60ef1\") " pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238012    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4afab8c-02d7-4bf5-b246-80ee643292f0-cni-binary-copy\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238039    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-kubelet\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-cni-netd\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238086    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-socket-dir\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b4afab8c-02d7-4bf5-b246-80ee643292f0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.238710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238143    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-node-log\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238153    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b4afab8c-02d7-4bf5-b246-80ee643292f0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238166    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-lib-modules\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238204    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzjvv\" (UniqueName: \"kubernetes.io/projected/a8fa8fbd-736e-4bf2-a7c7-d9db65334a61-kube-api-access-vzjvv\") pod \"node-ca-b64k8\" (UID: \"a8fa8fbd-736e-4bf2-a7c7-d9db65334a61\") " pod="openshift-image-registry/node-ca-b64k8"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238234    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-systemd-units\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-lib-modules\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-var-lib-openvswitch\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238291    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-var-lib-openvswitch\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-run-ovn\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-kubernetes\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8fa8fbd-736e-4bf2-a7c7-d9db65334a61-serviceca\") pod \"node-ca-b64k8\" (UID: \"a8fa8fbd-736e-4bf2-a7c7-d9db65334a61\") " pod="openshift-image-registry/node-ca-b64k8"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238397    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-ovnkube-script-lib\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238430    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-systemd-units\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238451    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-kubelet-config\") pod \"global-pull-secret-syncer-hjhs7\" (UID: \"cc66186e-7479-4d5f-8e81-fa0d49a60ef1\") " pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-kubelet-config\") pod \"global-pull-secret-syncer-hjhs7\" (UID: \"cc66186e-7479-4d5f-8e81-fa0d49a60ef1\") " pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-dbus\") pod \"global-pull-secret-syncer-hjhs7\" (UID: \"cc66186e-7479-4d5f-8e81-fa0d49a60ef1\") " pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238530    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-run-systemd\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.238545    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:23.239545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238549    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4afab8c-02d7-4bf5-b246-80ee643292f0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-log-socket\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06b64b48-3059-46f5-bbb9-c29ba4697270-tmp-dir\") pod \"node-resolver-qngmr\" (UID: \"06b64b48-3059-46f5-bbb9-c29ba4697270\") " pod="openshift-dns/node-resolver-qngmr"
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238627    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-log-socket\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.238637    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret podName:cc66186e-7479-4d5f-8e81-fa0d49a60ef1 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:23.738600506 +0000 UTC m=+3.070840050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret") pod "global-pull-secret-syncer-hjhs7" (UID: "cc66186e-7479-4d5f-8e81-fa0d49a60ef1") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238657    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8859fc32-64fd-484f-97e3-6256a530f2ee-iptables-alerter-script\") pod \"iptables-alerter-wqkxw\" (UID: \"8859fc32-64fd-484f-97e3-6256a530f2ee\") " pod="openshift-network-operator/iptables-alerter-wqkxw"
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-host\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238718    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238813    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-etc-selinux\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238866    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06b64b48-3059-46f5-bbb9-c29ba4697270-tmp-dir\") pod \"node-resolver-qngmr\" (UID: \"06b64b48-3059-46f5-bbb9-c29ba4697270\") " pod="openshift-dns/node-resolver-qngmr"
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-ovnkube-config\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238894    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-kubelet\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-env-overrides\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238946    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4afab8c-02d7-4bf5-b246-80ee643292f0-cni-binary-copy\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238969    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vjb7\" (UniqueName: \"kubernetes.io/projected/06b64b48-3059-46f5-bbb9-c29ba4697270-kube-api-access-4vjb7\") pod \"node-resolver-qngmr\" (UID: \"06b64b48-3059-46f5-bbb9-c29ba4697270\") " pod="openshift-dns/node-resolver-qngmr"
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238977    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-cni-netd\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-node-log\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.240341 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.238997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4afab8c-02d7-4bf5-b246-80ee643292f0-system-cni-dir\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-kubernetes\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239033    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4afab8c-02d7-4bf5-b246-80ee643292f0-system-cni-dir\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-modprobe-d\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239126    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-sys-fs\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239156    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06b64b48-3059-46f5-bbb9-c29ba4697270-hosts-file\") pod \"node-resolver-qngmr\" (UID: \"06b64b48-3059-46f5-bbb9-c29ba4697270\") " pod="openshift-dns/node-resolver-qngmr"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-run-netns\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239258    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-kubelet-dir\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs\") pod \"network-metrics-daemon-6w52g\" (UID: \"95e20c4e-8cd2-4ac0-9364-1065c6c8a10b\") " pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239375    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-env-overrides\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.239400    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239443    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-kubelet-dir\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239481    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-run-ovn\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239539    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-sys-fs\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239560    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8fa8fbd-736e-4bf2-a7c7-d9db65334a61-serviceca\") pod \"node-ca-b64k8\" (UID: \"a8fa8fbd-736e-4bf2-a7c7-d9db65334a61\") " pod="openshift-image-registry/node-ca-b64k8"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b4afab8c-02d7-4bf5-b246-80ee643292f0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-run-netns\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.240957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239604    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-run-systemd\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239633    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.239644    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs podName:95e20c4e-8cd2-4ac0-9364-1065c6c8a10b nodeName:}" failed. No retries permitted until 2026-09-08 14:55:23.739627496 +0000 UTC m=+3.071867020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs") pod "network-metrics-daemon-6w52g" (UID: "95e20c4e-8cd2-4ac0-9364-1065c6c8a10b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-slash\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239683    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06b64b48-3059-46f5-bbb9-c29ba4697270-hosts-file\") pod \"node-resolver-qngmr\" (UID: \"06b64b48-3059-46f5-bbb9-c29ba4697270\") " pod="openshift-dns/node-resolver-qngmr"
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-systemd\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239704    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-modprobe-d\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239733    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-host-slash\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239746    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-dbus\") pod \"global-pull-secret-syncer-hjhs7\" (UID: \"cc66186e-7479-4d5f-8e81-fa0d49a60ef1\") " pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ppzz\" (UniqueName: \"kubernetes.io/projected/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-kube-api-access-2ppzz\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239832    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-registration-dir\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239837    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-systemd\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239859    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8859fc32-64fd-484f-97e3-6256a530f2ee-host-slash\") pod \"iptables-alerter-wqkxw\" (UID: \"8859fc32-64fd-484f-97e3-6256a530f2ee\") " pod="openshift-network-operator/iptables-alerter-wqkxw"
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-ovnkube-config\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239877    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a6bfdbc-f49b-4c50-9116-a37de6a21402-registration-dir\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.239959    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8859fc32-64fd-484f-97e3-6256a530f2ee-host-slash\") pod \"iptables-alerter-wqkxw\" (UID: \"8859fc32-64fd-484f-97e3-6256a530f2ee\") " pod="openshift-network-operator/iptables-alerter-wqkxw"
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.240492    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-etc-tuned\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.241445 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.240530    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-ovn-node-metrics-cert\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.241923 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.241118    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-tmp\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.245607 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.245584    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:55:23.245688 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.245612    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:55:23.245688 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.245627    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vsrvj for pod openshift-network-diagnostics/network-check-target-fjm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:23.245775 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.245705    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj podName:d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:23.745690838 +0000 UTC m=+3.077930363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vsrvj" (UniqueName: "kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj") pod "network-check-target-fjm4v" (UID: "d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:23.247712 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.247683    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2fdk\" (UniqueName: \"kubernetes.io/projected/3f7f485e-e925-44c2-83b5-5ab147b6a6b8-kube-api-access-t2fdk\") pod \"ovnkube-node-8c5lk\" (UID: \"3f7f485e-e925-44c2-83b5-5ab147b6a6b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.250816 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.250775    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkjd8\" (UniqueName: \"kubernetes.io/projected/7a6bfdbc-f49b-4c50-9116-a37de6a21402-kube-api-access-pkjd8\") pod \"aws-ebs-csi-driver-node-74789\" (UID: \"7a6bfdbc-f49b-4c50-9116-a37de6a21402\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.251276 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.251252    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbp9x\" (UniqueName: \"kubernetes.io/projected/8859fc32-64fd-484f-97e3-6256a530f2ee-kube-api-access-xbp9x\") pod \"iptables-alerter-wqkxw\" (UID: \"8859fc32-64fd-484f-97e3-6256a530f2ee\") " pod="openshift-network-operator/iptables-alerter-wqkxw"
Sep 08 14:55:23.251369 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.251287    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ppzz\" (UniqueName: \"kubernetes.io/projected/b0d7ae31-4c06-47a1-8816-57fad4c6b67b-kube-api-access-2ppzz\") pod \"tuned-86pv2\" (UID: \"b0d7ae31-4c06-47a1-8816-57fad4c6b67b\") " pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.251441 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.251371    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vjb7\" (UniqueName: \"kubernetes.io/projected/06b64b48-3059-46f5-bbb9-c29ba4697270-kube-api-access-4vjb7\") pod \"node-resolver-qngmr\" (UID: \"06b64b48-3059-46f5-bbb9-c29ba4697270\") " pod="openshift-dns/node-resolver-qngmr"
Sep 08 14:55:23.251441 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.251388    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhw6d\" (UniqueName: \"kubernetes.io/projected/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-kube-api-access-vhw6d\") pod \"network-metrics-daemon-6w52g\" (UID: \"95e20c4e-8cd2-4ac0-9364-1065c6c8a10b\") " pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:23.251574 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.251478    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44mlh\" (UniqueName: \"kubernetes.io/projected/b4afab8c-02d7-4bf5-b246-80ee643292f0-kube-api-access-44mlh\") pod \"multus-additional-cni-plugins-zp8vb\" (UID: \"b4afab8c-02d7-4bf5-b246-80ee643292f0\") " pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.251659 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.251643    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzjvv\" (UniqueName: \"kubernetes.io/projected/a8fa8fbd-736e-4bf2-a7c7-d9db65334a61-kube-api-access-vzjvv\") pod \"node-ca-b64k8\" (UID: \"a8fa8fbd-736e-4bf2-a7c7-d9db65334a61\") " pod="openshift-image-registry/node-ca-b64k8"
Sep 08 14:55:23.332167 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.332083    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sl7g8"
Sep 08 14:55:23.339489 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.339467    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k7kj5"
Sep 08 14:55:23.341951 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:23.341782    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8fa1793_9a61_454c_9e42_7a3374e3c0fb.slice/crio-721c0314fb6e15f86eb043c0fcc4d60d6a69394b01727ed94b830e1293b94072 WatchSource:0}: Error finding container 721c0314fb6e15f86eb043c0fcc4d60d6a69394b01727ed94b830e1293b94072: Status 404 returned error can't find the container with id 721c0314fb6e15f86eb043c0fcc4d60d6a69394b01727ed94b830e1293b94072
Sep 08 14:55:23.347481 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.347462    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zp8vb"
Sep 08 14:55:23.347881 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:23.347854    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe9450b_15fc_4cf7_8f5a_c4fa45db92ae.slice/crio-2314e394311ca9d3fc854e2be182384f4e7f2d1cbe421027580a35e9633b83bb WatchSource:0}: Error finding container 2314e394311ca9d3fc854e2be182384f4e7f2d1cbe421027580a35e9633b83bb: Status 404 returned error can't find the container with id 2314e394311ca9d3fc854e2be182384f4e7f2d1cbe421027580a35e9633b83bb
Sep 08 14:55:23.352186 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.352166    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wqkxw"
Sep 08 14:55:23.358105 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.358080    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:23.358846 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:23.358818    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4afab8c_02d7_4bf5_b246_80ee643292f0.slice/crio-45dc82e6a42931756f4e64b81cf2e3a80ad06384b1ffdb6fddbd8531420f1036 WatchSource:0}: Error finding container 45dc82e6a42931756f4e64b81cf2e3a80ad06384b1ffdb6fddbd8531420f1036: Status 404 returned error can't find the container with id 45dc82e6a42931756f4e64b81cf2e3a80ad06384b1ffdb6fddbd8531420f1036
Sep 08 14:55:23.362075 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:23.362050    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8859fc32_64fd_484f_97e3_6256a530f2ee.slice/crio-69fa8901012c20adcb77877569bf04d48dcfd2b4fdac101b36d7a27e4a7059ea WatchSource:0}: Error finding container 69fa8901012c20adcb77877569bf04d48dcfd2b4fdac101b36d7a27e4a7059ea: Status 404 returned error can't find the container with id 69fa8901012c20adcb77877569bf04d48dcfd2b4fdac101b36d7a27e4a7059ea
Sep 08 14:55:23.364477 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.363255    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-86pv2"
Sep 08 14:55:23.368539 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.368498    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789"
Sep 08 14:55:23.370000 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:23.369982    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f7f485e_e925_44c2_83b5_5ab147b6a6b8.slice/crio-229992c862a8428f92671b20bb9e3e326320ba5dd6ef84693d4da892ca1df8bd WatchSource:0}: Error finding container 229992c862a8428f92671b20bb9e3e326320ba5dd6ef84693d4da892ca1df8bd: Status 404 returned error can't find the container with id 229992c862a8428f92671b20bb9e3e326320ba5dd6ef84693d4da892ca1df8bd
Sep 08 14:55:23.372822 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:23.372796    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0d7ae31_4c06_47a1_8816_57fad4c6b67b.slice/crio-4eb5041c57df4c24b4a81ff989b6c857e738da58447d9e8c9545b6a6b8c4e5d2 WatchSource:0}: Error finding container 4eb5041c57df4c24b4a81ff989b6c857e738da58447d9e8c9545b6a6b8c4e5d2: Status 404 returned error can't find the container with id 4eb5041c57df4c24b4a81ff989b6c857e738da58447d9e8c9545b6a6b8c4e5d2
Sep 08 14:55:23.373595 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.373551    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qngmr"
Sep 08 14:55:23.378339 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.378319    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b64k8"
Sep 08 14:55:23.378653 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:23.378628    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a6bfdbc_f49b_4c50_9116_a37de6a21402.slice/crio-19f85dc95458ba7ac06fe062af9fa6cd6f767152de296b84920665a88fbf40f9 WatchSource:0}: Error finding container 19f85dc95458ba7ac06fe062af9fa6cd6f767152de296b84920665a88fbf40f9: Status 404 returned error can't find the container with id 19f85dc95458ba7ac06fe062af9fa6cd6f767152de296b84920665a88fbf40f9
Sep 08 14:55:23.383618 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:23.383594    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b64b48_3059_46f5_bbb9_c29ba4697270.slice/crio-a8e199b405df027cf807fc4442bd91c2a7ffb548d49fd9deec59b40530fbab56 WatchSource:0}: Error finding container a8e199b405df027cf807fc4442bd91c2a7ffb548d49fd9deec59b40530fbab56: Status 404 returned error can't find the container with id a8e199b405df027cf807fc4442bd91c2a7ffb548d49fd9deec59b40530fbab56
Sep 08 14:55:23.388085 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:23.388064    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8fa8fbd_736e_4bf2_a7c7_d9db65334a61.slice/crio-f543008f09b45b364419b843a099eda29f2e11ac6227d5f95e42c68adbcb6351 WatchSource:0}: Error finding container f543008f09b45b364419b843a099eda29f2e11ac6227d5f95e42c68adbcb6351: Status 404 returned error can't find the container with id f543008f09b45b364419b843a099eda29f2e11ac6227d5f95e42c68adbcb6351
Sep 08 14:55:23.743099 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.743031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret\") pod \"global-pull-secret-syncer-hjhs7\" (UID: \"cc66186e-7479-4d5f-8e81-fa0d49a60ef1\") " pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:23.743099 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.743084    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs\") pod \"network-metrics-daemon-6w52g\" (UID: \"95e20c4e-8cd2-4ac0-9364-1065c6c8a10b\") " pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:23.743265 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.743195    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:23.743265 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.743220    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:23.743265 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.743257    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs podName:95e20c4e-8cd2-4ac0-9364-1065c6c8a10b nodeName:}" failed. No retries permitted until 2026-09-08 14:55:24.743241684 +0000 UTC m=+4.075481207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs") pod "network-metrics-daemon-6w52g" (UID: "95e20c4e-8cd2-4ac0-9364-1065c6c8a10b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:23.743399 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.743276    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret podName:cc66186e-7479-4d5f-8e81-fa0d49a60ef1 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:24.743269122 +0000 UTC m=+4.075508646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret") pod "global-pull-secret-syncer-hjhs7" (UID: "cc66186e-7479-4d5f-8e81-fa0d49a60ef1") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:23.844239 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:23.844204    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsrvj\" (UniqueName: \"kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj\") pod \"network-check-target-fjm4v\" (UID: \"d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6\") " pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:23.844422 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.844389    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:55:23.844422 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.844419    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:55:23.844573 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.844433    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vsrvj for pod openshift-network-diagnostics/network-check-target-fjm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:23.844573 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:23.844494    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj podName:d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:24.844475769 +0000 UTC m=+4.176715298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vsrvj" (UniqueName: "kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj") pod "network-check-target-fjm4v" (UID: "d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:24.075708 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:24.075546    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 14:50:23 +0000 UTC" deadline="2028-04-26 03:34:10.784871692 +0000 UTC"
Sep 08 14:55:24.075708 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:24.075585    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14292h38m46.709291189s"
Sep 08 14:55:24.150886 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:24.150857    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:24.151062 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:24.151001    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:24.159922 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:24.159885    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789" event={"ID":"7a6bfdbc-f49b-4c50-9116-a37de6a21402","Type":"ContainerStarted","Data":"19f85dc95458ba7ac06fe062af9fa6cd6f767152de296b84920665a88fbf40f9"}
Sep 08 14:55:24.166993 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:24.166960    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-86pv2" event={"ID":"b0d7ae31-4c06-47a1-8816-57fad4c6b67b","Type":"ContainerStarted","Data":"4eb5041c57df4c24b4a81ff989b6c857e738da58447d9e8c9545b6a6b8c4e5d2"}
Sep 08 14:55:24.172557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:24.172528    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk" event={"ID":"3f7f485e-e925-44c2-83b5-5ab147b6a6b8","Type":"ContainerStarted","Data":"229992c862a8428f92671b20bb9e3e326320ba5dd6ef84693d4da892ca1df8bd"}
Sep 08 14:55:24.189467 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:24.189219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k7kj5" event={"ID":"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae","Type":"ContainerStarted","Data":"2314e394311ca9d3fc854e2be182384f4e7f2d1cbe421027580a35e9633b83bb"}
Sep 08 14:55:24.194472 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:24.194392    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b64k8" event={"ID":"a8fa8fbd-736e-4bf2-a7c7-d9db65334a61","Type":"ContainerStarted","Data":"f543008f09b45b364419b843a099eda29f2e11ac6227d5f95e42c68adbcb6351"}
Sep 08 14:55:24.203772 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:24.203679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wqkxw" event={"ID":"8859fc32-64fd-484f-97e3-6256a530f2ee","Type":"ContainerStarted","Data":"69fa8901012c20adcb77877569bf04d48dcfd2b4fdac101b36d7a27e4a7059ea"}
Sep 08 14:55:24.206442 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:24.206411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zp8vb" event={"ID":"b4afab8c-02d7-4bf5-b246-80ee643292f0","Type":"ContainerStarted","Data":"45dc82e6a42931756f4e64b81cf2e3a80ad06384b1ffdb6fddbd8531420f1036"}
Sep 08 14:55:24.209501 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:24.209460    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sl7g8" event={"ID":"b8fa1793-9a61-454c-9e42-7a3374e3c0fb","Type":"ContainerStarted","Data":"721c0314fb6e15f86eb043c0fcc4d60d6a69394b01727ed94b830e1293b94072"}
Sep 08 14:55:24.213834 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:24.213777    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qngmr" event={"ID":"06b64b48-3059-46f5-bbb9-c29ba4697270","Type":"ContainerStarted","Data":"a8e199b405df027cf807fc4442bd91c2a7ffb548d49fd9deec59b40530fbab56"}
Sep 08 14:55:24.754129 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:24.754037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret\") pod \"global-pull-secret-syncer-hjhs7\" (UID: \"cc66186e-7479-4d5f-8e81-fa0d49a60ef1\") " pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:24.754129 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:24.754112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs\") pod \"network-metrics-daemon-6w52g\" (UID: \"95e20c4e-8cd2-4ac0-9364-1065c6c8a10b\") " pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:24.754376 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:24.754273    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:24.754376 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:24.754339    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs podName:95e20c4e-8cd2-4ac0-9364-1065c6c8a10b nodeName:}" failed. No retries permitted until 2026-09-08 14:55:26.754319043 +0000 UTC m=+6.086558572 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs") pod "network-metrics-daemon-6w52g" (UID: "95e20c4e-8cd2-4ac0-9364-1065c6c8a10b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:24.754845 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:24.754821    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:24.754937 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:24.754884    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret podName:cc66186e-7479-4d5f-8e81-fa0d49a60ef1 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:26.754867926 +0000 UTC m=+6.087107455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret") pod "global-pull-secret-syncer-hjhs7" (UID: "cc66186e-7479-4d5f-8e81-fa0d49a60ef1") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:24.854999 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:24.854959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsrvj\" (UniqueName: \"kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj\") pod \"network-check-target-fjm4v\" (UID: \"d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6\") " pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:24.855165 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:24.855135    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:55:24.855165 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:24.855155    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:55:24.855235 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:24.855168    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vsrvj for pod openshift-network-diagnostics/network-check-target-fjm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:24.855235 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:24.855228    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj podName:d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:26.855209991 +0000 UTC m=+6.187449518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vsrvj" (UniqueName: "kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj") pod "network-check-target-fjm4v" (UID: "d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:25.075927 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:25.075779    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 14:50:23 +0000 UTC" deadline="2028-02-17 04:04:06.21356378 +0000 UTC"
Sep 08 14:55:25.075927 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:25.075841    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12637h8m41.137727325s"
Sep 08 14:55:25.151653 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:25.151622    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:25.151836 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:25.151752    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:25.152092 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:25.151622    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:25.152196 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:25.152175    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:25.261029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:25.260755    2580 generic.go:356] "Generic (PLEG): container finished" podID="b5ded91485376d888c05a9f15df44fd5" containerID="9c934c3f4453e0d23d0b389185050ff224ac5051fe57c95ad04df9560c22994b" exitCode=0
Sep 08 14:55:25.261029 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:25.260886    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal" event={"ID":"b5ded91485376d888c05a9f15df44fd5","Type":"ContainerDied","Data":"9c934c3f4453e0d23d0b389185050ff224ac5051fe57c95ad04df9560c22994b"}
Sep 08 14:55:25.284293 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:25.284262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal" event={"ID":"1fe981aef88d6cd2cc7b16faaac99f73","Type":"ContainerStarted","Data":"f6e34a1fbf35cbf7e371a5e34a4821c1f5f096cc5040125a69ce5a74aea5f68f"}
Sep 08 14:55:26.150709 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:26.150677    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:26.151392 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:26.150826    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:26.296257 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:26.296219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal" event={"ID":"b5ded91485376d888c05a9f15df44fd5","Type":"ContainerStarted","Data":"411cc8d0f96f57d8255922b2b78a4f4bfad8523cef1f938a6cc1c0b4f0de11e7"}
Sep 08 14:55:26.773778 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:26.773739    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs\") pod \"network-metrics-daemon-6w52g\" (UID: \"95e20c4e-8cd2-4ac0-9364-1065c6c8a10b\") " pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:26.773950 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:26.773831    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret\") pod \"global-pull-secret-syncer-hjhs7\" (UID: \"cc66186e-7479-4d5f-8e81-fa0d49a60ef1\") " pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:26.774025 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:26.773961    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:26.774082 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:26.774029    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret podName:cc66186e-7479-4d5f-8e81-fa0d49a60ef1 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:30.774008361 +0000 UTC m=+10.106247902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret") pod "global-pull-secret-syncer-hjhs7" (UID: "cc66186e-7479-4d5f-8e81-fa0d49a60ef1") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:26.774143 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:26.774101    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:26.774143 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:26.774140    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs podName:95e20c4e-8cd2-4ac0-9364-1065c6c8a10b nodeName:}" failed. No retries permitted until 2026-09-08 14:55:30.77412877 +0000 UTC m=+10.106368325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs") pod "network-metrics-daemon-6w52g" (UID: "95e20c4e-8cd2-4ac0-9364-1065c6c8a10b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:26.875156 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:26.875120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsrvj\" (UniqueName: \"kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj\") pod \"network-check-target-fjm4v\" (UID: \"d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6\") " pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:26.875336 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:26.875311    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:55:26.875393 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:26.875339    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:55:26.875393 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:26.875353    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vsrvj for pod openshift-network-diagnostics/network-check-target-fjm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:26.875491 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:26.875413    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj podName:d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:30.875394255 +0000 UTC m=+10.207633788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vsrvj" (UniqueName: "kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj") pod "network-check-target-fjm4v" (UID: "d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:27.150744 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:27.150661    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:27.151180 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:27.150671    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:27.151180 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:27.150793    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:27.151180 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:27.150840    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:28.151438 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:28.150824    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:28.151438 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:28.150984    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:29.150073 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:29.150042    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:29.150257 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:29.150170    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:29.150492 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:29.150053    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:29.150638 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:29.150565    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:30.150855 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:30.150772    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:30.151267 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:30.150903    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:30.809205 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:30.808948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret\") pod \"global-pull-secret-syncer-hjhs7\" (UID: \"cc66186e-7479-4d5f-8e81-fa0d49a60ef1\") " pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:30.809205 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:30.809017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs\") pod \"network-metrics-daemon-6w52g\" (UID: \"95e20c4e-8cd2-4ac0-9364-1065c6c8a10b\") " pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:30.809205 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:30.809170    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:30.809503 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:30.809239    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs podName:95e20c4e-8cd2-4ac0-9364-1065c6c8a10b nodeName:}" failed. No retries permitted until 2026-09-08 14:55:38.809221732 +0000 UTC m=+18.141461273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs") pod "network-metrics-daemon-6w52g" (UID: "95e20c4e-8cd2-4ac0-9364-1065c6c8a10b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:30.809617 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:30.809170    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:30.809686 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:30.809639    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret podName:cc66186e-7479-4d5f-8e81-fa0d49a60ef1 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:38.809621112 +0000 UTC m=+18.141860651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret") pod "global-pull-secret-syncer-hjhs7" (UID: "cc66186e-7479-4d5f-8e81-fa0d49a60ef1") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:30.910256 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:30.910185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsrvj\" (UniqueName: \"kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj\") pod \"network-check-target-fjm4v\" (UID: \"d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6\") " pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:30.910433 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:30.910358    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:55:30.910433 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:30.910384    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:55:30.910433 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:30.910400    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vsrvj for pod openshift-network-diagnostics/network-check-target-fjm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:30.910639 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:30.910461    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj podName:d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:38.910442119 +0000 UTC m=+18.242681650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vsrvj" (UniqueName: "kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj") pod "network-check-target-fjm4v" (UID: "d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:31.152133 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:31.152054    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:31.152583 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:31.152178    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:31.152583 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:31.152548    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:31.152709 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:31.152642    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:32.151191 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:32.151101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:32.151362 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:32.151262    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:33.150566 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:33.150445    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:33.151033 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:33.150635    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:33.151286 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:33.151142    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:33.151286 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:33.151250    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:34.150644 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:34.150608    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:34.151065 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:34.150722    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:35.150110 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:35.150072    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:35.150287 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:35.150072    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:35.150287 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:35.150206    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:35.150287 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:35.150245    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:36.150831 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:36.150618    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:36.151285 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:36.150925    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:37.150410 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:37.150370    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:37.150591 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:37.150370    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:37.150591 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:37.150497    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:37.150692 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:37.150591    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:38.150610 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:38.150574    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:38.151132 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:38.150700    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:38.869770 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:38.869732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs\") pod \"network-metrics-daemon-6w52g\" (UID: \"95e20c4e-8cd2-4ac0-9364-1065c6c8a10b\") " pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:38.869952 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:38.869800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret\") pod \"global-pull-secret-syncer-hjhs7\" (UID: \"cc66186e-7479-4d5f-8e81-fa0d49a60ef1\") " pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:38.869952 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:38.869908    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:38.870072 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:38.869990    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret podName:cc66186e-7479-4d5f-8e81-fa0d49a60ef1 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:54.869969268 +0000 UTC m=+34.202208792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret") pod "global-pull-secret-syncer-hjhs7" (UID: "cc66186e-7479-4d5f-8e81-fa0d49a60ef1") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:38.870072 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:38.869908    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:38.870072 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:38.870052    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs podName:95e20c4e-8cd2-4ac0-9364-1065c6c8a10b nodeName:}" failed. No retries permitted until 2026-09-08 14:55:54.870038269 +0000 UTC m=+34.202277793 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs") pod "network-metrics-daemon-6w52g" (UID: "95e20c4e-8cd2-4ac0-9364-1065c6c8a10b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:38.970281 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:38.970246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsrvj\" (UniqueName: \"kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj\") pod \"network-check-target-fjm4v\" (UID: \"d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6\") " pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:38.970446 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:38.970390    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:55:38.970446 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:38.970405    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:55:38.970446 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:38.970415    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vsrvj for pod openshift-network-diagnostics/network-check-target-fjm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:38.970588 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:38.970472    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj podName:d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:54.970454995 +0000 UTC m=+34.302694520 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vsrvj" (UniqueName: "kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj") pod "network-check-target-fjm4v" (UID: "d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:39.151154 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:39.151063    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:39.151627 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:39.151063    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:39.151627 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:39.151199    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:39.151627 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:39.151249    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:40.150146 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:40.150104    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:40.150335 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:40.150221    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:41.151347 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:41.151309    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:41.151807 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:41.151362    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:41.151807 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:41.151443    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:41.151807 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:41.151478    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:42.150668 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.150645    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:42.150775 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:42.150755    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:42.331492 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.331365    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 14:55:42.331940 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.331830    2580 generic.go:356] "Generic (PLEG): container finished" podID="3f7f485e-e925-44c2-83b5-5ab147b6a6b8" containerID="98613fd33048656d727133c494565d5263dcb1140d981836d698cccff46d0fe0" exitCode=1
Sep 08 14:55:42.331940 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.331890    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk" event={"ID":"3f7f485e-e925-44c2-83b5-5ab147b6a6b8","Type":"ContainerStarted","Data":"b3ed415fa8d350d623d64d98bbf46c747f3fc79b8e6be6b0b0dd0a16d69bf76f"}
Sep 08 14:55:42.332024 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.331982    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk" event={"ID":"3f7f485e-e925-44c2-83b5-5ab147b6a6b8","Type":"ContainerStarted","Data":"f24c483d6e4cc45374c94a4e19ff6daad493f16063e676d58e55243b8e4ddb26"}
Sep 08 14:55:42.332062 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.332021    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk" event={"ID":"3f7f485e-e925-44c2-83b5-5ab147b6a6b8","Type":"ContainerDied","Data":"98613fd33048656d727133c494565d5263dcb1140d981836d698cccff46d0fe0"}
Sep 08 14:55:42.332062 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.332053    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk" event={"ID":"3f7f485e-e925-44c2-83b5-5ab147b6a6b8","Type":"ContainerStarted","Data":"aeb7b59dc958b9e2189914234eb1d372763d74428d48b6c2866523cb44f5adc6"}
Sep 08 14:55:42.333374 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.333349    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b64k8" event={"ID":"a8fa8fbd-736e-4bf2-a7c7-d9db65334a61","Type":"ContainerStarted","Data":"9f120a1c81abfdecdec3cffb693ed9326ba7eae8d2669ac5939846f4e9cfdbf5"}
Sep 08 14:55:42.335000 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.334979    2580 generic.go:356] "Generic (PLEG): container finished" podID="b4afab8c-02d7-4bf5-b246-80ee643292f0" containerID="99e550bfe82bf02c765ad897675344da264ad5b43673a8b8715f72fecca2bf69" exitCode=0
Sep 08 14:55:42.335067 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.335048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zp8vb" event={"ID":"b4afab8c-02d7-4bf5-b246-80ee643292f0","Type":"ContainerDied","Data":"99e550bfe82bf02c765ad897675344da264ad5b43673a8b8715f72fecca2bf69"}
Sep 08 14:55:42.336710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.336677    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sl7g8" event={"ID":"b8fa1793-9a61-454c-9e42-7a3374e3c0fb","Type":"ContainerStarted","Data":"39b5a7b9cc4d5776ab0df0ad1c06fb2af8a48c394459628ac2f07f4e868e70fa"}
Sep 08 14:55:42.338136 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.338115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal" event={"ID":"1fe981aef88d6cd2cc7b16faaac99f73","Type":"ContainerStarted","Data":"af2bfd5700bc4c7722174e1fb64d7814767cc8a634ce05a9845240c001ceb877"}
Sep 08 14:55:42.339584 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.339562    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qngmr" event={"ID":"06b64b48-3059-46f5-bbb9-c29ba4697270","Type":"ContainerStarted","Data":"eb90c75454811414f995c28711db96c8eef018edc4e784bc62bcdccd81a99672"}
Sep 08 14:55:42.340934 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.340907    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789" event={"ID":"7a6bfdbc-f49b-4c50-9116-a37de6a21402","Type":"ContainerStarted","Data":"72de750f86b41b1070eba7ea84016bf0f5689dddb0524a8a33d591e8bb764fb8"}
Sep 08 14:55:42.342408 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.342389    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-86pv2" event={"ID":"b0d7ae31-4c06-47a1-8816-57fad4c6b67b","Type":"ContainerStarted","Data":"3503a0ab517a8b29de9befd0961adb23b1fffcee3e1540bb461b373660e180c0"}
Sep 08 14:55:42.348761 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.348715    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal" podStartSLOduration=20.348681233 podStartE2EDuration="20.348681233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:26.312591228 +0000 UTC m=+5.644830774" watchObservedRunningTime="2026-09-08 14:55:42.348681233 +0000 UTC m=+21.680920769"
Sep 08 14:55:42.349427 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.349400    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b64k8" podStartSLOduration=3.003866112 podStartE2EDuration="21.349389212s" totalImagesPullingTime="18.3455231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:42.348845646 +0000 UTC m=+21.681085189" watchObservedRunningTime="2026-09-08 14:55:42.349389212 +0000 UTC m=+21.681628758"
Sep 08 14:55:42.365202 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.365162    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-86pv2" podStartSLOduration=2.919135736 podStartE2EDuration="21.365146369s" totalImagesPullingTime="18.446010633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:42.364824693 +0000 UTC m=+21.697064239" watchObservedRunningTime="2026-09-08 14:55:42.365146369 +0000 UTC m=+21.697385914"
Sep 08 14:55:42.380927 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.380614    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qngmr" podStartSLOduration=3.031034457 podStartE2EDuration="21.380596074s" totalImagesPullingTime="18.349561617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:42.380334832 +0000 UTC m=+21.712574379" watchObservedRunningTime="2026-09-08 14:55:42.380596074 +0000 UTC m=+21.712835624"
Sep 08 14:55:42.393670 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.393631    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal" podStartSLOduration=20.393617236 podStartE2EDuration="20.393617236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:42.393564196 +0000 UTC m=+21.725803743" watchObservedRunningTime="2026-09-08 14:55:42.393617236 +0000 UTC m=+21.725856781"
Sep 08 14:55:42.408918 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:42.408871    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sl7g8" podStartSLOduration=10.152957445 podStartE2EDuration="21.408848277s" totalImagesPullingTime="11.255890832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:42.408786656 +0000 UTC m=+21.741026198" watchObservedRunningTime="2026-09-08 14:55:42.408848277 +0000 UTC m=+21.741087822"
Sep 08 14:55:43.150613 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:43.150278    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:43.150613 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:43.150278    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:43.150701 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:43.150622    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:43.150701 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:43.150652    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:43.347459 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:43.347438    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 14:55:43.347954 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:43.347796    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk" event={"ID":"3f7f485e-e925-44c2-83b5-5ab147b6a6b8","Type":"ContainerStarted","Data":"0f355ff2c664c5a2152422c6b74cc9749d4c480c095de0c2e8e7ef8fcd344f90"}
Sep 08 14:55:43.347954 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:43.347865    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk" event={"ID":"3f7f485e-e925-44c2-83b5-5ab147b6a6b8","Type":"ContainerStarted","Data":"a4c1e65567e8ed969685b20d581b1ececda968da8ca3323b8ca7036cf3a994f3"}
Sep 08 14:55:43.349116 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:43.349090    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k7kj5" event={"ID":"ebe9450b-15fc-4cf7-8f5a-c4fa45db92ae","Type":"ContainerStarted","Data":"81124749ad29e2b4075be3c1c263ee9fc3ea6398d37b6642a4cad3e3c2d8fb9a"}
Sep 08 14:55:43.350553 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:43.350521    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wqkxw" event={"ID":"8859fc32-64fd-484f-97e3-6256a530f2ee","Type":"ContainerStarted","Data":"615b4166cfdcb77585bc1c01941f7419ca4ac23a298ecb52742625995eaf4050"}
Sep 08 14:55:43.368042 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:43.367997    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k7kj5" podStartSLOduration=3.3348949709999998 podStartE2EDuration="22.367982478s" totalImagesPullingTime="19.033087507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:43.36769396 +0000 UTC m=+22.699933506" watchObservedRunningTime="2026-09-08 14:55:43.367982478 +0000 UTC m=+22.700222024"
Sep 08 14:55:43.368584 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:43.368564    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 14:55:43.381959 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:43.381919    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wqkxw" podStartSLOduration=4.011334701 podStartE2EDuration="22.381904236s" totalImagesPullingTime="18.370569535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:43.381432498 +0000 UTC m=+22.713672044" watchObservedRunningTime="2026-09-08 14:55:43.381904236 +0000 UTC m=+22.714143782"
Sep 08 14:55:44.086067 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:44.085961    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T14:55:43.368578944Z","UUID":"3ba6ced7-6d96-4a22-a5b4-858716f385d5","Handler":null,"Name":"","Endpoint":""}
Sep 08 14:55:44.087680 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:44.087654    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 14:55:44.087810 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:44.087710    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 14:55:44.150254 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:44.150226    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:44.150474 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:44.150370    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:44.355794 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:44.355709    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789" event={"ID":"7a6bfdbc-f49b-4c50-9116-a37de6a21402","Type":"ContainerStarted","Data":"1a4af85cbd6462cbd5ae186fe137a02b508fad26bf64cb0124513d0028326b21"}
Sep 08 14:55:45.150575 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:45.150533    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:45.150764 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:45.150716    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:45.150764 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:45.150729    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:45.150883 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:45.150846    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:45.360996 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:45.360967    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 14:55:45.361384 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:45.361291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk" event={"ID":"3f7f485e-e925-44c2-83b5-5ab147b6a6b8","Type":"ContainerStarted","Data":"130c84b6cf41c094ba163c8196ca8ce2f36013b95288c983b3aae5b3715038cb"}
Sep 08 14:55:45.862870 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:45.862838    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sl7g8"
Sep 08 14:55:45.863458 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:45.863429    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sl7g8"
Sep 08 14:55:46.150906 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:46.150833    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:46.151096 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:46.150984    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:46.363925 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:46.363890    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sl7g8"
Sep 08 14:55:46.364571 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:46.364554    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sl7g8"
Sep 08 14:55:47.151025 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:47.150985    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:47.151207 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:47.151124    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:47.151207 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:47.151181    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:47.151311 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:47.151292    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:48.150161 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:48.150133    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:48.150545 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:48.150272    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:48.371667 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:48.371424    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789" event={"ID":"7a6bfdbc-f49b-4c50-9116-a37de6a21402","Type":"ContainerStarted","Data":"81e519e6a857992595305fa8fb5e5518a1af92dfa03a68b4e1356275d7054a38"}
Sep 08 14:55:48.375178 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:48.375156    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 14:55:48.375688 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:48.375653    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk" event={"ID":"3f7f485e-e925-44c2-83b5-5ab147b6a6b8","Type":"ContainerStarted","Data":"f5059a1a4e62a0105435a897abcafc58c60b1aa5042256ef683660df3de28577"}
Sep 08 14:55:48.375935 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:48.375916    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:48.376022 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:48.375985    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:48.376114 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:48.376096    2580 scope.go:117] "RemoveContainer" containerID="98613fd33048656d727133c494565d5263dcb1140d981836d698cccff46d0fe0"
Sep 08 14:55:48.377746 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:48.377720    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zp8vb" event={"ID":"b4afab8c-02d7-4bf5-b246-80ee643292f0","Type":"ContainerStarted","Data":"3dc009f764bc379e3e43da556770318106d8493cacb534f5da2e7c7f1c26b45d"}
Sep 08 14:55:48.388857 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:48.388798    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74789" podStartSLOduration=3.096891623 podStartE2EDuration="27.388783328s" totalImagesPullingTime="24.291891705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:48.387732971 +0000 UTC m=+27.719972518" watchObservedRunningTime="2026-09-08 14:55:48.388783328 +0000 UTC m=+27.721022873"
Sep 08 14:55:48.392308 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:48.392284    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:49.153652 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:49.153625    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:49.154092 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:49.153625    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:49.154092 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:49.153733    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:49.154092 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:49.153801    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:49.384248 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:49.384222    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 14:55:49.384644 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:49.384621    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk" event={"ID":"3f7f485e-e925-44c2-83b5-5ab147b6a6b8","Type":"ContainerStarted","Data":"5f6ad1975465e8a37e97ea07fdc8c0cfc17c24b5d52dcfecf7fd436064e860ef"}
Sep 08 14:55:49.384807 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:49.384789    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:49.386479 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:49.386457    2580 generic.go:356] "Generic (PLEG): container finished" podID="b4afab8c-02d7-4bf5-b246-80ee643292f0" containerID="3dc009f764bc379e3e43da556770318106d8493cacb534f5da2e7c7f1c26b45d" exitCode=0
Sep 08 14:55:49.386597 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:49.386544    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zp8vb" event={"ID":"b4afab8c-02d7-4bf5-b246-80ee643292f0","Type":"ContainerDied","Data":"3dc009f764bc379e3e43da556770318106d8493cacb534f5da2e7c7f1c26b45d"}
Sep 08 14:55:49.400132 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:49.400056    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:55:49.412414 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:49.412366    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk" podStartSLOduration=9.962660541 podStartE2EDuration="28.412349804s" totalImagesPullingTime="18.449689263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:49.410753467 +0000 UTC m=+28.742993012" watchObservedRunningTime="2026-09-08 14:55:49.412349804 +0000 UTC m=+28.744589360"
Sep 08 14:55:50.150640 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:50.150609    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:50.150785 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:50.150728    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:50.404617 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:50.404299    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hjhs7"]
Sep 08 14:55:50.405261 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:50.404670    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:50.405261 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:50.404773    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:50.410624 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:50.410589    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fjm4v"]
Sep 08 14:55:50.411238 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:50.410761    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:50.411238 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:50.410933    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:50.413107 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:50.413083    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6w52g"]
Sep 08 14:55:50.413890 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:50.413213    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:50.413890 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:50.413356    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:51.393242 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:51.393208    2580 generic.go:356] "Generic (PLEG): container finished" podID="b4afab8c-02d7-4bf5-b246-80ee643292f0" containerID="1e497fde06804d72b26f8b5d8d2002170e7eb2e4dac961df3ab6ee5889655f34" exitCode=0
Sep 08 14:55:51.393453 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:51.393291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zp8vb" event={"ID":"b4afab8c-02d7-4bf5-b246-80ee643292f0","Type":"ContainerDied","Data":"1e497fde06804d72b26f8b5d8d2002170e7eb2e4dac961df3ab6ee5889655f34"}
Sep 08 14:55:52.150528 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:52.150478    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:52.150528 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:52.150527    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:52.150967 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:52.150484    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:52.150967 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:52.150593    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:52.150967 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:52.150668    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:52.150967 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:52.150734    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:54.150925 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:54.150894    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:54.151205 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:54.151002    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:54.151205 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:54.151010    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjm4v" podUID="d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6"
Sep 08 14:55:54.151205 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:54.151030    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:54.151205 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:54.151102    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjhs7" podUID="cc66186e-7479-4d5f-8e81-fa0d49a60ef1"
Sep 08 14:55:54.151205 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:54.151161    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6w52g" podUID="95e20c4e-8cd2-4ac0-9364-1065c6c8a10b"
Sep 08 14:55:54.401719 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:54.401627    2580 generic.go:356] "Generic (PLEG): container finished" podID="b4afab8c-02d7-4bf5-b246-80ee643292f0" containerID="57229bffd054227ebe50ec707996ea9b8cf7cf997d03af7cbe407596def6a7f1" exitCode=0
Sep 08 14:55:54.401719 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:54.401670    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zp8vb" event={"ID":"b4afab8c-02d7-4bf5-b246-80ee643292f0","Type":"ContainerDied","Data":"57229bffd054227ebe50ec707996ea9b8cf7cf997d03af7cbe407596def6a7f1"}
Sep 08 14:55:54.883649 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:54.883610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs\") pod \"network-metrics-daemon-6w52g\" (UID: \"95e20c4e-8cd2-4ac0-9364-1065c6c8a10b\") " pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:54.883946 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:54.883705    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret\") pod \"global-pull-secret-syncer-hjhs7\" (UID: \"cc66186e-7479-4d5f-8e81-fa0d49a60ef1\") " pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:54.883946 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:54.883790    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:54.883946 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:54.883825    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:54.883946 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:54.883879    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs podName:95e20c4e-8cd2-4ac0-9364-1065c6c8a10b nodeName:}" failed. No retries permitted until 2026-09-08 14:56:26.883848439 +0000 UTC m=+66.216087969 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs") pod "network-metrics-daemon-6w52g" (UID: "95e20c4e-8cd2-4ac0-9364-1065c6c8a10b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:54.883946 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:54.883902    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret podName:cc66186e-7479-4d5f-8e81-fa0d49a60ef1 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:26.883892696 +0000 UTC m=+66.216132225 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret") pod "global-pull-secret-syncer-hjhs7" (UID: "cc66186e-7479-4d5f-8e81-fa0d49a60ef1") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:54.953505 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:54.953470    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeReady"
Sep 08 14:55:54.953744 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:54.953729    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 14:55:54.984239 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:54.984164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsrvj\" (UniqueName: \"kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj\") pod \"network-check-target-fjm4v\" (UID: \"d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6\") " pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:54.984385 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:54.984334    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:55:54.984385 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:54.984366    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:55:54.984385 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:54.984379    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vsrvj for pod openshift-network-diagnostics/network-check-target-fjm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:54.984534 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:54.984443    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj podName:d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:26.984425344 +0000 UTC m=+66.316664882 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vsrvj" (UniqueName: "kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj") pod "network-check-target-fjm4v" (UID: "d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:54.998622 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:54.998588    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-knvj7"]
Sep 08 14:55:55.001949 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.001926    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v48sd"]
Sep 08 14:55:55.002086 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.002065    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-knvj7"
Sep 08 14:55:55.004757 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.004737    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v48sd"
Sep 08 14:55:55.004891 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.004795    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 14:55:55.004891 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.004800    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 14:55:55.005004 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.004901    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hknbk\""
Sep 08 14:55:55.006855 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.006835    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 14:55:55.007261 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.007242    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z5hlj\""
Sep 08 14:55:55.007358 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.007274    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 14:55:55.007671 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.007653    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 14:55:55.016310 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.015677    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-knvj7"]
Sep 08 14:55:55.016310 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.016270    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v48sd"]
Sep 08 14:55:55.084902 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.084854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fec39b5-fe04-4bdf-a96d-e97f8d99f1e6-cert\") pod \"ingress-canary-v48sd\" (UID: \"9fec39b5-fe04-4bdf-a96d-e97f8d99f1e6\") " pod="openshift-ingress-canary/ingress-canary-v48sd"
Sep 08 14:55:55.084902 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.084906    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5bpq\" (UniqueName: \"kubernetes.io/projected/9fec39b5-fe04-4bdf-a96d-e97f8d99f1e6-kube-api-access-b5bpq\") pod \"ingress-canary-v48sd\" (UID: \"9fec39b5-fe04-4bdf-a96d-e97f8d99f1e6\") " pod="openshift-ingress-canary/ingress-canary-v48sd"
Sep 08 14:55:55.085136 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.084946    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hrf7\" (UniqueName: \"kubernetes.io/projected/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-kube-api-access-7hrf7\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:55:55.085136 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.084975    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:55:55.085136 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.085015    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-tmp-dir\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:55:55.085136 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.085035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-config-volume\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:55:55.186217 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.186181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5bpq\" (UniqueName: \"kubernetes.io/projected/9fec39b5-fe04-4bdf-a96d-e97f8d99f1e6-kube-api-access-b5bpq\") pod \"ingress-canary-v48sd\" (UID: \"9fec39b5-fe04-4bdf-a96d-e97f8d99f1e6\") " pod="openshift-ingress-canary/ingress-canary-v48sd"
Sep 08 14:55:55.186659 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.186232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hrf7\" (UniqueName: \"kubernetes.io/projected/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-kube-api-access-7hrf7\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:55:55.186659 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.186261    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:55:55.186659 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.186314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-tmp-dir\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:55:55.186659 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.186346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-config-volume\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:55:55.186659 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:55.186401    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:55:55.186659 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.186410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fec39b5-fe04-4bdf-a96d-e97f8d99f1e6-cert\") pod \"ingress-canary-v48sd\" (UID: \"9fec39b5-fe04-4bdf-a96d-e97f8d99f1e6\") " pod="openshift-ingress-canary/ingress-canary-v48sd"
Sep 08 14:55:55.186659 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:55.186465    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls podName:2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:55.686445315 +0000 UTC m=+35.018684855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls") pod "dns-default-knvj7" (UID: "2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66") : secret "dns-default-metrics-tls" not found
Sep 08 14:55:55.186659 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.186627    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-tmp-dir\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:55:55.187062 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.187032    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-config-volume\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:55:55.191345 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.191326    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fec39b5-fe04-4bdf-a96d-e97f8d99f1e6-cert\") pod \"ingress-canary-v48sd\" (UID: \"9fec39b5-fe04-4bdf-a96d-e97f8d99f1e6\") " pod="openshift-ingress-canary/ingress-canary-v48sd"
Sep 08 14:55:55.195265 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.195216    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hrf7\" (UniqueName: \"kubernetes.io/projected/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-kube-api-access-7hrf7\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:55:55.195576 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.195553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5bpq\" (UniqueName: \"kubernetes.io/projected/9fec39b5-fe04-4bdf-a96d-e97f8d99f1e6-kube-api-access-b5bpq\") pod \"ingress-canary-v48sd\" (UID: \"9fec39b5-fe04-4bdf-a96d-e97f8d99f1e6\") " pod="openshift-ingress-canary/ingress-canary-v48sd"
Sep 08 14:55:55.322822 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.322740    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v48sd"
Sep 08 14:55:55.621893 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.621576    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v48sd"]
Sep 08 14:55:55.626779 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:55.626748    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fec39b5_fe04_4bdf_a96d_e97f8d99f1e6.slice/crio-220b844ccfabc4bbc448a05701c96e44f3e9edc82f918e88dac7fb8b90f5baa5 WatchSource:0}: Error finding container 220b844ccfabc4bbc448a05701c96e44f3e9edc82f918e88dac7fb8b90f5baa5: Status 404 returned error can't find the container with id 220b844ccfabc4bbc448a05701c96e44f3e9edc82f918e88dac7fb8b90f5baa5
Sep 08 14:55:55.690953 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.690919    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:55:55.691098 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:55.691085    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:55:55.691174 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:55.691162    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls podName:2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:56.691140264 +0000 UTC m=+36.023379801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls") pod "dns-default-knvj7" (UID: "2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66") : secret "dns-default-metrics-tls" not found
Sep 08 14:55:55.990640 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.990606    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"]
Sep 08 14:55:55.995698 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.995670    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:55:55.997740 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.997714    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq"]
Sep 08 14:55:55.998473 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:55.998445    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 08 14:55:56.000214 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.000195    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vd6mj\""
Sep 08 14:55:56.000699 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.000664    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 08 14:55:56.000699 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.000680    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 14:55:56.000699 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.000692    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 14:55:56.001323 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.001308    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq"
Sep 08 14:55:56.005557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.004796    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 08 14:55:56.005557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.004867    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:55:56.005557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.005013    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 08 14:55:56.005557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.005074    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-54kcd\""
Sep 08 14:55:56.005557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.005248    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"]
Sep 08 14:55:56.012904 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.012649    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq"]
Sep 08 14:55:56.093613 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.093579    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-j96p5"]
Sep 08 14:55:56.094959 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.094929    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vrr4\" (UniqueName: \"kubernetes.io/projected/c7bb2240-ebef-48d9-91d3-e85c04baf63d-kube-api-access-6vrr4\") pod \"cluster-samples-operator-7cdcfcf76c-bg6cq\" (UID: \"c7bb2240-ebef-48d9-91d3-e85c04baf63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq"
Sep 08 14:55:56.095086 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.094984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bg6cq\" (UID: \"c7bb2240-ebef-48d9-91d3-e85c04baf63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq"
Sep 08 14:55:56.095155 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.095077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/af0780d7-52f1-4ee6-9a32-db285e2c220c-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-h44k8\" (UID: \"af0780d7-52f1-4ee6-9a32-db285e2c220c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:55:56.095155 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.095146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-h44k8\" (UID: \"af0780d7-52f1-4ee6-9a32-db285e2c220c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:55:56.095245 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.095192    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqlgf\" (UniqueName: \"kubernetes.io/projected/af0780d7-52f1-4ee6-9a32-db285e2c220c-kube-api-access-xqlgf\") pod \"cluster-monitoring-operator-6cdcc96965-h44k8\" (UID: \"af0780d7-52f1-4ee6-9a32-db285e2c220c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:55:56.097431 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.097412    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-j96p5"
Sep 08 14:55:56.100279 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.100260    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 14:55:56.100364 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.100262    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lhxc2\""
Sep 08 14:55:56.100364 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.100262    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 14:55:56.107282 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.107260    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-j96p5"]
Sep 08 14:55:56.114569 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.114535    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85d5f6c77f-9g2nc"]
Sep 08 14:55:56.118047 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.118031    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.121156 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.121136    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 14:55:56.121446 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.121422    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 14:55:56.121551 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.121462    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8vqm8\""
Sep 08 14:55:56.121700 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.121685    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 14:55:56.130989 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.130960    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 14:55:56.134961 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.134939    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85d5f6c77f-9g2nc"]
Sep 08 14:55:56.150845 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.150809    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:55:56.150967 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.150810    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:55:56.151093 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.150812    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:55:56.153173 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.153146    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s4zv9\""
Sep 08 14:55:56.153353 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.153326    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 14:55:56.153430 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.153394    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 14:55:56.153640 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.153623    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4wbt\""
Sep 08 14:55:56.195996 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.195967    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9245568a-4c5c-4ffd-96b2-6f85cb27b307-image-registry-private-configuration\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.196501 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.196009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9245568a-4c5c-4ffd-96b2-6f85cb27b307-ca-trust-extracted\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.196501 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.196028    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-certificates\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.196501 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.196111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9245568a-4c5c-4ffd-96b2-6f85cb27b307-installation-pull-secrets\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.196501 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.196170    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbdvb\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-kube-api-access-sbdvb\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.196501 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.196205    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vrr4\" (UniqueName: \"kubernetes.io/projected/c7bb2240-ebef-48d9-91d3-e85c04baf63d-kube-api-access-6vrr4\") pod \"cluster-samples-operator-7cdcfcf76c-bg6cq\" (UID: \"c7bb2240-ebef-48d9-91d3-e85c04baf63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq"
Sep 08 14:55:56.196501 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.196285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bg6cq\" (UID: \"c7bb2240-ebef-48d9-91d3-e85c04baf63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq"
Sep 08 14:55:56.196501 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.196322    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/af0780d7-52f1-4ee6-9a32-db285e2c220c-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-h44k8\" (UID: \"af0780d7-52f1-4ee6-9a32-db285e2c220c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:55:56.196501 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.196348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-h44k8\" (UID: \"af0780d7-52f1-4ee6-9a32-db285e2c220c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:55:56.196501 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.196387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-467dh\" (UniqueName: \"kubernetes.io/projected/9b82e7e4-3c40-4c07-9600-e2e6ee9afa81-kube-api-access-467dh\") pod \"network-check-source-685456655f-j96p5\" (UID: \"9b82e7e4-3c40-4c07-9600-e2e6ee9afa81\") " pod="openshift-network-diagnostics/network-check-source-685456655f-j96p5"
Sep 08 14:55:56.196501 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.196409    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.196501 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.196452    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqlgf\" (UniqueName: \"kubernetes.io/projected/af0780d7-52f1-4ee6-9a32-db285e2c220c-kube-api-access-xqlgf\") pod \"cluster-monitoring-operator-6cdcc96965-h44k8\" (UID: \"af0780d7-52f1-4ee6-9a32-db285e2c220c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:55:56.196501 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.196477    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-bound-sa-token\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.196501 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.196505    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9245568a-4c5c-4ffd-96b2-6f85cb27b307-trusted-ca\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.197025 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:56.196837    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 14:55:56.197025 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:56.196913    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls podName:af0780d7-52f1-4ee6-9a32-db285e2c220c nodeName:}" failed. No retries permitted until 2026-09-08 14:55:56.696895133 +0000 UTC m=+36.029134662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-h44k8" (UID: "af0780d7-52f1-4ee6-9a32-db285e2c220c") : secret "cluster-monitoring-operator-tls" not found
Sep 08 14:55:56.197243 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:56.197227    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 14:55:56.197292 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.197254    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/af0780d7-52f1-4ee6-9a32-db285e2c220c-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-h44k8\" (UID: \"af0780d7-52f1-4ee6-9a32-db285e2c220c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:55:56.197292 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:56.197268    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls podName:c7bb2240-ebef-48d9-91d3-e85c04baf63d nodeName:}" failed. No retries permitted until 2026-09-08 14:55:56.697256967 +0000 UTC m=+36.029496491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-bg6cq" (UID: "c7bb2240-ebef-48d9-91d3-e85c04baf63d") : secret "samples-operator-tls" not found
Sep 08 14:55:56.208532 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.208493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vrr4\" (UniqueName: \"kubernetes.io/projected/c7bb2240-ebef-48d9-91d3-e85c04baf63d-kube-api-access-6vrr4\") pod \"cluster-samples-operator-7cdcfcf76c-bg6cq\" (UID: \"c7bb2240-ebef-48d9-91d3-e85c04baf63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq"
Sep 08 14:55:56.210903 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.210881    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqlgf\" (UniqueName: \"kubernetes.io/projected/af0780d7-52f1-4ee6-9a32-db285e2c220c-kube-api-access-xqlgf\") pod \"cluster-monitoring-operator-6cdcc96965-h44k8\" (UID: \"af0780d7-52f1-4ee6-9a32-db285e2c220c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:55:56.298124 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.298037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbdvb\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-kube-api-access-sbdvb\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.298284 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.298168    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-467dh\" (UniqueName: \"kubernetes.io/projected/9b82e7e4-3c40-4c07-9600-e2e6ee9afa81-kube-api-access-467dh\") pod \"network-check-source-685456655f-j96p5\" (UID: \"9b82e7e4-3c40-4c07-9600-e2e6ee9afa81\") " pod="openshift-network-diagnostics/network-check-source-685456655f-j96p5"
Sep 08 14:55:56.298284 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.298194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.298284 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.298231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-bound-sa-token\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.298284 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.298256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9245568a-4c5c-4ffd-96b2-6f85cb27b307-trusted-ca\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.298442 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.298298    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9245568a-4c5c-4ffd-96b2-6f85cb27b307-image-registry-private-configuration\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.298442 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.298325    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9245568a-4c5c-4ffd-96b2-6f85cb27b307-ca-trust-extracted\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.298442 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.298348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-certificates\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.298442 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.298386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9245568a-4c5c-4ffd-96b2-6f85cb27b307-installation-pull-secrets\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.299060 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:56.299038    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:55:56.299060 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:56.299060    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d5f6c77f-9g2nc: secret "image-registry-tls" not found
Sep 08 14:55:56.299214 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:56.299139    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls podName:9245568a-4c5c-4ffd-96b2-6f85cb27b307 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:56.799119802 +0000 UTC m=+36.131359340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls") pod "image-registry-85d5f6c77f-9g2nc" (UID: "9245568a-4c5c-4ffd-96b2-6f85cb27b307") : secret "image-registry-tls" not found
Sep 08 14:55:56.299442 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.299395    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9245568a-4c5c-4ffd-96b2-6f85cb27b307-ca-trust-extracted\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.299674 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.299631    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9245568a-4c5c-4ffd-96b2-6f85cb27b307-trusted-ca\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.299820 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.299798    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-certificates\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.301494 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.301452    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9245568a-4c5c-4ffd-96b2-6f85cb27b307-installation-pull-secrets\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.301912 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.301890    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9245568a-4c5c-4ffd-96b2-6f85cb27b307-image-registry-private-configuration\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.306582 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.306535    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-bound-sa-token\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.307370 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.306907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbdvb\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-kube-api-access-sbdvb\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.308141 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.308043    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-467dh\" (UniqueName: \"kubernetes.io/projected/9b82e7e4-3c40-4c07-9600-e2e6ee9afa81-kube-api-access-467dh\") pod \"network-check-source-685456655f-j96p5\" (UID: \"9b82e7e4-3c40-4c07-9600-e2e6ee9afa81\") " pod="openshift-network-diagnostics/network-check-source-685456655f-j96p5"
Sep 08 14:55:56.408442 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.408410    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-j96p5"
Sep 08 14:55:56.408993 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.408966    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v48sd" event={"ID":"9fec39b5-fe04-4bdf-a96d-e97f8d99f1e6","Type":"ContainerStarted","Data":"220b844ccfabc4bbc448a05701c96e44f3e9edc82f918e88dac7fb8b90f5baa5"}
Sep 08 14:55:56.696121 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.696042    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-j96p5"]
Sep 08 14:55:56.700344 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:55:56.700316    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b82e7e4_3c40_4c07_9600_e2e6ee9afa81.slice/crio-7f58e241baeb0625e8b51a03b9ca1f995927736342e1ab383bdbb66f9affe3d0 WatchSource:0}: Error finding container 7f58e241baeb0625e8b51a03b9ca1f995927736342e1ab383bdbb66f9affe3d0: Status 404 returned error can't find the container with id 7f58e241baeb0625e8b51a03b9ca1f995927736342e1ab383bdbb66f9affe3d0
Sep 08 14:55:56.702148 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.702122    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bg6cq\" (UID: \"c7bb2240-ebef-48d9-91d3-e85c04baf63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq"
Sep 08 14:55:56.702246 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.702158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-h44k8\" (UID: \"af0780d7-52f1-4ee6-9a32-db285e2c220c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:55:56.702246 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.702207    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:55:56.702350 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:56.702297    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:55:56.702350 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:56.702301    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 14:55:56.702350 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:56.702336    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls podName:2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:58.702324218 +0000 UTC m=+38.034563742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls") pod "dns-default-knvj7" (UID: "2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66") : secret "dns-default-metrics-tls" not found
Sep 08 14:55:56.702492 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:56.702359    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls podName:c7bb2240-ebef-48d9-91d3-e85c04baf63d nodeName:}" failed. No retries permitted until 2026-09-08 14:55:57.702341727 +0000 UTC m=+37.034581268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-bg6cq" (UID: "c7bb2240-ebef-48d9-91d3-e85c04baf63d") : secret "samples-operator-tls" not found
Sep 08 14:55:56.702492 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:56.702396    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 14:55:56.702492 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:56.702429    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls podName:af0780d7-52f1-4ee6-9a32-db285e2c220c nodeName:}" failed. No retries permitted until 2026-09-08 14:55:57.70241876 +0000 UTC m=+37.034658288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-h44k8" (UID: "af0780d7-52f1-4ee6-9a32-db285e2c220c") : secret "cluster-monitoring-operator-tls" not found
Sep 08 14:55:56.802833 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:56.802721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:56.803028 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:56.802907    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:55:56.803028 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:56.802924    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d5f6c77f-9g2nc: secret "image-registry-tls" not found
Sep 08 14:55:56.803028 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:56.803003    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls podName:9245568a-4c5c-4ffd-96b2-6f85cb27b307 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:57.802985094 +0000 UTC m=+37.135224631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls") pod "image-registry-85d5f6c77f-9g2nc" (UID: "9245568a-4c5c-4ffd-96b2-6f85cb27b307") : secret "image-registry-tls" not found
Sep 08 14:55:57.412832 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:57.412787    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-j96p5" event={"ID":"9b82e7e4-3c40-4c07-9600-e2e6ee9afa81","Type":"ContainerStarted","Data":"7f58e241baeb0625e8b51a03b9ca1f995927736342e1ab383bdbb66f9affe3d0"}
Sep 08 14:55:57.709537 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:57.709431    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bg6cq\" (UID: \"c7bb2240-ebef-48d9-91d3-e85c04baf63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq"
Sep 08 14:55:57.709537 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:57.709485    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-h44k8\" (UID: \"af0780d7-52f1-4ee6-9a32-db285e2c220c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:55:57.709768 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:57.709597    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 14:55:57.709768 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:57.709625    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 14:55:57.709768 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:57.709673    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls podName:c7bb2240-ebef-48d9-91d3-e85c04baf63d nodeName:}" failed. No retries permitted until 2026-09-08 14:55:59.709654963 +0000 UTC m=+39.041894504 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-bg6cq" (UID: "c7bb2240-ebef-48d9-91d3-e85c04baf63d") : secret "samples-operator-tls" not found
Sep 08 14:55:57.709768 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:57.709688    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls podName:af0780d7-52f1-4ee6-9a32-db285e2c220c nodeName:}" failed. No retries permitted until 2026-09-08 14:55:59.709682155 +0000 UTC m=+39.041921679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-h44k8" (UID: "af0780d7-52f1-4ee6-9a32-db285e2c220c") : secret "cluster-monitoring-operator-tls" not found
Sep 08 14:55:57.810958 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:57.810917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:57.811122 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:57.811085    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:55:57.811122 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:57.811107    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d5f6c77f-9g2nc: secret "image-registry-tls" not found
Sep 08 14:55:57.811201 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:57.811175    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls podName:9245568a-4c5c-4ffd-96b2-6f85cb27b307 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:59.811155604 +0000 UTC m=+39.143395135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls") pod "image-registry-85d5f6c77f-9g2nc" (UID: "9245568a-4c5c-4ffd-96b2-6f85cb27b307") : secret "image-registry-tls" not found
Sep 08 14:55:58.717876 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:58.717844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:55:58.718361 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:58.718010    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:55:58.718361 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:58.718099    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls podName:2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:02.718075683 +0000 UTC m=+42.050315242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls") pod "dns-default-knvj7" (UID: "2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66") : secret "dns-default-metrics-tls" not found
Sep 08 14:55:59.725705 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:59.725676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bg6cq\" (UID: \"c7bb2240-ebef-48d9-91d3-e85c04baf63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq"
Sep 08 14:55:59.726037 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:59.725717    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-h44k8\" (UID: \"af0780d7-52f1-4ee6-9a32-db285e2c220c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:55:59.726037 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:59.725872    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 14:55:59.726037 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:59.725900    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 14:55:59.726037 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:59.725942    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls podName:c7bb2240-ebef-48d9-91d3-e85c04baf63d nodeName:}" failed. No retries permitted until 2026-09-08 14:56:03.725918714 +0000 UTC m=+43.058158258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-bg6cq" (UID: "c7bb2240-ebef-48d9-91d3-e85c04baf63d") : secret "samples-operator-tls" not found
Sep 08 14:55:59.726037 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:59.725961    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls podName:af0780d7-52f1-4ee6-9a32-db285e2c220c nodeName:}" failed. No retries permitted until 2026-09-08 14:56:03.725952231 +0000 UTC m=+43.058191755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-h44k8" (UID: "af0780d7-52f1-4ee6-9a32-db285e2c220c") : secret "cluster-monitoring-operator-tls" not found
Sep 08 14:55:59.827135 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:55:59.827098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:55:59.827309 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:59.827245    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:55:59.827309 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:59.827262    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d5f6c77f-9g2nc: secret "image-registry-tls" not found
Sep 08 14:55:59.827383 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:55:59.827332    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls podName:9245568a-4c5c-4ffd-96b2-6f85cb27b307 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:03.827300548 +0000 UTC m=+43.159540077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls") pod "image-registry-85d5f6c77f-9g2nc" (UID: "9245568a-4c5c-4ffd-96b2-6f85cb27b307") : secret "image-registry-tls" not found
Sep 08 14:56:00.422296 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:00.422257    2580 generic.go:356] "Generic (PLEG): container finished" podID="b4afab8c-02d7-4bf5-b246-80ee643292f0" containerID="2481b015aa54f95ca959e4d36b9431a290007cc82b1fe4b8c31ec241eccdb810" exitCode=0
Sep 08 14:56:00.422460 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:00.422351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zp8vb" event={"ID":"b4afab8c-02d7-4bf5-b246-80ee643292f0","Type":"ContainerDied","Data":"2481b015aa54f95ca959e4d36b9431a290007cc82b1fe4b8c31ec241eccdb810"}
Sep 08 14:56:00.423917 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:00.423889    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v48sd" event={"ID":"9fec39b5-fe04-4bdf-a96d-e97f8d99f1e6","Type":"ContainerStarted","Data":"bfcacc3826ee3955fd2a451b17cff87afb4c13631858cbf8cc9ffcc10bf71b1a"}
Sep 08 14:56:00.460024 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:00.459972    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v48sd" podStartSLOduration=2.459948747 podStartE2EDuration="6.459953086s" totalImagesPullingTime="4.000004339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:00.45895615 +0000 UTC m=+39.791195696" watchObservedRunningTime="2026-09-08 14:56:00.459953086 +0000 UTC m=+39.792192634"
Sep 08 14:56:01.430148 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.430113    2580 generic.go:356] "Generic (PLEG): container finished" podID="b4afab8c-02d7-4bf5-b246-80ee643292f0" containerID="f32bf932c8ee63f5bf60c22fcfd719b6a87bd153fdf98e44e8fe0977338add3c" exitCode=0
Sep 08 14:56:01.430600 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.430198    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zp8vb" event={"ID":"b4afab8c-02d7-4bf5-b246-80ee643292f0","Type":"ContainerDied","Data":"f32bf932c8ee63f5bf60c22fcfd719b6a87bd153fdf98e44e8fe0977338add3c"}
Sep 08 14:56:01.606687 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.606652    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zk74n"]
Sep 08 14:56:01.630662 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.630620    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zk74n"]
Sep 08 14:56:01.630827 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.630718    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:01.633152 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.633115    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 14:56:01.633414 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.633262    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 14:56:01.633414 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.633271    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 14:56:01.633414 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.633281    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xf5qg\""
Sep 08 14:56:01.633614 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.633413    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 14:56:01.748789 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.748738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-crio-socket\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:01.748994 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.748932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-data-volume\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:01.748994 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.748967    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:01.749107 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.749011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:01.749107 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.749035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcjpv\" (UniqueName: \"kubernetes.io/projected/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-api-access-zcjpv\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:01.849953 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.849914    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-data-volume\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:01.849953 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.849957    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:01.850192 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.849994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:01.850192 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.850018    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcjpv\" (UniqueName: \"kubernetes.io/projected/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-api-access-zcjpv\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:01.850192 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.850054    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-crio-socket\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:01.850192 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:01.850094    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:01.850192 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:01.850158    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls podName:17bdd47e-5354-44a5-a19b-c6d7f6b82cef nodeName:}" failed. No retries permitted until 2026-09-08 14:56:02.35013996 +0000 UTC m=+41.682379498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk74n" (UID: "17bdd47e-5354-44a5-a19b-c6d7f6b82cef") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:01.850192 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:01.850164    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:56:01.850466 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:01.850232    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm podName:17bdd47e-5354-44a5-a19b-c6d7f6b82cef nodeName:}" failed. No retries permitted until 2026-09-08 14:56:02.350216631 +0000 UTC m=+41.682456155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zk74n" (UID: "17bdd47e-5354-44a5-a19b-c6d7f6b82cef") : configmap "kube-rbac-proxy" not found
Sep 08 14:56:01.850466 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.850264    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-crio-socket\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:01.850466 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.850333    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-data-volume\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:01.858200 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:01.858169    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcjpv\" (UniqueName: \"kubernetes.io/projected/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-api-access-zcjpv\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:02.354928 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:02.354891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:02.355086 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:02.355067    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:02.355234 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:02.355217    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:02.355299 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:02.355285    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls podName:17bdd47e-5354-44a5-a19b-c6d7f6b82cef nodeName:}" failed. No retries permitted until 2026-09-08 14:56:03.355266237 +0000 UTC m=+42.687505781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk74n" (UID: "17bdd47e-5354-44a5-a19b-c6d7f6b82cef") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:02.355741 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:02.355720    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:56:02.355849 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:02.355778    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm podName:17bdd47e-5354-44a5-a19b-c6d7f6b82cef nodeName:}" failed. No retries permitted until 2026-09-08 14:56:03.355764013 +0000 UTC m=+42.688003537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zk74n" (UID: "17bdd47e-5354-44a5-a19b-c6d7f6b82cef") : configmap "kube-rbac-proxy" not found
Sep 08 14:56:02.757921 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:02.757892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:56:02.758280 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:02.758063    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:56:02.758280 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:02.758144    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls podName:2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:10.758119874 +0000 UTC m=+50.090359413 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls") pod "dns-default-knvj7" (UID: "2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66") : secret "dns-default-metrics-tls" not found
Sep 08 14:56:03.361868 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:03.361819    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:03.362078 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:03.361963    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:56:03.362078 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:03.361999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:03.362078 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:03.362041    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm podName:17bdd47e-5354-44a5-a19b-c6d7f6b82cef nodeName:}" failed. No retries permitted until 2026-09-08 14:56:05.362019655 +0000 UTC m=+44.694259197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zk74n" (UID: "17bdd47e-5354-44a5-a19b-c6d7f6b82cef") : configmap "kube-rbac-proxy" not found
Sep 08 14:56:03.362222 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:03.362103    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:03.362222 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:03.362157    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls podName:17bdd47e-5354-44a5-a19b-c6d7f6b82cef nodeName:}" failed. No retries permitted until 2026-09-08 14:56:05.362142212 +0000 UTC m=+44.694381741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk74n" (UID: "17bdd47e-5354-44a5-a19b-c6d7f6b82cef") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:03.440160 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:03.440125    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-j96p5" event={"ID":"9b82e7e4-3c40-4c07-9600-e2e6ee9afa81","Type":"ContainerStarted","Data":"9e3cb26219b78721794726144ab935438908fa6bac33ea1466f818f0f4a12c2a"}
Sep 08 14:56:03.443681 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:03.443651    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zp8vb" event={"ID":"b4afab8c-02d7-4bf5-b246-80ee643292f0","Type":"ContainerStarted","Data":"a4759d20ef5ce7f2ee76bb492f0c1392507529e24125e1c368150a6d19a3c3a8"}
Sep 08 14:56:03.454665 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:03.454621    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-j96p5" podStartSLOduration=1.493145599 podStartE2EDuration="7.454608979s" totalImagesPullingTime="5.96146338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:03.454468349 +0000 UTC m=+42.786707895" watchObservedRunningTime="2026-09-08 14:56:03.454608979 +0000 UTC m=+42.786848528"
Sep 08 14:56:03.474925 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:03.474880    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zp8vb" podStartSLOduration=9.281432967 podStartE2EDuration="42.474865442s" totalImagesPullingTime="33.193432475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:03.474152348 +0000 UTC m=+42.806391893" watchObservedRunningTime="2026-09-08 14:56:03.474865442 +0000 UTC m=+42.807104967"
Sep 08 14:56:03.742156 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:03.742127    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qngmr_06b64b48-3059-46f5-bbb9-c29ba4697270/dns-node-resolver/0.log"
Sep 08 14:56:03.765521 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:03.765471    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bg6cq\" (UID: \"c7bb2240-ebef-48d9-91d3-e85c04baf63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq"
Sep 08 14:56:03.765892 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:03.765531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-h44k8\" (UID: \"af0780d7-52f1-4ee6-9a32-db285e2c220c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:56:03.765892 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:03.765621    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 14:56:03.765892 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:03.765637    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 14:56:03.765892 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:03.765685    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls podName:c7bb2240-ebef-48d9-91d3-e85c04baf63d nodeName:}" failed. No retries permitted until 2026-09-08 14:56:11.765668408 +0000 UTC m=+51.097907939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-bg6cq" (UID: "c7bb2240-ebef-48d9-91d3-e85c04baf63d") : secret "samples-operator-tls" not found
Sep 08 14:56:03.765892 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:03.765707    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls podName:af0780d7-52f1-4ee6-9a32-db285e2c220c nodeName:}" failed. No retries permitted until 2026-09-08 14:56:11.765691428 +0000 UTC m=+51.097930953 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-h44k8" (UID: "af0780d7-52f1-4ee6-9a32-db285e2c220c") : secret "cluster-monitoring-operator-tls" not found
Sep 08 14:56:03.866210 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:03.866169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:56:03.866376 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:03.866316    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:56:03.866376 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:03.866338    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d5f6c77f-9g2nc: secret "image-registry-tls" not found
Sep 08 14:56:03.866502 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:03.866396    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls podName:9245568a-4c5c-4ffd-96b2-6f85cb27b307 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:11.866379692 +0000 UTC m=+51.198619218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls") pod "image-registry-85d5f6c77f-9g2nc" (UID: "9245568a-4c5c-4ffd-96b2-6f85cb27b307") : secret "image-registry-tls" not found
Sep 08 14:56:04.341770 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:04.341744    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b64k8_a8fa8fbd-736e-4bf2-a7c7-d9db65334a61/node-ca/0.log"
Sep 08 14:56:05.342349 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.342320    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v48sd_9fec39b5-fe04-4bdf-a96d-e97f8d99f1e6/serve-healthcheck-canary/0.log"
Sep 08 14:56:05.379118 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.379086    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:05.379228 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.379131    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:05.379228 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:05.379220    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:56:05.379323 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:05.379223    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:05.379323 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:05.379271    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm podName:17bdd47e-5354-44a5-a19b-c6d7f6b82cef nodeName:}" failed. No retries permitted until 2026-09-08 14:56:09.379257624 +0000 UTC m=+48.711497148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zk74n" (UID: "17bdd47e-5354-44a5-a19b-c6d7f6b82cef") : configmap "kube-rbac-proxy" not found
Sep 08 14:56:05.379323 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:05.379285    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls podName:17bdd47e-5354-44a5-a19b-c6d7f6b82cef nodeName:}" failed. No retries permitted until 2026-09-08 14:56:09.379278228 +0000 UTC m=+48.711517753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk74n" (UID: "17bdd47e-5354-44a5-a19b-c6d7f6b82cef") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:05.652755 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.652679    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-lngmv"]
Sep 08 14:56:05.676821 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.676786    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-lngmv"]
Sep 08 14:56:05.676975 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.676916    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-lngmv"
Sep 08 14:56:05.680557 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.680535    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 08 14:56:05.680687 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.680631    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 08 14:56:05.680786 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.680770    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 08 14:56:05.680838 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.680774    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 08 14:56:05.684841 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.684819    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7knn6\""
Sep 08 14:56:05.782282 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.782246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcxtq\" (UniqueName: \"kubernetes.io/projected/9ff179f6-87c9-4a38-90d3-659552f507c5-kube-api-access-kcxtq\") pod \"service-ca-75d99c484-lngmv\" (UID: \"9ff179f6-87c9-4a38-90d3-659552f507c5\") " pod="openshift-service-ca/service-ca-75d99c484-lngmv"
Sep 08 14:56:05.782434 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.782381    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9ff179f6-87c9-4a38-90d3-659552f507c5-signing-key\") pod \"service-ca-75d99c484-lngmv\" (UID: \"9ff179f6-87c9-4a38-90d3-659552f507c5\") " pod="openshift-service-ca/service-ca-75d99c484-lngmv"
Sep 08 14:56:05.782481 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.782430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9ff179f6-87c9-4a38-90d3-659552f507c5-signing-cabundle\") pod \"service-ca-75d99c484-lngmv\" (UID: \"9ff179f6-87c9-4a38-90d3-659552f507c5\") " pod="openshift-service-ca/service-ca-75d99c484-lngmv"
Sep 08 14:56:05.882952 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.882910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9ff179f6-87c9-4a38-90d3-659552f507c5-signing-key\") pod \"service-ca-75d99c484-lngmv\" (UID: \"9ff179f6-87c9-4a38-90d3-659552f507c5\") " pod="openshift-service-ca/service-ca-75d99c484-lngmv"
Sep 08 14:56:05.883117 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.882976    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9ff179f6-87c9-4a38-90d3-659552f507c5-signing-cabundle\") pod \"service-ca-75d99c484-lngmv\" (UID: \"9ff179f6-87c9-4a38-90d3-659552f507c5\") " pod="openshift-service-ca/service-ca-75d99c484-lngmv"
Sep 08 14:56:05.883117 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.883010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcxtq\" (UniqueName: \"kubernetes.io/projected/9ff179f6-87c9-4a38-90d3-659552f507c5-kube-api-access-kcxtq\") pod \"service-ca-75d99c484-lngmv\" (UID: \"9ff179f6-87c9-4a38-90d3-659552f507c5\") " pod="openshift-service-ca/service-ca-75d99c484-lngmv"
Sep 08 14:56:05.883826 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.883799    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9ff179f6-87c9-4a38-90d3-659552f507c5-signing-cabundle\") pod \"service-ca-75d99c484-lngmv\" (UID: \"9ff179f6-87c9-4a38-90d3-659552f507c5\") " pod="openshift-service-ca/service-ca-75d99c484-lngmv"
Sep 08 14:56:05.885452 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.885425    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9ff179f6-87c9-4a38-90d3-659552f507c5-signing-key\") pod \"service-ca-75d99c484-lngmv\" (UID: \"9ff179f6-87c9-4a38-90d3-659552f507c5\") " pod="openshift-service-ca/service-ca-75d99c484-lngmv"
Sep 08 14:56:05.891278 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.891255    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcxtq\" (UniqueName: \"kubernetes.io/projected/9ff179f6-87c9-4a38-90d3-659552f507c5-kube-api-access-kcxtq\") pod \"service-ca-75d99c484-lngmv\" (UID: \"9ff179f6-87c9-4a38-90d3-659552f507c5\") " pod="openshift-service-ca/service-ca-75d99c484-lngmv"
Sep 08 14:56:05.987690 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:05.987656    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-lngmv"
Sep 08 14:56:06.275777 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:06.275698    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-lngmv"]
Sep 08 14:56:06.278319 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:56:06.278296    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff179f6_87c9_4a38_90d3_659552f507c5.slice/crio-16097f7af7dd79102550b62fba47820e4b84c2fb624ed471687c3024aa44d306 WatchSource:0}: Error finding container 16097f7af7dd79102550b62fba47820e4b84c2fb624ed471687c3024aa44d306: Status 404 returned error can't find the container with id 16097f7af7dd79102550b62fba47820e4b84c2fb624ed471687c3024aa44d306
Sep 08 14:56:06.452216 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:06.452176    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-lngmv" event={"ID":"9ff179f6-87c9-4a38-90d3-659552f507c5","Type":"ContainerStarted","Data":"16097f7af7dd79102550b62fba47820e4b84c2fb624ed471687c3024aa44d306"}
Sep 08 14:56:09.410939 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:09.410906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:09.411306 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:09.411020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:09.411306 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:09.411050    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:56:09.411306 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:09.411111    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:09.411306 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:09.411127    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm podName:17bdd47e-5354-44a5-a19b-c6d7f6b82cef nodeName:}" failed. No retries permitted until 2026-09-08 14:56:17.411105927 +0000 UTC m=+56.743345466 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zk74n" (UID: "17bdd47e-5354-44a5-a19b-c6d7f6b82cef") : configmap "kube-rbac-proxy" not found
Sep 08 14:56:09.411306 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:09.411148    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls podName:17bdd47e-5354-44a5-a19b-c6d7f6b82cef nodeName:}" failed. No retries permitted until 2026-09-08 14:56:17.411136257 +0000 UTC m=+56.743375781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk74n" (UID: "17bdd47e-5354-44a5-a19b-c6d7f6b82cef") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:09.462390 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:09.462352    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-lngmv" event={"ID":"9ff179f6-87c9-4a38-90d3-659552f507c5","Type":"ContainerStarted","Data":"c528927bb439e5e27d3623152fc0b4f3516d1ad75209012e4aae4958e68827fe"}
Sep 08 14:56:09.479080 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:09.479029    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-lngmv" podStartSLOduration=1.9781023530000001 podStartE2EDuration="4.479011647s" totalImagesPullingTime="2.500909294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:09.477721668 +0000 UTC m=+48.809961214" watchObservedRunningTime="2026-09-08 14:56:09.479011647 +0000 UTC m=+48.811251240"
Sep 08 14:56:10.822031 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:10.821992    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:56:10.822486 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:10.822138    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:56:10.822486 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:10.822204    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls podName:2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:26.822185811 +0000 UTC m=+66.154425334 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls") pod "dns-default-knvj7" (UID: "2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66") : secret "dns-default-metrics-tls" not found
Sep 08 14:56:11.832150 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:11.832098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bg6cq\" (UID: \"c7bb2240-ebef-48d9-91d3-e85c04baf63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq"
Sep 08 14:56:11.832548 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:11.832157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-h44k8\" (UID: \"af0780d7-52f1-4ee6-9a32-db285e2c220c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:56:11.832548 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:11.832305    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 14:56:11.832548 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:11.832375    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls podName:af0780d7-52f1-4ee6-9a32-db285e2c220c nodeName:}" failed. No retries permitted until 2026-09-08 14:56:27.832355019 +0000 UTC m=+67.164594549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-h44k8" (UID: "af0780d7-52f1-4ee6-9a32-db285e2c220c") : secret "cluster-monitoring-operator-tls" not found
Sep 08 14:56:11.834513 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:11.834483    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7bb2240-ebef-48d9-91d3-e85c04baf63d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bg6cq\" (UID: \"c7bb2240-ebef-48d9-91d3-e85c04baf63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq"
Sep 08 14:56:11.916062 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:11.916027    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq"
Sep 08 14:56:11.933455 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:11.933426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:56:11.933603 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:11.933584    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:56:11.933644 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:11.933605    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d5f6c77f-9g2nc: secret "image-registry-tls" not found
Sep 08 14:56:11.933677 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:11.933661    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls podName:9245568a-4c5c-4ffd-96b2-6f85cb27b307 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:27.933645313 +0000 UTC m=+67.265884841 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls") pod "image-registry-85d5f6c77f-9g2nc" (UID: "9245568a-4c5c-4ffd-96b2-6f85cb27b307") : secret "image-registry-tls" not found
Sep 08 14:56:12.202645 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:12.202562    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq"]
Sep 08 14:56:12.472346 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:12.472312    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq" event={"ID":"c7bb2240-ebef-48d9-91d3-e85c04baf63d","Type":"ContainerStarted","Data":"5489b73c326b7431a0aee6cffb6592187f5d4f65f769c6e20dbcaf14b5056703"}
Sep 08 14:56:17.477932 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:17.477898    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:17.478281 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:17.477943    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:17.478281 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:17.478060    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:17.478281 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:17.478127    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls podName:17bdd47e-5354-44a5-a19b-c6d7f6b82cef nodeName:}" failed. No retries permitted until 2026-09-08 14:56:33.478110377 +0000 UTC m=+72.810349920 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk74n" (UID: "17bdd47e-5354-44a5-a19b-c6d7f6b82cef") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:17.478393 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:17.478375    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:17.486958 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:17.486930    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq" event={"ID":"c7bb2240-ebef-48d9-91d3-e85c04baf63d","Type":"ContainerStarted","Data":"4670bd0560f6112a9152d01f490e58e1d274203df84c571de0eae38d2ee7b54c"}
Sep 08 14:56:17.487107 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:17.486981    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq" event={"ID":"c7bb2240-ebef-48d9-91d3-e85c04baf63d","Type":"ContainerStarted","Data":"4fc877045c4e615878af17ea426b5fa047252b8d44616d7ace14039a854f68f5"}
Sep 08 14:56:17.507934 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:17.507872    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bg6cq" podStartSLOduration=17.606116116 podStartE2EDuration="22.507851006s" totalImagesPullingTime="4.90173489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:17.507625248 +0000 UTC m=+56.839864794" watchObservedRunningTime="2026-09-08 14:56:17.507851006 +0000 UTC m=+56.840090552"
Sep 08 14:56:21.408930 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:21.408901    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8c5lk"
Sep 08 14:56:26.847529 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:26.847462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:56:26.849826 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:26.849802    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66-metrics-tls\") pod \"dns-default-knvj7\" (UID: \"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66\") " pod="openshift-dns/dns-default-knvj7"
Sep 08 14:56:26.948167 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:26.948113    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs\") pod \"network-metrics-daemon-6w52g\" (UID: \"95e20c4e-8cd2-4ac0-9364-1065c6c8a10b\") " pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:56:26.948367 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:26.948220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret\") pod \"global-pull-secret-syncer-hjhs7\" (UID: \"cc66186e-7479-4d5f-8e81-fa0d49a60ef1\") " pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:56:26.950582 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:26.950563    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 14:56:26.950636 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:26.950582    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 14:56:26.961472 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:26.961439    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc66186e-7479-4d5f-8e81-fa0d49a60ef1-original-pull-secret\") pod \"global-pull-secret-syncer-hjhs7\" (UID: \"cc66186e-7479-4d5f-8e81-fa0d49a60ef1\") " pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:56:26.961600 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:26.961498    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95e20c4e-8cd2-4ac0-9364-1065c6c8a10b-metrics-certs\") pod \"network-metrics-daemon-6w52g\" (UID: \"95e20c4e-8cd2-4ac0-9364-1065c6c8a10b\") " pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:56:27.049246 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.049209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsrvj\" (UniqueName: \"kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj\") pod \"network-check-target-fjm4v\" (UID: \"d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6\") " pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:56:27.051612 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.051586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsrvj\" (UniqueName: \"kubernetes.io/projected/d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6-kube-api-access-vsrvj\") pod \"network-check-target-fjm4v\" (UID: \"d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6\") " pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:56:27.065866 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.065847    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s4zv9\""
Sep 08 14:56:27.072636 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.072622    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4wbt\""
Sep 08 14:56:27.073668 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.073654    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:56:27.077369 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.077350    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjhs7"
Sep 08 14:56:27.082691 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.082442    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6w52g"
Sep 08 14:56:27.117645 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.117398    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hknbk\""
Sep 08 14:56:27.124824 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.124607    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-knvj7"
Sep 08 14:56:27.136896 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.136484    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85d5f6c77f-9g2nc"]
Sep 08 14:56:27.136896 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:27.136822    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc" podUID="9245568a-4c5c-4ffd-96b2-6f85cb27b307"
Sep 08 14:56:27.158885 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.158719    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6"]
Sep 08 14:56:27.161532 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.161207    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6"
Sep 08 14:56:27.171832 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.171803    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 08 14:56:27.171941 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.171812    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-gqbdv\""
Sep 08 14:56:27.172099 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.172083    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 08 14:56:27.172715 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.172691    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 08 14:56:27.173393 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.173320    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6"]
Sep 08 14:56:27.173393 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.173360    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 08 14:56:27.250427 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.250390    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/afa11fd2-8b48-43a0-85b4-2af64fe05d08-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6\" (UID: \"afa11fd2-8b48-43a0-85b4-2af64fe05d08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6"
Sep 08 14:56:27.250628 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.250437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krqj2\" (UniqueName: \"kubernetes.io/projected/afa11fd2-8b48-43a0-85b4-2af64fe05d08-kube-api-access-krqj2\") pod \"managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6\" (UID: \"afa11fd2-8b48-43a0-85b4-2af64fe05d08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6"
Sep 08 14:56:27.258543 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.258491    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-5zskh"]
Sep 08 14:56:27.260436 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.260420    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-dfcb95cfc-gp5ss"]
Sep 08 14:56:27.260575 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.260556    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-5zskh"
Sep 08 14:56:27.262271 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.262253    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.263126 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.263110    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 14:56:27.263208 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.263174    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5glp5\""
Sep 08 14:56:27.263266 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.263201    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 14:56:27.279349 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.279319    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-5zskh"]
Sep 08 14:56:27.299718 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.299687    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dfcb95cfc-gp5ss"]
Sep 08 14:56:27.351122 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.351090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/091179fe-28c3-4e61-89f9-85470b799854-image-registry-private-configuration\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.351273 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.351129    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krqj2\" (UniqueName: \"kubernetes.io/projected/afa11fd2-8b48-43a0-85b4-2af64fe05d08-kube-api-access-krqj2\") pod \"managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6\" (UID: \"afa11fd2-8b48-43a0-85b4-2af64fe05d08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6"
Sep 08 14:56:27.351273 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.351159    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9hpw\" (UniqueName: \"kubernetes.io/projected/21a8fde4-ee11-4c50-8daf-6fb231d5bb23-kube-api-access-d9hpw\") pod \"downloads-85d98c998f-5zskh\" (UID: \"21a8fde4-ee11-4c50-8daf-6fb231d5bb23\") " pod="openshift-console/downloads-85d98c998f-5zskh"
Sep 08 14:56:27.351273 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.351194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/091179fe-28c3-4e61-89f9-85470b799854-registry-tls\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.351273 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.351211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/091179fe-28c3-4e61-89f9-85470b799854-bound-sa-token\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.351273 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.351249    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/091179fe-28c3-4e61-89f9-85470b799854-registry-certificates\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.351486 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.351303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/091179fe-28c3-4e61-89f9-85470b799854-installation-pull-secrets\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.351486 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.351327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6gt8\" (UniqueName: \"kubernetes.io/projected/091179fe-28c3-4e61-89f9-85470b799854-kube-api-access-m6gt8\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.351486 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.351387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/091179fe-28c3-4e61-89f9-85470b799854-ca-trust-extracted\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.351486 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.351431    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/afa11fd2-8b48-43a0-85b4-2af64fe05d08-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6\" (UID: \"afa11fd2-8b48-43a0-85b4-2af64fe05d08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6"
Sep 08 14:56:27.351486 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.351448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/091179fe-28c3-4e61-89f9-85470b799854-trusted-ca\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.354544 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.354465    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/afa11fd2-8b48-43a0-85b4-2af64fe05d08-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6\" (UID: \"afa11fd2-8b48-43a0-85b4-2af64fe05d08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6"
Sep 08 14:56:27.358803 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.358291    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hjhs7"]
Sep 08 14:56:27.359337 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:56:27.359297    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc66186e_7479_4d5f_8e81_fa0d49a60ef1.slice/crio-9f46271d93dcd6e8fc97be7b7c338e88b3683bc9fab7a659ab2b0044074ce150 WatchSource:0}: Error finding container 9f46271d93dcd6e8fc97be7b7c338e88b3683bc9fab7a659ab2b0044074ce150: Status 404 returned error can't find the container with id 9f46271d93dcd6e8fc97be7b7c338e88b3683bc9fab7a659ab2b0044074ce150
Sep 08 14:56:27.359721 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:56:27.359700    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3acc78c_3c81_4c11_8f8a_f0ae4fd186b6.slice/crio-3ce6cfc0c97a99122cb15e40703fbb14ef3e08ab5d46aa48b9e7c6928753abbb WatchSource:0}: Error finding container 3ce6cfc0c97a99122cb15e40703fbb14ef3e08ab5d46aa48b9e7c6928753abbb: Status 404 returned error can't find the container with id 3ce6cfc0c97a99122cb15e40703fbb14ef3e08ab5d46aa48b9e7c6928753abbb
Sep 08 14:56:27.359904 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.359880    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fjm4v"]
Sep 08 14:56:27.362123 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.362106    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krqj2\" (UniqueName: \"kubernetes.io/projected/afa11fd2-8b48-43a0-85b4-2af64fe05d08-kube-api-access-krqj2\") pod \"managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6\" (UID: \"afa11fd2-8b48-43a0-85b4-2af64fe05d08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6"
Sep 08 14:56:27.370444 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.370395    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6w52g"]
Sep 08 14:56:27.373156 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:56:27.373134    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e20c4e_8cd2_4ac0_9364_1065c6c8a10b.slice/crio-c4434b2d82c413ed57f90b0d67c3f76d54da6239b6e44b2e6fee4025a030bcd6 WatchSource:0}: Error finding container c4434b2d82c413ed57f90b0d67c3f76d54da6239b6e44b2e6fee4025a030bcd6: Status 404 returned error can't find the container with id c4434b2d82c413ed57f90b0d67c3f76d54da6239b6e44b2e6fee4025a030bcd6
Sep 08 14:56:27.426214 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.426182    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-knvj7"]
Sep 08 14:56:27.429764 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:56:27.429737    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b871cd4_c07d_4b3d_bb2f_6e7f6d6d9b66.slice/crio-0265066061d9562973afa5d67e2f37ebeed812a2b843094fee67baea6dfc45d9 WatchSource:0}: Error finding container 0265066061d9562973afa5d67e2f37ebeed812a2b843094fee67baea6dfc45d9: Status 404 returned error can't find the container with id 0265066061d9562973afa5d67e2f37ebeed812a2b843094fee67baea6dfc45d9
Sep 08 14:56:27.452785 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.452754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/091179fe-28c3-4e61-89f9-85470b799854-installation-pull-secrets\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.452785 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.452796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6gt8\" (UniqueName: \"kubernetes.io/projected/091179fe-28c3-4e61-89f9-85470b799854-kube-api-access-m6gt8\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.453028 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.452822    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/091179fe-28c3-4e61-89f9-85470b799854-ca-trust-extracted\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.453028 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.452844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/091179fe-28c3-4e61-89f9-85470b799854-trusted-ca\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.453028 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.452866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/091179fe-28c3-4e61-89f9-85470b799854-image-registry-private-configuration\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.453028 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.453008    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9hpw\" (UniqueName: \"kubernetes.io/projected/21a8fde4-ee11-4c50-8daf-6fb231d5bb23-kube-api-access-d9hpw\") pod \"downloads-85d98c998f-5zskh\" (UID: \"21a8fde4-ee11-4c50-8daf-6fb231d5bb23\") " pod="openshift-console/downloads-85d98c998f-5zskh"
Sep 08 14:56:27.453220 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.453074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/091179fe-28c3-4e61-89f9-85470b799854-registry-tls\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.453220 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.453100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/091179fe-28c3-4e61-89f9-85470b799854-bound-sa-token\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.453220 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.453147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/091179fe-28c3-4e61-89f9-85470b799854-registry-certificates\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.453360 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.453273    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/091179fe-28c3-4e61-89f9-85470b799854-ca-trust-extracted\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.453864 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.453840    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/091179fe-28c3-4e61-89f9-85470b799854-registry-certificates\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.453974 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.453930    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/091179fe-28c3-4e61-89f9-85470b799854-trusted-ca\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.455523 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.455490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/091179fe-28c3-4e61-89f9-85470b799854-image-registry-private-configuration\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.455612 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.455491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/091179fe-28c3-4e61-89f9-85470b799854-registry-tls\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.455651 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.455630    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/091179fe-28c3-4e61-89f9-85470b799854-installation-pull-secrets\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.463498 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.463477    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6gt8\" (UniqueName: \"kubernetes.io/projected/091179fe-28c3-4e61-89f9-85470b799854-kube-api-access-m6gt8\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.464991 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.464962    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/091179fe-28c3-4e61-89f9-85470b799854-bound-sa-token\") pod \"image-registry-dfcb95cfc-gp5ss\" (UID: \"091179fe-28c3-4e61-89f9-85470b799854\") " pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.465071 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.465056    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9hpw\" (UniqueName: \"kubernetes.io/projected/21a8fde4-ee11-4c50-8daf-6fb231d5bb23-kube-api-access-d9hpw\") pod \"downloads-85d98c998f-5zskh\" (UID: \"21a8fde4-ee11-4c50-8daf-6fb231d5bb23\") " pod="openshift-console/downloads-85d98c998f-5zskh"
Sep 08 14:56:27.475969 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.475945    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6"
Sep 08 14:56:27.516945 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.516907    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6w52g" event={"ID":"95e20c4e-8cd2-4ac0-9364-1065c6c8a10b","Type":"ContainerStarted","Data":"c4434b2d82c413ed57f90b0d67c3f76d54da6239b6e44b2e6fee4025a030bcd6"}
Sep 08 14:56:27.518140 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.518107    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hjhs7" event={"ID":"cc66186e-7479-4d5f-8e81-fa0d49a60ef1","Type":"ContainerStarted","Data":"9f46271d93dcd6e8fc97be7b7c338e88b3683bc9fab7a659ab2b0044074ce150"}
Sep 08 14:56:27.519688 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.519652    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fjm4v" event={"ID":"d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6","Type":"ContainerStarted","Data":"3d59da09ecaf1bae664cb7699b74bb87ce6f6630b07756957349f899598a5723"}
Sep 08 14:56:27.519813 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.519692    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fjm4v" event={"ID":"d3acc78c-3c81-4c11-8f8a-f0ae4fd186b6","Type":"ContainerStarted","Data":"3ce6cfc0c97a99122cb15e40703fbb14ef3e08ab5d46aa48b9e7c6928753abbb"}
Sep 08 14:56:27.519813 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.519739    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:56:27.521451 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.521421    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:56:27.521871 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.521707    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-knvj7" event={"ID":"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66","Type":"ContainerStarted","Data":"0265066061d9562973afa5d67e2f37ebeed812a2b843094fee67baea6dfc45d9"}
Sep 08 14:56:27.529138 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.529115    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:56:27.535618 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.535573    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fjm4v" podStartSLOduration=66.535557828 podStartE2EDuration="1m6.535557828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:27.53479656 +0000 UTC m=+66.867036333" watchObservedRunningTime="2026-09-08 14:56:27.535557828 +0000 UTC m=+66.867797373"
Sep 08 14:56:27.553775 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.553744    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9245568a-4c5c-4ffd-96b2-6f85cb27b307-ca-trust-extracted\") pod \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") "
Sep 08 14:56:27.553929 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.553787    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-bound-sa-token\") pod \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") "
Sep 08 14:56:27.553929 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.553812    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9245568a-4c5c-4ffd-96b2-6f85cb27b307-trusted-ca\") pod \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") "
Sep 08 14:56:27.553929 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.553858    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-certificates\") pod \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") "
Sep 08 14:56:27.553929 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.553888    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9245568a-4c5c-4ffd-96b2-6f85cb27b307-image-registry-private-configuration\") pod \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") "
Sep 08 14:56:27.553929 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.553922    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9245568a-4c5c-4ffd-96b2-6f85cb27b307-installation-pull-secrets\") pod \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") "
Sep 08 14:56:27.554175 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.553966    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbdvb\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-kube-api-access-sbdvb\") pod \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") "
Sep 08 14:56:27.554175 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.553997    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9245568a-4c5c-4ffd-96b2-6f85cb27b307-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9245568a-4c5c-4ffd-96b2-6f85cb27b307" (UID: "9245568a-4c5c-4ffd-96b2-6f85cb27b307"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:56:27.554278 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.554215    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9245568a-4c5c-4ffd-96b2-6f85cb27b307-ca-trust-extracted\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:56:27.554342 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.554314    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9245568a-4c5c-4ffd-96b2-6f85cb27b307" (UID: "9245568a-4c5c-4ffd-96b2-6f85cb27b307"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:56:27.554400 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.554380    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9245568a-4c5c-4ffd-96b2-6f85cb27b307-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9245568a-4c5c-4ffd-96b2-6f85cb27b307" (UID: "9245568a-4c5c-4ffd-96b2-6f85cb27b307"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:56:27.556123 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.556092    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-kube-api-access-sbdvb" (OuterVolumeSpecName: "kube-api-access-sbdvb") pod "9245568a-4c5c-4ffd-96b2-6f85cb27b307" (UID: "9245568a-4c5c-4ffd-96b2-6f85cb27b307"). InnerVolumeSpecName "kube-api-access-sbdvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:56:27.556222 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.556123    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9245568a-4c5c-4ffd-96b2-6f85cb27b307" (UID: "9245568a-4c5c-4ffd-96b2-6f85cb27b307"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:56:27.556222 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.556128    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9245568a-4c5c-4ffd-96b2-6f85cb27b307-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9245568a-4c5c-4ffd-96b2-6f85cb27b307" (UID: "9245568a-4c5c-4ffd-96b2-6f85cb27b307"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:56:27.556222 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.556153    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9245568a-4c5c-4ffd-96b2-6f85cb27b307-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9245568a-4c5c-4ffd-96b2-6f85cb27b307" (UID: "9245568a-4c5c-4ffd-96b2-6f85cb27b307"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:56:27.570668 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.570641    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-5zskh"
Sep 08 14:56:27.577653 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.577630    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8vqm8\""
Sep 08 14:56:27.586609 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.586590    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:27.655154 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.655127    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-certificates\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:56:27.655154 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.655152    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9245568a-4c5c-4ffd-96b2-6f85cb27b307-image-registry-private-configuration\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:56:27.655309 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.655161    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9245568a-4c5c-4ffd-96b2-6f85cb27b307-installation-pull-secrets\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:56:27.655309 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.655170    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbdvb\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-kube-api-access-sbdvb\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:56:27.655309 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.655182    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-bound-sa-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:56:27.655309 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.655191    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9245568a-4c5c-4ffd-96b2-6f85cb27b307-trusted-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:56:27.743018 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.742990    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6"]
Sep 08 14:56:27.745761 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:56:27.745738    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafa11fd2_8b48_43a0_85b4_2af64fe05d08.slice/crio-bbcf8f8fb7c9486162d9c73e5a6ce0a265bb7ee458ce52b1b4b80a5b2250cdaf WatchSource:0}: Error finding container bbcf8f8fb7c9486162d9c73e5a6ce0a265bb7ee458ce52b1b4b80a5b2250cdaf: Status 404 returned error can't find the container with id bbcf8f8fb7c9486162d9c73e5a6ce0a265bb7ee458ce52b1b4b80a5b2250cdaf
Sep 08 14:56:27.842457 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.842424    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-5zskh"]
Sep 08 14:56:27.845818 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:56:27.845795    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21a8fde4_ee11_4c50_8daf_6fb231d5bb23.slice/crio-1765bbfa38c840e0b317ef64a090ee9a54908dc4aef750a10428e25d5edb9d5f WatchSource:0}: Error finding container 1765bbfa38c840e0b317ef64a090ee9a54908dc4aef750a10428e25d5edb9d5f: Status 404 returned error can't find the container with id 1765bbfa38c840e0b317ef64a090ee9a54908dc4aef750a10428e25d5edb9d5f
Sep 08 14:56:27.857173 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.857141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-h44k8\" (UID: \"af0780d7-52f1-4ee6-9a32-db285e2c220c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:56:27.860049 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.859998    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af0780d7-52f1-4ee6-9a32-db285e2c220c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-h44k8\" (UID: \"af0780d7-52f1-4ee6-9a32-db285e2c220c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:56:27.860344 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.860320    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dfcb95cfc-gp5ss"]
Sep 08 14:56:27.864087 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:56:27.864060    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod091179fe_28c3_4e61_89f9_85470b799854.slice/crio-19f9d5db8bf0bd5415c693fc79eb1f9ed58583efe1ed7f54e1b0a44c9fb4f22e WatchSource:0}: Error finding container 19f9d5db8bf0bd5415c693fc79eb1f9ed58583efe1ed7f54e1b0a44c9fb4f22e: Status 404 returned error can't find the container with id 19f9d5db8bf0bd5415c693fc79eb1f9ed58583efe1ed7f54e1b0a44c9fb4f22e
Sep 08 14:56:27.957550 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.957501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:56:27.960049 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:27.960026    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls\") pod \"image-registry-85d5f6c77f-9g2nc\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") " pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:56:28.058749 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:28.058707    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls\") pod \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\" (UID: \"9245568a-4c5c-4ffd-96b2-6f85cb27b307\") "
Sep 08 14:56:28.061068 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:28.061033    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9245568a-4c5c-4ffd-96b2-6f85cb27b307" (UID: "9245568a-4c5c-4ffd-96b2-6f85cb27b307"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:56:28.110960 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:28.110896    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vd6mj\""
Sep 08 14:56:28.120005 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:28.119956    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"
Sep 08 14:56:28.159823 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:28.159741    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9245568a-4c5c-4ffd-96b2-6f85cb27b307-registry-tls\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:56:28.398957 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:28.398929    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8"]
Sep 08 14:56:28.403622 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:56:28.403445    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0780d7_52f1_4ee6_9a32_db285e2c220c.slice/crio-58cc312e16dce9119cf26c445bb621a904d2b1f474e9e39b225474753efd51ff WatchSource:0}: Error finding container 58cc312e16dce9119cf26c445bb621a904d2b1f474e9e39b225474753efd51ff: Status 404 returned error can't find the container with id 58cc312e16dce9119cf26c445bb621a904d2b1f474e9e39b225474753efd51ff
Sep 08 14:56:28.528357 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:28.528257    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8" event={"ID":"af0780d7-52f1-4ee6-9a32-db285e2c220c","Type":"ContainerStarted","Data":"58cc312e16dce9119cf26c445bb621a904d2b1f474e9e39b225474753efd51ff"}
Sep 08 14:56:28.531734 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:28.531185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss" event={"ID":"091179fe-28c3-4e61-89f9-85470b799854","Type":"ContainerStarted","Data":"0e0dadcc8036d38d760832f999bae86db2c00e088333c361ec4e5cdd826f23a1"}
Sep 08 14:56:28.531734 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:28.531244    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss" event={"ID":"091179fe-28c3-4e61-89f9-85470b799854","Type":"ContainerStarted","Data":"19f9d5db8bf0bd5415c693fc79eb1f9ed58583efe1ed7f54e1b0a44c9fb4f22e"}
Sep 08 14:56:28.531734 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:28.531454    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:28.533278 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:28.533188    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-5zskh" event={"ID":"21a8fde4-ee11-4c50-8daf-6fb231d5bb23","Type":"ContainerStarted","Data":"1765bbfa38c840e0b317ef64a090ee9a54908dc4aef750a10428e25d5edb9d5f"}
Sep 08 14:56:28.535770 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:28.535370    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6" event={"ID":"afa11fd2-8b48-43a0-85b4-2af64fe05d08","Type":"ContainerStarted","Data":"bbcf8f8fb7c9486162d9c73e5a6ce0a265bb7ee458ce52b1b4b80a5b2250cdaf"}
Sep 08 14:56:28.535770 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:28.535469    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d5f6c77f-9g2nc"
Sep 08 14:56:28.550337 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:28.550289    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss" podStartSLOduration=1.5502693760000001 podStartE2EDuration="1.550269376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:28.548716029 +0000 UTC m=+67.880955577" watchObservedRunningTime="2026-09-08 14:56:28.550269376 +0000 UTC m=+67.882508926"
Sep 08 14:56:28.576531 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:28.576444    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85d5f6c77f-9g2nc"]
Sep 08 14:56:28.579662 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:28.579615    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85d5f6c77f-9g2nc"]
Sep 08 14:56:29.157362 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:29.157140    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9245568a-4c5c-4ffd-96b2-6f85cb27b307" path="/var/lib/kubelet/pods/9245568a-4c5c-4ffd-96b2-6f85cb27b307/volumes"
Sep 08 14:56:30.548365 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:30.548324    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-knvj7" event={"ID":"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66","Type":"ContainerStarted","Data":"df4753c1302315b3b2090dab848735abc2ae919d06af45a89ba6e631602747bd"}
Sep 08 14:56:33.505335 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:33.505299    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:33.507910 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:33.507887    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17bdd47e-5354-44a5-a19b-c6d7f6b82cef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk74n\" (UID: \"17bdd47e-5354-44a5-a19b-c6d7f6b82cef\") " pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:33.744054 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:33.743969    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xf5qg\""
Sep 08 14:56:33.751944 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:33.751912    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zk74n"
Sep 08 14:56:34.841342 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:34.841305    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zk74n"]
Sep 08 14:56:34.845857 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:56:34.845828    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17bdd47e_5354_44a5_a19b_c6d7f6b82cef.slice/crio-26f3f85069fe15ea18b2c1300b392acf8d04073376bc0c65b530d8c40eb33e35 WatchSource:0}: Error finding container 26f3f85069fe15ea18b2c1300b392acf8d04073376bc0c65b530d8c40eb33e35: Status 404 returned error can't find the container with id 26f3f85069fe15ea18b2c1300b392acf8d04073376bc0c65b530d8c40eb33e35
Sep 08 14:56:35.573138 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:35.573003    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6w52g" event={"ID":"95e20c4e-8cd2-4ac0-9364-1065c6c8a10b","Type":"ContainerStarted","Data":"dc19d63da4faa201add0d976ddae25dfa266589ce0067ede553f64ead3e503da"}
Sep 08 14:56:35.573138 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:35.573070    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6w52g" event={"ID":"95e20c4e-8cd2-4ac0-9364-1065c6c8a10b","Type":"ContainerStarted","Data":"7b1e55d7f3d0f269f1eccca97b01e0c275c66591c8771d77344919e7e9891c71"}
Sep 08 14:56:35.575241 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:35.574876    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hjhs7" event={"ID":"cc66186e-7479-4d5f-8e81-fa0d49a60ef1","Type":"ContainerStarted","Data":"389237604ad5c6bff483b51b6268d164f8b451a1ed36715a65cc737ad73aa386"}
Sep 08 14:56:35.576851 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:35.576818    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8" event={"ID":"af0780d7-52f1-4ee6-9a32-db285e2c220c","Type":"ContainerStarted","Data":"e6b4d23ed44987e3b17cd2887a58699f4be462f85f3d83a7f164574cf0ac2a85"}
Sep 08 14:56:35.578844 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:35.578818    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zk74n" event={"ID":"17bdd47e-5354-44a5-a19b-c6d7f6b82cef","Type":"ContainerStarted","Data":"f7dcdad64c32e394665a15f40426741feef5d3d6d540ba5473463b0c2e478633"}
Sep 08 14:56:35.578966 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:35.578873    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zk74n" event={"ID":"17bdd47e-5354-44a5-a19b-c6d7f6b82cef","Type":"ContainerStarted","Data":"26f3f85069fe15ea18b2c1300b392acf8d04073376bc0c65b530d8c40eb33e35"}
Sep 08 14:56:35.580915 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:35.580881    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-knvj7" event={"ID":"2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66","Type":"ContainerStarted","Data":"b8e77fdd8dddf151157ab91f49adb865116638862b38c6f54e706daa216380e8"}
Sep 08 14:56:35.581030 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:35.580949    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-knvj7"
Sep 08 14:56:35.582624 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:35.582597    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6" event={"ID":"afa11fd2-8b48-43a0-85b4-2af64fe05d08","Type":"ContainerStarted","Data":"9eca31d971e6e81e6991e8ef6410c6b25842fd4a23ff13213a5ad9c25c89fae8"}
Sep 08 14:56:35.589322 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:35.589276    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6w52g" podStartSLOduration=67.403389206 podStartE2EDuration="1m14.589258257s" totalImagesPullingTime="7.185869051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:35.58852424 +0000 UTC m=+74.920763999" watchObservedRunningTime="2026-09-08 14:56:35.589258257 +0000 UTC m=+74.921497806"
Sep 08 14:56:35.602592 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:35.602541    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hjhs7" podStartSLOduration=67.403315666 podStartE2EDuration="1m14.602502384s" totalImagesPullingTime="7.199186718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:35.601959292 +0000 UTC m=+74.934198839" watchObservedRunningTime="2026-09-08 14:56:35.602502384 +0000 UTC m=+74.934741932"
Sep 08 14:56:35.615769 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:35.615716    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68c6dbcf46-rxnl6" podStartSLOduration=1.804779186 podStartE2EDuration="8.615699687s" totalImagesPullingTime="6.810920501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:35.61530647 +0000 UTC m=+74.947546017" watchObservedRunningTime="2026-09-08 14:56:35.615699687 +0000 UTC m=+74.947939233"
Sep 08 14:56:35.632465 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:35.632407    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-knvj7" podStartSLOduration=39.446456607 podStartE2EDuration="41.632386159s" totalImagesPullingTime="2.185929552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:35.631425079 +0000 UTC m=+74.963664626" watchObservedRunningTime="2026-09-08 14:56:35.632386159 +0000 UTC m=+74.964625707"
Sep 08 14:56:35.648017 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:35.647954    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-h44k8" podStartSLOduration=34.493489669 podStartE2EDuration="40.647934101s" totalImagesPullingTime="6.154444432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:35.646655902 +0000 UTC m=+74.978895448" watchObservedRunningTime="2026-09-08 14:56:35.647934101 +0000 UTC m=+74.980173648"
Sep 08 14:56:36.588832 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:36.588745    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zk74n" event={"ID":"17bdd47e-5354-44a5-a19b-c6d7f6b82cef","Type":"ContainerStarted","Data":"9345be5559b5295f1936c709a2fd90bd9dd30105dad4c9a59ff00fb4089d44d2"}
Sep 08 14:56:38.600662 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.600618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zk74n" event={"ID":"17bdd47e-5354-44a5-a19b-c6d7f6b82cef","Type":"ContainerStarted","Data":"4af07e612438f05c428beea5109897de0f1a19d2ee58e5b75d39a99cd29a3eb9"}
Sep 08 14:56:38.620884 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.620825    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zk74n" podStartSLOduration=34.947804401 podStartE2EDuration="37.620808133s" totalImagesPullingTime="2.673003732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:56:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:38.62039745 +0000 UTC m=+77.952636997" watchObservedRunningTime="2026-09-08 14:56:38.620808133 +0000 UTC m=+77.953047679"
Sep 08 14:56:38.798819 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.798782    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ccfd7fff5-kwz5x"]
Sep 08 14:56:38.801474 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.801450    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.804574 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.804173    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 14:56:38.804574 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.804201    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 14:56:38.804574 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.804298    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6xplc\""
Sep 08 14:56:38.804574 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.804349    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 14:56:38.804574 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.804493    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 14:56:38.804574 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.804497    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 14:56:38.809588 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.809565    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 14:56:38.812318 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.812297    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ccfd7fff5-kwz5x"]
Sep 08 14:56:38.850042 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.850006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-console-config\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.850197 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.850061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15a0820c-907a-4b1f-a43d-296b5a70096e-console-oauth-config\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.850197 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.850094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v5zl\" (UniqueName: \"kubernetes.io/projected/15a0820c-907a-4b1f-a43d-296b5a70096e-kube-api-access-2v5zl\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.850197 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.850149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-trusted-ca-bundle\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.850197 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.850169    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-oauth-serving-cert\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.850197 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.850188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-service-ca\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.850412 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.850227    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15a0820c-907a-4b1f-a43d-296b5a70096e-console-serving-cert\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.950929 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.950840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-trusted-ca-bundle\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.950929 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.950884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-oauth-serving-cert\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.950929 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.950910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-service-ca\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.951215 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.950941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15a0820c-907a-4b1f-a43d-296b5a70096e-console-serving-cert\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.951215 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.950973    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-console-config\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.951215 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.951021    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15a0820c-907a-4b1f-a43d-296b5a70096e-console-oauth-config\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.951215 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.951040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v5zl\" (UniqueName: \"kubernetes.io/projected/15a0820c-907a-4b1f-a43d-296b5a70096e-kube-api-access-2v5zl\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.951687 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.951655    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-oauth-serving-cert\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.951831 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.951809    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-trusted-ca-bundle\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.952035 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.952015    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-console-config\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.952198 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.952173    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-service-ca\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.954106 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.954080    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15a0820c-907a-4b1f-a43d-296b5a70096e-console-oauth-config\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.954218 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.954190    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15a0820c-907a-4b1f-a43d-296b5a70096e-console-serving-cert\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:38.959174 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:38.959148    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v5zl\" (UniqueName: \"kubernetes.io/projected/15a0820c-907a-4b1f-a43d-296b5a70096e-kube-api-access-2v5zl\") pod \"console-6ccfd7fff5-kwz5x\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") " pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:39.113527 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:39.113485    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:39.591905 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:39.591878    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-knvj7"
Sep 08 14:56:41.333959 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.333922    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-lgngg"]
Sep 08 14:56:41.336466 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.336440    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg"
Sep 08 14:56:41.340017 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.339986    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 08 14:56:41.340186 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.340097    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vx2sr\""
Sep 08 14:56:41.341346 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.341328    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 08 14:56:41.341498 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.341465    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 14:56:41.347698 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.347678    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-lgngg"]
Sep 08 14:56:41.372310 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.372278    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-845fh\" (UniqueName: \"kubernetes.io/projected/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-kube-api-access-845fh\") pod \"prometheus-operator-6f4946db56-lgngg\" (UID: \"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg"
Sep 08 14:56:41.372476 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.372325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-lgngg\" (UID: \"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg"
Sep 08 14:56:41.372476 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.372387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-lgngg\" (UID: \"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg"
Sep 08 14:56:41.372624 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.372501    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-lgngg\" (UID: \"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg"
Sep 08 14:56:41.473818 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.473777    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-lgngg\" (UID: \"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg"
Sep 08 14:56:41.474004 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.473864    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-lgngg\" (UID: \"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg"
Sep 08 14:56:41.474072 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.473988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-845fh\" (UniqueName: \"kubernetes.io/projected/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-kube-api-access-845fh\") pod \"prometheus-operator-6f4946db56-lgngg\" (UID: \"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg"
Sep 08 14:56:41.474072 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.474040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-lgngg\" (UID: \"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg"
Sep 08 14:56:41.474183 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:41.474149    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 08 14:56:41.474264 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:41.474248    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-prometheus-operator-tls podName:4f00f64e-5aa8-4d7e-8ff1-68c5c7484433 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:41.974224632 +0000 UTC m=+81.306464159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-lgngg" (UID: "4f00f64e-5aa8-4d7e-8ff1-68c5c7484433") : secret "prometheus-operator-tls" not found
Sep 08 14:56:41.474734 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.474714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-lgngg\" (UID: \"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg"
Sep 08 14:56:41.476854 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.476829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-lgngg\" (UID: \"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg"
Sep 08 14:56:41.483080 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.483057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-845fh\" (UniqueName: \"kubernetes.io/projected/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-kube-api-access-845fh\") pod \"prometheus-operator-6f4946db56-lgngg\" (UID: \"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg"
Sep 08 14:56:41.979301 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:41.979264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-lgngg\" (UID: \"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg"
Sep 08 14:56:41.979454 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:41.979433    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 08 14:56:41.979540 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:56:41.979531    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-prometheus-operator-tls podName:4f00f64e-5aa8-4d7e-8ff1-68c5c7484433 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:42.979494997 +0000 UTC m=+82.311734538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-lgngg" (UID: "4f00f64e-5aa8-4d7e-8ff1-68c5c7484433") : secret "prometheus-operator-tls" not found
Sep 08 14:56:42.988193 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:42.988150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-lgngg\" (UID: \"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg"
Sep 08 14:56:42.990797 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:42.990771    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f00f64e-5aa8-4d7e-8ff1-68c5c7484433-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-lgngg\" (UID: \"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg"
Sep 08 14:56:43.149348 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:43.149293    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg"
Sep 08 14:56:45.890885 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:45.890763    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-lgngg"]
Sep 08 14:56:45.893893 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:45.893603    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ccfd7fff5-kwz5x"]
Sep 08 14:56:45.894659 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:56:45.894623    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f00f64e_5aa8_4d7e_8ff1_68c5c7484433.slice/crio-f15640a708188737878db2774e9d2220ab458fe38361515569f542d879341d2b WatchSource:0}: Error finding container f15640a708188737878db2774e9d2220ab458fe38361515569f542d879341d2b: Status 404 returned error can't find the container with id f15640a708188737878db2774e9d2220ab458fe38361515569f542d879341d2b
Sep 08 14:56:45.896494 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:56:45.896463    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a0820c_907a_4b1f_a43d_296b5a70096e.slice/crio-0c908951ee71fd431ed613bede441bf2eaf4a645a57fee078bf052a2f5647521 WatchSource:0}: Error finding container 0c908951ee71fd431ed613bede441bf2eaf4a645a57fee078bf052a2f5647521: Status 404 returned error can't find the container with id 0c908951ee71fd431ed613bede441bf2eaf4a645a57fee078bf052a2f5647521
Sep 08 14:56:46.639471 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:46.639425    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-5zskh" event={"ID":"21a8fde4-ee11-4c50-8daf-6fb231d5bb23","Type":"ContainerStarted","Data":"131febd526a548b71839140092b0e8386409bbab68edb0c27d52e7c0a8bcd649"}
Sep 08 14:56:46.642662 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:46.642548    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-5zskh"
Sep 08 14:56:46.645342 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:46.645315    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg" event={"ID":"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433","Type":"ContainerStarted","Data":"f15640a708188737878db2774e9d2220ab458fe38361515569f542d879341d2b"}
Sep 08 14:56:46.647898 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:46.647854    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccfd7fff5-kwz5x" event={"ID":"15a0820c-907a-4b1f-a43d-296b5a70096e","Type":"ContainerStarted","Data":"0c908951ee71fd431ed613bede441bf2eaf4a645a57fee078bf052a2f5647521"}
Sep 08 14:56:46.656803 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:46.656670    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-5zskh"
Sep 08 14:56:46.659448 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:46.659194    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-5zskh" podStartSLOduration=1.7797854850000001 podStartE2EDuration="19.659133108s" totalImagesPullingTime="17.879347623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:46.657353432 +0000 UTC m=+85.989592978" watchObservedRunningTime="2026-09-08 14:56:46.659133108 +0000 UTC m=+85.991372645"
Sep 08 14:56:49.547481 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:49.547456    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-dfcb95cfc-gp5ss"
Sep 08 14:56:49.663964 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:49.663625    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg" event={"ID":"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433","Type":"ContainerStarted","Data":"6ee88065636a8f5ff60282015aca4eb4a0be869f2c78963ec5116c28954ac799"}
Sep 08 14:56:50.670013 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:50.669973    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg" event={"ID":"4f00f64e-5aa8-4d7e-8ff1-68c5c7484433","Type":"ContainerStarted","Data":"5ae216e72f0283f69e58cf714be5d8b6890b3a7ff5304fcf70489f13c3783af8"}
Sep 08 14:56:50.672034 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:50.672006    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccfd7fff5-kwz5x" event={"ID":"15a0820c-907a-4b1f-a43d-296b5a70096e","Type":"ContainerStarted","Data":"fb0af13497c8cf8bab1760e72e177c47bca5540aa16eeee63dc4002eb613fa0c"}
Sep 08 14:56:50.688051 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:50.687995    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-lgngg" podStartSLOduration=6.037037008 podStartE2EDuration="9.687974916s" totalImagesPullingTime="3.650937908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:50.687609282 +0000 UTC m=+90.019848829" watchObservedRunningTime="2026-09-08 14:56:50.687974916 +0000 UTC m=+90.020214462"
Sep 08 14:56:50.704839 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:50.704776    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ccfd7fff5-kwz5x" podStartSLOduration=8.627080749 podStartE2EDuration="12.704754774s" totalImagesPullingTime="4.077674025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:50.704006862 +0000 UTC m=+90.036246408" watchObservedRunningTime="2026-09-08 14:56:50.704754774 +0000 UTC m=+90.036994323"
Sep 08 14:56:52.712945 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.712911    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bhdbr"]
Sep 08 14:56:52.752636 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.752606    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.755717 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.755692    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6k5q8\""
Sep 08 14:56:52.756325 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.756309    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 14:56:52.756586 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.756459    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 14:56:52.756747 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.756731    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 14:56:52.873342 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.873288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/106ef39d-941e-49e7-9763-e27bfd453144-metrics-client-ca\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.873568 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.873365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/106ef39d-941e-49e7-9763-e27bfd453144-root\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.873568 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.873415    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/106ef39d-941e-49e7-9763-e27bfd453144-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.873568 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.873454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/106ef39d-941e-49e7-9763-e27bfd453144-sys\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.873568 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.873478    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/106ef39d-941e-49e7-9763-e27bfd453144-node-exporter-textfile\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.873568 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.873531    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/106ef39d-941e-49e7-9763-e27bfd453144-node-exporter-accelerators-collector-config\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.873840 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.873560    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/106ef39d-941e-49e7-9763-e27bfd453144-node-exporter-tls\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.873840 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.873644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/106ef39d-941e-49e7-9763-e27bfd453144-node-exporter-wtmp\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.873840 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.873685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bnz8\" (UniqueName: \"kubernetes.io/projected/106ef39d-941e-49e7-9763-e27bfd453144-kube-api-access-4bnz8\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.974866 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.974817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/106ef39d-941e-49e7-9763-e27bfd453144-node-exporter-accelerators-collector-config\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.974866 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.974871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/106ef39d-941e-49e7-9763-e27bfd453144-node-exporter-tls\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.975123 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.974966    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/106ef39d-941e-49e7-9763-e27bfd453144-node-exporter-wtmp\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.975123 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.974989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bnz8\" (UniqueName: \"kubernetes.io/projected/106ef39d-941e-49e7-9763-e27bfd453144-kube-api-access-4bnz8\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.975123 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.975014    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/106ef39d-941e-49e7-9763-e27bfd453144-metrics-client-ca\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.975123 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.975038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/106ef39d-941e-49e7-9763-e27bfd453144-root\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.975123 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.975064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/106ef39d-941e-49e7-9763-e27bfd453144-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.975123 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.975092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/106ef39d-941e-49e7-9763-e27bfd453144-sys\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.975123 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.975106    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/106ef39d-941e-49e7-9763-e27bfd453144-node-exporter-textfile\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.975455 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.975435    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/106ef39d-941e-49e7-9763-e27bfd453144-node-exporter-textfile\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.976044 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.976019    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/106ef39d-941e-49e7-9763-e27bfd453144-node-exporter-accelerators-collector-config\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.978541 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.976770    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/106ef39d-941e-49e7-9763-e27bfd453144-root\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.978541 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.976913    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/106ef39d-941e-49e7-9763-e27bfd453144-metrics-client-ca\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.978541 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.976912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/106ef39d-941e-49e7-9763-e27bfd453144-node-exporter-wtmp\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.978541 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.977005    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/106ef39d-941e-49e7-9763-e27bfd453144-sys\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.985582 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.983910    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/106ef39d-941e-49e7-9763-e27bfd453144-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.987537 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.987101    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bnz8\" (UniqueName: \"kubernetes.io/projected/106ef39d-941e-49e7-9763-e27bfd453144-kube-api-access-4bnz8\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:52.999373 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:52.996829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/106ef39d-941e-49e7-9763-e27bfd453144-node-exporter-tls\") pod \"node-exporter-bhdbr\" (UID: \"106ef39d-941e-49e7-9763-e27bfd453144\") " pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:53.073660 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:53.073617    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bhdbr"
Sep 08 14:56:53.687708 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:53.687662    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhdbr" event={"ID":"106ef39d-941e-49e7-9763-e27bfd453144","Type":"ContainerStarted","Data":"520400fcd8617c7778b6f6a6f35683b331c65d4cd0436ece4db4024296743b8d"}
Sep 08 14:56:56.701370 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:56.701337    2580 generic.go:356] "Generic (PLEG): container finished" podID="106ef39d-941e-49e7-9763-e27bfd453144" containerID="f6eb1314e1671faa0561cf54006897f49612e480ca7df98a42457ee28fdb16de" exitCode=0
Sep 08 14:56:56.701828 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:56.701383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhdbr" event={"ID":"106ef39d-941e-49e7-9763-e27bfd453144","Type":"ContainerDied","Data":"f6eb1314e1671faa0561cf54006897f49612e480ca7df98a42457ee28fdb16de"}
Sep 08 14:56:57.494955 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.494921    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-fvmdp"]
Sep 08 14:56:57.514713 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.514678    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ccfd7fff5-kwz5x"]
Sep 08 14:56:57.514874 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.514800    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fvmdp"
Sep 08 14:56:57.518201 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.518177    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 08 14:56:57.518567 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.518551    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jq9n6\""
Sep 08 14:56:57.524200 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.524175    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-fvmdp"]
Sep 08 14:56:57.547941 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.547913    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67755d8699-zmxbk"]
Sep 08 14:56:57.572628 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.572598    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67755d8699-zmxbk"]
Sep 08 14:56:57.572765 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.572695    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.618026 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.617995    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc4r5\" (UniqueName: \"kubernetes.io/projected/4ff46f58-6f12-4fcc-9ecc-46870e168246-kube-api-access-fc4r5\") pod \"monitoring-plugin-85bbbbbf4-fvmdp\" (UID: \"4ff46f58-6f12-4fcc-9ecc-46870e168246\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fvmdp"
Sep 08 14:56:57.618178 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.618036    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ff46f58-6f12-4fcc-9ecc-46870e168246-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-fvmdp\" (UID: \"4ff46f58-6f12-4fcc-9ecc-46870e168246\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fvmdp"
Sep 08 14:56:57.707045 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.707008    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhdbr" event={"ID":"106ef39d-941e-49e7-9763-e27bfd453144","Type":"ContainerStarted","Data":"6c91f18580ad281af250782a212f9f7d3a4c8c0b9ebb81a85c99b8350b1c1a3d"}
Sep 08 14:56:57.707473 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.707059    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhdbr" event={"ID":"106ef39d-941e-49e7-9763-e27bfd453144","Type":"ContainerStarted","Data":"9d188d5427d36fb43efb5c6543a3e952e200e33075fba430834d3b806d347c56"}
Sep 08 14:56:57.718765 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.718740    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-oauth-config\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.718872 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.718792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxprx\" (UniqueName: \"kubernetes.io/projected/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-kube-api-access-jxprx\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.718872 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.718809    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-service-ca\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.718872 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.718832    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc4r5\" (UniqueName: \"kubernetes.io/projected/4ff46f58-6f12-4fcc-9ecc-46870e168246-kube-api-access-fc4r5\") pod \"monitoring-plugin-85bbbbbf4-fvmdp\" (UID: \"4ff46f58-6f12-4fcc-9ecc-46870e168246\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fvmdp"
Sep 08 14:56:57.718872 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.718856    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-serving-cert\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.719068 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.718877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-trusted-ca-bundle\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.719068 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.718899    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-oauth-serving-cert\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.719068 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.718915    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ff46f58-6f12-4fcc-9ecc-46870e168246-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-fvmdp\" (UID: \"4ff46f58-6f12-4fcc-9ecc-46870e168246\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fvmdp"
Sep 08 14:56:57.719068 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.718951    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-config\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.721417 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.721394    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ff46f58-6f12-4fcc-9ecc-46870e168246-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-fvmdp\" (UID: \"4ff46f58-6f12-4fcc-9ecc-46870e168246\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fvmdp"
Sep 08 14:56:57.727600 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.727557    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bhdbr" podStartSLOduration=2.633395696 podStartE2EDuration="5.727543759s" totalImagesPullingTime="3.011168368s" totalInitContainerRuntime="82.979695ms" isStatefulPod=true podCreationTimestamp="2026-09-08 14:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:57.725671547 +0000 UTC m=+97.057911106" watchObservedRunningTime="2026-09-08 14:56:57.727543759 +0000 UTC m=+97.059783306"
Sep 08 14:56:57.733699 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.733673    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc4r5\" (UniqueName: \"kubernetes.io/projected/4ff46f58-6f12-4fcc-9ecc-46870e168246-kube-api-access-fc4r5\") pod \"monitoring-plugin-85bbbbbf4-fvmdp\" (UID: \"4ff46f58-6f12-4fcc-9ecc-46870e168246\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fvmdp"
Sep 08 14:56:57.819913 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.819826    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-trusted-ca-bundle\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.819913 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.819864    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-oauth-serving-cert\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.819913 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.819899    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-config\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.820196 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.820071    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-oauth-config\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.820196 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.820173    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxprx\" (UniqueName: \"kubernetes.io/projected/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-kube-api-access-jxprx\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.820309 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.820227    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-service-ca\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.820309 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.820275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-serving-cert\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.820841 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.820809    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-trusted-ca-bundle\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.820953 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.820852    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-config\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.821030 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.820977    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-service-ca\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.821147 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.821104    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-oauth-serving-cert\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.823563 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.823496    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-oauth-config\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.824100 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.824081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-serving-cert\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.825313 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.825300    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fvmdp"
Sep 08 14:56:57.828343 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.828327    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxprx\" (UniqueName: \"kubernetes.io/projected/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-kube-api-access-jxprx\") pod \"console-67755d8699-zmxbk\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") " pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:57.881528 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:57.881484    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:56:58.125218 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.125191    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-fvmdp"]
Sep 08 14:56:58.127359 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:56:58.127336    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff46f58_6f12_4fcc_9ecc_46870e168246.slice/crio-663dc5f4b82cd519b9cf36d409dc3431e79b623d1f57602d861d65fd72f73d29 WatchSource:0}: Error finding container 663dc5f4b82cd519b9cf36d409dc3431e79b623d1f57602d861d65fd72f73d29: Status 404 returned error can't find the container with id 663dc5f4b82cd519b9cf36d409dc3431e79b623d1f57602d861d65fd72f73d29
Sep 08 14:56:58.179449 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.179416    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67755d8699-zmxbk"]
Sep 08 14:56:58.182388 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:56:58.182362    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37fc6f66_4b74_4162_acab_d3d6c0a41aa2.slice/crio-c61f489808d3d0d9618cdb656438065786d9d22cbbe9b43057998ed33c242a42 WatchSource:0}: Error finding container c61f489808d3d0d9618cdb656438065786d9d22cbbe9b43057998ed33c242a42: Status 404 returned error can't find the container with id c61f489808d3d0d9618cdb656438065786d9d22cbbe9b43057998ed33c242a42
Sep 08 14:56:58.537910 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.537881    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fjm4v"
Sep 08 14:56:58.712399 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.712364    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fvmdp" event={"ID":"4ff46f58-6f12-4fcc-9ecc-46870e168246","Type":"ContainerStarted","Data":"663dc5f4b82cd519b9cf36d409dc3431e79b623d1f57602d861d65fd72f73d29"}
Sep 08 14:56:58.714389 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.714355    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67755d8699-zmxbk" event={"ID":"37fc6f66-4b74-4162-acab-d3d6c0a41aa2","Type":"ContainerStarted","Data":"a1652e07f53ecb32b4ec9dda16236db6a91aecaf28d0d399d539702ae372b664"}
Sep 08 14:56:58.714545 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.714410    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67755d8699-zmxbk" event={"ID":"37fc6f66-4b74-4162-acab-d3d6c0a41aa2","Type":"ContainerStarted","Data":"c61f489808d3d0d9618cdb656438065786d9d22cbbe9b43057998ed33c242a42"}
Sep 08 14:56:58.732780 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.732730    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67755d8699-zmxbk" podStartSLOduration=1.7327123210000002 podStartE2EDuration="1.732712321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:58.731046415 +0000 UTC m=+98.063285962" watchObservedRunningTime="2026-09-08 14:56:58.732712321 +0000 UTC m=+98.064951866"
Sep 08 14:56:58.885996 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.885912    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 14:56:58.910520 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.910471    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 14:56:58.910686 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.910663    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:58.914452 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.914391    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 08 14:56:58.914783 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.914761    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 08 14:56:58.914931 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.914912    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 08 14:56:58.915001 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.914771    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 08 14:56:58.915001 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.914988    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 08 14:56:58.915102 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.915005    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 08 14:56:58.915102 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.914828    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 08 14:56:58.915102 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.914874    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 08 14:56:58.915102 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.914883    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7k182518g5ve4\""
Sep 08 14:56:58.915102 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.914915    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 08 14:56:58.915336 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.914773    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 08 14:56:58.915701 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.915677    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 08 14:56:58.916184 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.916119    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8lbtv\""
Sep 08 14:56:58.916289 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.916214    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 08 14:56:58.916289 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.916218    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 08 14:56:58.916440 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.916270    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 08 14:56:58.917990 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:58.917971    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 08 14:56:59.031236 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.031406 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.031406 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be148675-7ffb-429d-8571-ef41a0bf5ac0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.031406 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031309    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be148675-7ffb-429d-8571-ef41a0bf5ac0-config-out\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.031406 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-config\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.031406 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.031406 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031391    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.031735 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031418    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.031735 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.031735 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031472    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.031735 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjw95\" (UniqueName: \"kubernetes.io/projected/be148675-7ffb-429d-8571-ef41a0bf5ac0-kube-api-access-xjw95\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.031735 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/be148675-7ffb-429d-8571-ef41a0bf5ac0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.031735 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031610    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.031735 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.031735 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031719    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.032088 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031763    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.032088 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-web-config\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.032088 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.032088 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031884    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.032088 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.031905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.114191 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.114149    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:56:59.132788 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.132751    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.132967 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.132800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.132967 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.132834    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-web-config\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.132967 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.132862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.132967 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.132897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133218 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133218 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133218 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133218 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be148675-7ffb-429d-8571-ef41a0bf5ac0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133218 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133205    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be148675-7ffb-429d-8571-ef41a0bf5ac0-config-out\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133465 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-config\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133465 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133465 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133299    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133465 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133465 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133465 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133465 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjw95\" (UniqueName: \"kubernetes.io/projected/be148675-7ffb-429d-8571-ef41a0bf5ac0-kube-api-access-xjw95\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133465 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133446    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/be148675-7ffb-429d-8571-ef41a0bf5ac0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133852 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133852 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133852 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133657    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.133852 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.133811    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.134463 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.134439    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.135136 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.135114    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.136288 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.136225    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-web-config\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.136433 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.136408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.136502 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.136481    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.136772 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.136744    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.137146 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.137120    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.137982 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.137953    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.138586 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.138237    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/be148675-7ffb-429d-8571-ef41a0bf5ac0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.138586 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.138461    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-config\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.138586 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.138545    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.138960 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.138934    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.139294 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.139243    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be148675-7ffb-429d-8571-ef41a0bf5ac0-config-out\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.139294 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.139270    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be148675-7ffb-429d-8571-ef41a0bf5ac0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.141418 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.141233    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.141632 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.141613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be148675-7ffb-429d-8571-ef41a0bf5ac0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.141700 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.141656    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/be148675-7ffb-429d-8571-ef41a0bf5ac0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.147629 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.147610    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjw95\" (UniqueName: \"kubernetes.io/projected/be148675-7ffb-429d-8571-ef41a0bf5ac0-kube-api-access-xjw95\") pod \"prometheus-k8s-0\" (UID: \"be148675-7ffb-429d-8571-ef41a0bf5ac0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.224710 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.224671    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:56:59.547213 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.547179    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 14:56:59.551822 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:56:59.551796    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe148675_7ffb_429d_8571_ef41a0bf5ac0.slice/crio-a70b3d5d9a7a91f46f6e5c864330fdb15c42b23ec67f90551223d6800c44f5a1 WatchSource:0}: Error finding container a70b3d5d9a7a91f46f6e5c864330fdb15c42b23ec67f90551223d6800c44f5a1: Status 404 returned error can't find the container with id a70b3d5d9a7a91f46f6e5c864330fdb15c42b23ec67f90551223d6800c44f5a1
Sep 08 14:56:59.718965 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:56:59.718931    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be148675-7ffb-429d-8571-ef41a0bf5ac0","Type":"ContainerStarted","Data":"a70b3d5d9a7a91f46f6e5c864330fdb15c42b23ec67f90551223d6800c44f5a1"}
Sep 08 14:57:02.733827 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:02.733794    2580 generic.go:356] "Generic (PLEG): container finished" podID="be148675-7ffb-429d-8571-ef41a0bf5ac0" containerID="2d962c0941e341548c20d386d6c1796de9f21573d7b283d8271978c28dfc7b4f" exitCode=0
Sep 08 14:57:02.734248 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:02.733882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be148675-7ffb-429d-8571-ef41a0bf5ac0","Type":"ContainerDied","Data":"2d962c0941e341548c20d386d6c1796de9f21573d7b283d8271978c28dfc7b4f"}
Sep 08 14:57:02.735562 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:02.735535    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fvmdp" event={"ID":"4ff46f58-6f12-4fcc-9ecc-46870e168246","Type":"ContainerStarted","Data":"92879f8010bba65396bee5fb31dd608840d2ca3b69f75b21b5d43ef99f7b91c1"}
Sep 08 14:57:02.735673 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:02.735594    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fvmdp"
Sep 08 14:57:02.740786 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:02.740764    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fvmdp"
Sep 08 14:57:02.777310 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:02.777258    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-fvmdp" podStartSLOduration=2.214009813 podStartE2EDuration="5.777241911s" totalImagesPullingTime="3.563232098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:57:02.776039191 +0000 UTC m=+102.108278739" watchObservedRunningTime="2026-09-08 14:57:02.777241911 +0000 UTC m=+102.109481478"
Sep 08 14:57:03.341064 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:03.341029    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67755d8699-zmxbk"]
Sep 08 14:57:06.759062 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:06.759027    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be148675-7ffb-429d-8571-ef41a0bf5ac0","Type":"ContainerStarted","Data":"a9acf46797c0b85d6b7573bb4a255f06ec7f6cde3588fef9403cf6a9fd4378cb"}
Sep 08 14:57:07.768727 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:07.768686    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be148675-7ffb-429d-8571-ef41a0bf5ac0","Type":"ContainerStarted","Data":"1dd9f41af3cd65effa47488f999948d5a128eb1fe11bf2d66531edc530c72ae2"}
Sep 08 14:57:07.882636 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:07.882603    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:57:09.784477 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:09.784392    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be148675-7ffb-429d-8571-ef41a0bf5ac0","Type":"ContainerStarted","Data":"56976dec26b12960a1eaadebf005be759445b68d3a70b8715e9a00238eb3fd46"}
Sep 08 14:57:09.784477 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:09.784458    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be148675-7ffb-429d-8571-ef41a0bf5ac0","Type":"ContainerStarted","Data":"6a8a73f5274f93fcf3b29ed01fa5ddd8562f9690781cf143ab2033e0cda0e749"}
Sep 08 14:57:09.784892 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:09.784492    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be148675-7ffb-429d-8571-ef41a0bf5ac0","Type":"ContainerStarted","Data":"49248f344801005c087005dd743e4b311c63f3cd3af81d130ce27c2d26be7139"}
Sep 08 14:57:09.784892 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:09.784542    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be148675-7ffb-429d-8571-ef41a0bf5ac0","Type":"ContainerStarted","Data":"37d17ac7424af42261ccf3240fe47d663b3783c9de0dd07a1ace5affd5af2a6c"}
Sep 08 14:57:09.821475 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:09.821419    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.456307724 podStartE2EDuration="11.821401976s" totalImagesPullingTime="8.341539092s" totalInitContainerRuntime="23.55516ms" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:57:09.819022139 +0000 UTC m=+109.151261719" watchObservedRunningTime="2026-09-08 14:57:09.821401976 +0000 UTC m=+109.153641522"
Sep 08 14:57:14.225216 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:14.225176    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:57:22.536392 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.536322    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6ccfd7fff5-kwz5x" podUID="15a0820c-907a-4b1f-a43d-296b5a70096e" containerName="console" containerID="cri-o://fb0af13497c8cf8bab1760e72e177c47bca5540aa16eeee63dc4002eb613fa0c" gracePeriod=15
Sep 08 14:57:22.804919 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.804847    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:57:22.835457 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.835419    2580 generic.go:356] "Generic (PLEG): container finished" podID="15a0820c-907a-4b1f-a43d-296b5a70096e" containerID="fb0af13497c8cf8bab1760e72e177c47bca5540aa16eeee63dc4002eb613fa0c" exitCode=0
Sep 08 14:57:22.835457 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.835448    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccfd7fff5-kwz5x"
Sep 08 14:57:22.835666 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.835488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccfd7fff5-kwz5x" event={"ID":"15a0820c-907a-4b1f-a43d-296b5a70096e","Type":"ContainerDied","Data":"fb0af13497c8cf8bab1760e72e177c47bca5540aa16eeee63dc4002eb613fa0c"}
Sep 08 14:57:22.835666 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.835557    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccfd7fff5-kwz5x" event={"ID":"15a0820c-907a-4b1f-a43d-296b5a70096e","Type":"ContainerDied","Data":"0c908951ee71fd431ed613bede441bf2eaf4a645a57fee078bf052a2f5647521"}
Sep 08 14:57:22.835666 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.835580    2580 scope.go:117] "RemoveContainer" containerID="fb0af13497c8cf8bab1760e72e177c47bca5540aa16eeee63dc4002eb613fa0c"
Sep 08 14:57:22.844095 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.844071    2580 scope.go:117] "RemoveContainer" containerID="fb0af13497c8cf8bab1760e72e177c47bca5540aa16eeee63dc4002eb613fa0c"
Sep 08 14:57:22.844431 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:57:22.844410    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb0af13497c8cf8bab1760e72e177c47bca5540aa16eeee63dc4002eb613fa0c\": container with ID starting with fb0af13497c8cf8bab1760e72e177c47bca5540aa16eeee63dc4002eb613fa0c not found: ID does not exist" containerID="fb0af13497c8cf8bab1760e72e177c47bca5540aa16eeee63dc4002eb613fa0c"
Sep 08 14:57:22.844548 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.844444    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb0af13497c8cf8bab1760e72e177c47bca5540aa16eeee63dc4002eb613fa0c"} err="failed to get container status \"fb0af13497c8cf8bab1760e72e177c47bca5540aa16eeee63dc4002eb613fa0c\": rpc error: code = NotFound desc = could not find container \"fb0af13497c8cf8bab1760e72e177c47bca5540aa16eeee63dc4002eb613fa0c\": container with ID starting with fb0af13497c8cf8bab1760e72e177c47bca5540aa16eeee63dc4002eb613fa0c not found: ID does not exist"
Sep 08 14:57:22.849733 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.849712    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-trusted-ca-bundle\") pod \"15a0820c-907a-4b1f-a43d-296b5a70096e\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") "
Sep 08 14:57:22.849795 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.849754    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-service-ca\") pod \"15a0820c-907a-4b1f-a43d-296b5a70096e\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") "
Sep 08 14:57:22.849795 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.849789    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-console-config\") pod \"15a0820c-907a-4b1f-a43d-296b5a70096e\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") "
Sep 08 14:57:22.849918 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.849898    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15a0820c-907a-4b1f-a43d-296b5a70096e-console-oauth-config\") pod \"15a0820c-907a-4b1f-a43d-296b5a70096e\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") "
Sep 08 14:57:22.849965 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.849956    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15a0820c-907a-4b1f-a43d-296b5a70096e-console-serving-cert\") pod \"15a0820c-907a-4b1f-a43d-296b5a70096e\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") "
Sep 08 14:57:22.850020 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.850006    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-oauth-serving-cert\") pod \"15a0820c-907a-4b1f-a43d-296b5a70096e\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") "
Sep 08 14:57:22.850093 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.850078    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2v5zl\" (UniqueName: \"kubernetes.io/projected/15a0820c-907a-4b1f-a43d-296b5a70096e-kube-api-access-2v5zl\") pod \"15a0820c-907a-4b1f-a43d-296b5a70096e\" (UID: \"15a0820c-907a-4b1f-a43d-296b5a70096e\") "
Sep 08 14:57:22.850165 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.850141    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-console-config" (OuterVolumeSpecName: "console-config") pod "15a0820c-907a-4b1f-a43d-296b5a70096e" (UID: "15a0820c-907a-4b1f-a43d-296b5a70096e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:22.850165 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.850150    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "15a0820c-907a-4b1f-a43d-296b5a70096e" (UID: "15a0820c-907a-4b1f-a43d-296b5a70096e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:22.850273 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.850155    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-service-ca" (OuterVolumeSpecName: "service-ca") pod "15a0820c-907a-4b1f-a43d-296b5a70096e" (UID: "15a0820c-907a-4b1f-a43d-296b5a70096e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:22.850415 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.850394    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "15a0820c-907a-4b1f-a43d-296b5a70096e" (UID: "15a0820c-907a-4b1f-a43d-296b5a70096e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:22.850495 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.850480    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-oauth-serving-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:57:22.850575 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.850503    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-trusted-ca-bundle\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:57:22.850575 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.850537    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:57:22.850575 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.850551    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15a0820c-907a-4b1f-a43d-296b5a70096e-console-config\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:57:22.852174 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.852153    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15a0820c-907a-4b1f-a43d-296b5a70096e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "15a0820c-907a-4b1f-a43d-296b5a70096e" (UID: "15a0820c-907a-4b1f-a43d-296b5a70096e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:57:22.852251 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.852207    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15a0820c-907a-4b1f-a43d-296b5a70096e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "15a0820c-907a-4b1f-a43d-296b5a70096e" (UID: "15a0820c-907a-4b1f-a43d-296b5a70096e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:57:22.852293 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.852268    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15a0820c-907a-4b1f-a43d-296b5a70096e-kube-api-access-2v5zl" (OuterVolumeSpecName: "kube-api-access-2v5zl") pod "15a0820c-907a-4b1f-a43d-296b5a70096e" (UID: "15a0820c-907a-4b1f-a43d-296b5a70096e"). InnerVolumeSpecName "kube-api-access-2v5zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:22.951702 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.951658    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2v5zl\" (UniqueName: \"kubernetes.io/projected/15a0820c-907a-4b1f-a43d-296b5a70096e-kube-api-access-2v5zl\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:57:22.951702 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.951694    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15a0820c-907a-4b1f-a43d-296b5a70096e-console-oauth-config\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:57:22.951702 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:22.951709    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15a0820c-907a-4b1f-a43d-296b5a70096e-console-serving-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:57:23.157911 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:23.157858    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ccfd7fff5-kwz5x"]
Sep 08 14:57:23.159233 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:23.159208    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ccfd7fff5-kwz5x"]
Sep 08 14:57:25.155399 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:25.155358    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15a0820c-907a-4b1f-a43d-296b5a70096e" path="/var/lib/kubelet/pods/15a0820c-907a-4b1f-a43d-296b5a70096e/volumes"
Sep 08 14:57:28.360118 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.360059    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67755d8699-zmxbk" podUID="37fc6f66-4b74-4162-acab-d3d6c0a41aa2" containerName="console" containerID="cri-o://a1652e07f53ecb32b4ec9dda16236db6a91aecaf28d0d399d539702ae372b664" gracePeriod=15
Sep 08 14:57:28.632468 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.632394    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:57:28.699645 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.699610    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-config\") pod \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") "
Sep 08 14:57:28.699846 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.699664    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-oauth-config\") pod \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") "
Sep 08 14:57:28.699846 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.699701    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-oauth-serving-cert\") pod \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") "
Sep 08 14:57:28.699846 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.699741    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-service-ca\") pod \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") "
Sep 08 14:57:28.699846 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.699773    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxprx\" (UniqueName: \"kubernetes.io/projected/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-kube-api-access-jxprx\") pod \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") "
Sep 08 14:57:28.699846 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.699823    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-serving-cert\") pod \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") "
Sep 08 14:57:28.700095 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.699867    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-trusted-ca-bundle\") pod \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\" (UID: \"37fc6f66-4b74-4162-acab-d3d6c0a41aa2\") "
Sep 08 14:57:28.700149 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.700112    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-config" (OuterVolumeSpecName: "console-config") pod "37fc6f66-4b74-4162-acab-d3d6c0a41aa2" (UID: "37fc6f66-4b74-4162-acab-d3d6c0a41aa2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:28.700149 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.700129    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "37fc6f66-4b74-4162-acab-d3d6c0a41aa2" (UID: "37fc6f66-4b74-4162-acab-d3d6c0a41aa2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:28.700245 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.700190    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-service-ca" (OuterVolumeSpecName: "service-ca") pod "37fc6f66-4b74-4162-acab-d3d6c0a41aa2" (UID: "37fc6f66-4b74-4162-acab-d3d6c0a41aa2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:28.700427 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.700394    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "37fc6f66-4b74-4162-acab-d3d6c0a41aa2" (UID: "37fc6f66-4b74-4162-acab-d3d6c0a41aa2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:28.701980 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.701953    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "37fc6f66-4b74-4162-acab-d3d6c0a41aa2" (UID: "37fc6f66-4b74-4162-acab-d3d6c0a41aa2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:57:28.702065 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.701980    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "37fc6f66-4b74-4162-acab-d3d6c0a41aa2" (UID: "37fc6f66-4b74-4162-acab-d3d6c0a41aa2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:57:28.702065 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.701992    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-kube-api-access-jxprx" (OuterVolumeSpecName: "kube-api-access-jxprx") pod "37fc6f66-4b74-4162-acab-d3d6c0a41aa2" (UID: "37fc6f66-4b74-4162-acab-d3d6c0a41aa2"). InnerVolumeSpecName "kube-api-access-jxprx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:28.800612 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.800575    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-oauth-config\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:57:28.800612 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.800606    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-oauth-serving-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:57:28.800612 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.800616    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:57:28.800825 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.800625    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxprx\" (UniqueName: \"kubernetes.io/projected/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-kube-api-access-jxprx\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:57:28.800825 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.800635    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-serving-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:57:28.800825 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.800643    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-trusted-ca-bundle\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:57:28.800825 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.800651    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37fc6f66-4b74-4162-acab-d3d6c0a41aa2-console-config\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 14:57:28.863024 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.862992    2580 generic.go:356] "Generic (PLEG): container finished" podID="37fc6f66-4b74-4162-acab-d3d6c0a41aa2" containerID="a1652e07f53ecb32b4ec9dda16236db6a91aecaf28d0d399d539702ae372b664" exitCode=0
Sep 08 14:57:28.863176 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.863030    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67755d8699-zmxbk" event={"ID":"37fc6f66-4b74-4162-acab-d3d6c0a41aa2","Type":"ContainerDied","Data":"a1652e07f53ecb32b4ec9dda16236db6a91aecaf28d0d399d539702ae372b664"}
Sep 08 14:57:28.863176 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.863057    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67755d8699-zmxbk"
Sep 08 14:57:28.863176 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.863072    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67755d8699-zmxbk" event={"ID":"37fc6f66-4b74-4162-acab-d3d6c0a41aa2","Type":"ContainerDied","Data":"c61f489808d3d0d9618cdb656438065786d9d22cbbe9b43057998ed33c242a42"}
Sep 08 14:57:28.863176 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.863092    2580 scope.go:117] "RemoveContainer" containerID="a1652e07f53ecb32b4ec9dda16236db6a91aecaf28d0d399d539702ae372b664"
Sep 08 14:57:28.871883 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.871863    2580 scope.go:117] "RemoveContainer" containerID="a1652e07f53ecb32b4ec9dda16236db6a91aecaf28d0d399d539702ae372b664"
Sep 08 14:57:28.872156 ip-10-0-134-147 kubenswrapper[2580]: E0908 14:57:28.872139    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1652e07f53ecb32b4ec9dda16236db6a91aecaf28d0d399d539702ae372b664\": container with ID starting with a1652e07f53ecb32b4ec9dda16236db6a91aecaf28d0d399d539702ae372b664 not found: ID does not exist" containerID="a1652e07f53ecb32b4ec9dda16236db6a91aecaf28d0d399d539702ae372b664"
Sep 08 14:57:28.872196 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.872165    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1652e07f53ecb32b4ec9dda16236db6a91aecaf28d0d399d539702ae372b664"} err="failed to get container status \"a1652e07f53ecb32b4ec9dda16236db6a91aecaf28d0d399d539702ae372b664\": rpc error: code = NotFound desc = could not find container \"a1652e07f53ecb32b4ec9dda16236db6a91aecaf28d0d399d539702ae372b664\": container with ID starting with a1652e07f53ecb32b4ec9dda16236db6a91aecaf28d0d399d539702ae372b664 not found: ID does not exist"
Sep 08 14:57:28.883567 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.883505    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67755d8699-zmxbk"]
Sep 08 14:57:28.888185 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:28.888164    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67755d8699-zmxbk"]
Sep 08 14:57:29.156230 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:29.156139    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37fc6f66-4b74-4162-acab-d3d6c0a41aa2" path="/var/lib/kubelet/pods/37fc6f66-4b74-4162-acab-d3d6c0a41aa2/volumes"
Sep 08 14:57:59.225006 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:59.224965    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:57:59.244562 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:57:59.244533    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:58:00.004104 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:58:00.004037    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:59:57.292664 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.292585    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qtrlg"]
Sep 08 14:59:57.293136 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.292876    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37fc6f66-4b74-4162-acab-d3d6c0a41aa2" containerName="console"
Sep 08 14:59:57.293136 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.292891    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="37fc6f66-4b74-4162-acab-d3d6c0a41aa2" containerName="console"
Sep 08 14:59:57.293136 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.292907    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15a0820c-907a-4b1f-a43d-296b5a70096e" containerName="console"
Sep 08 14:59:57.293136 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.292912    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="15a0820c-907a-4b1f-a43d-296b5a70096e" containerName="console"
Sep 08 14:59:57.293136 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.292968    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="37fc6f66-4b74-4162-acab-d3d6c0a41aa2" containerName="console"
Sep 08 14:59:57.293136 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.292977    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="15a0820c-907a-4b1f-a43d-296b5a70096e" containerName="console"
Sep 08 14:59:57.294665 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.294650    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qtrlg"
Sep 08 14:59:57.297282 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.297256    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 08 14:59:57.297406 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.297323    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:59:57.297406 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.297262    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-6xpq9\""
Sep 08 14:59:57.303965 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.303944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qtrlg"]
Sep 08 14:59:57.398007 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.397965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/874cfd3f-0d20-482d-9484-2bae3af7fc9d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qtrlg\" (UID: \"874cfd3f-0d20-482d-9484-2bae3af7fc9d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qtrlg"
Sep 08 14:59:57.398177 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.398021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhj9t\" (UniqueName: \"kubernetes.io/projected/874cfd3f-0d20-482d-9484-2bae3af7fc9d-kube-api-access-dhj9t\") pod \"openshift-lws-operator-fd8ccff4c-qtrlg\" (UID: \"874cfd3f-0d20-482d-9484-2bae3af7fc9d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qtrlg"
Sep 08 14:59:57.498741 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.498693    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/874cfd3f-0d20-482d-9484-2bae3af7fc9d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qtrlg\" (UID: \"874cfd3f-0d20-482d-9484-2bae3af7fc9d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qtrlg"
Sep 08 14:59:57.498911 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.498760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhj9t\" (UniqueName: \"kubernetes.io/projected/874cfd3f-0d20-482d-9484-2bae3af7fc9d-kube-api-access-dhj9t\") pod \"openshift-lws-operator-fd8ccff4c-qtrlg\" (UID: \"874cfd3f-0d20-482d-9484-2bae3af7fc9d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qtrlg"
Sep 08 14:59:57.499101 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.499077    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/874cfd3f-0d20-482d-9484-2bae3af7fc9d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qtrlg\" (UID: \"874cfd3f-0d20-482d-9484-2bae3af7fc9d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qtrlg"
Sep 08 14:59:57.507567 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.507544    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhj9t\" (UniqueName: \"kubernetes.io/projected/874cfd3f-0d20-482d-9484-2bae3af7fc9d-kube-api-access-dhj9t\") pod \"openshift-lws-operator-fd8ccff4c-qtrlg\" (UID: \"874cfd3f-0d20-482d-9484-2bae3af7fc9d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qtrlg"
Sep 08 14:59:57.603548 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.603453    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qtrlg"
Sep 08 14:59:57.877214 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:57.877189    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qtrlg"]
Sep 08 14:59:57.879822 ip-10-0-134-147 kubenswrapper[2580]: W0908 14:59:57.879786    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod874cfd3f_0d20_482d_9484_2bae3af7fc9d.slice/crio-7061b71276209bf8fc9e3d9574cfba47887ad548b6ee108db9840dba03f6bfeb WatchSource:0}: Error finding container 7061b71276209bf8fc9e3d9574cfba47887ad548b6ee108db9840dba03f6bfeb: Status 404 returned error can't find the container with id 7061b71276209bf8fc9e3d9574cfba47887ad548b6ee108db9840dba03f6bfeb
Sep 08 14:59:58.419399 ip-10-0-134-147 kubenswrapper[2580]: I0908 14:59:58.419361    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qtrlg" event={"ID":"874cfd3f-0d20-482d-9484-2bae3af7fc9d","Type":"ContainerStarted","Data":"7061b71276209bf8fc9e3d9574cfba47887ad548b6ee108db9840dba03f6bfeb"}
Sep 08 15:00:02.436143 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:02.436108    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qtrlg" event={"ID":"874cfd3f-0d20-482d-9484-2bae3af7fc9d","Type":"ContainerStarted","Data":"d6889803504c843bf06c82580ced705bf77866b3900df19f2a30f82df53364f4"}
Sep 08 15:00:02.453816 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:02.453753    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qtrlg" podStartSLOduration=1.753040957 podStartE2EDuration="5.453734447s" totalImagesPullingTime="3.70069349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:00:02.45258319 +0000 UTC m=+281.784822741" watchObservedRunningTime="2026-09-08 15:00:02.453734447 +0000 UTC m=+281.785973992"
Sep 08 15:00:17.555389 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.555347    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"]
Sep 08 15:00:17.557471 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.557454    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"
Sep 08 15:00:17.563264 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.563235    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 08 15:00:17.564201 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.564177    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4ztrb\""
Sep 08 15:00:17.564327 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.564237    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 08 15:00:17.564586 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.564569    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 08 15:00:17.574262 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.574235    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"]
Sep 08 15:00:17.666937 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.666901    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bb2ab7a-9b16-4fdf-923c-75def46227f9-cert\") pod \"lws-controller-manager-5c458b45b4-rjkkl\" (UID: \"5bb2ab7a-9b16-4fdf-923c-75def46227f9\") " pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"
Sep 08 15:00:17.667108 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.666951    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5bb2ab7a-9b16-4fdf-923c-75def46227f9-metrics-cert\") pod \"lws-controller-manager-5c458b45b4-rjkkl\" (UID: \"5bb2ab7a-9b16-4fdf-923c-75def46227f9\") " pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"
Sep 08 15:00:17.667108 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.666979    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58xrh\" (UniqueName: \"kubernetes.io/projected/5bb2ab7a-9b16-4fdf-923c-75def46227f9-kube-api-access-58xrh\") pod \"lws-controller-manager-5c458b45b4-rjkkl\" (UID: \"5bb2ab7a-9b16-4fdf-923c-75def46227f9\") " pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"
Sep 08 15:00:17.667108 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.667033    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5bb2ab7a-9b16-4fdf-923c-75def46227f9-manager-config\") pod \"lws-controller-manager-5c458b45b4-rjkkl\" (UID: \"5bb2ab7a-9b16-4fdf-923c-75def46227f9\") " pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"
Sep 08 15:00:17.768185 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.768145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5bb2ab7a-9b16-4fdf-923c-75def46227f9-metrics-cert\") pod \"lws-controller-manager-5c458b45b4-rjkkl\" (UID: \"5bb2ab7a-9b16-4fdf-923c-75def46227f9\") " pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"
Sep 08 15:00:17.768354 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.768191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58xrh\" (UniqueName: \"kubernetes.io/projected/5bb2ab7a-9b16-4fdf-923c-75def46227f9-kube-api-access-58xrh\") pod \"lws-controller-manager-5c458b45b4-rjkkl\" (UID: \"5bb2ab7a-9b16-4fdf-923c-75def46227f9\") " pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"
Sep 08 15:00:17.768354 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.768223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5bb2ab7a-9b16-4fdf-923c-75def46227f9-manager-config\") pod \"lws-controller-manager-5c458b45b4-rjkkl\" (UID: \"5bb2ab7a-9b16-4fdf-923c-75def46227f9\") " pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"
Sep 08 15:00:17.768354 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.768304    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bb2ab7a-9b16-4fdf-923c-75def46227f9-cert\") pod \"lws-controller-manager-5c458b45b4-rjkkl\" (UID: \"5bb2ab7a-9b16-4fdf-923c-75def46227f9\") " pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"
Sep 08 15:00:17.768954 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.768928    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5bb2ab7a-9b16-4fdf-923c-75def46227f9-manager-config\") pod \"lws-controller-manager-5c458b45b4-rjkkl\" (UID: \"5bb2ab7a-9b16-4fdf-923c-75def46227f9\") " pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"
Sep 08 15:00:17.770911 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.770886    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bb2ab7a-9b16-4fdf-923c-75def46227f9-cert\") pod \"lws-controller-manager-5c458b45b4-rjkkl\" (UID: \"5bb2ab7a-9b16-4fdf-923c-75def46227f9\") " pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"
Sep 08 15:00:17.770911 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.770904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5bb2ab7a-9b16-4fdf-923c-75def46227f9-metrics-cert\") pod \"lws-controller-manager-5c458b45b4-rjkkl\" (UID: \"5bb2ab7a-9b16-4fdf-923c-75def46227f9\") " pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"
Sep 08 15:00:17.775922 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.775900    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58xrh\" (UniqueName: \"kubernetes.io/projected/5bb2ab7a-9b16-4fdf-923c-75def46227f9-kube-api-access-58xrh\") pod \"lws-controller-manager-5c458b45b4-rjkkl\" (UID: \"5bb2ab7a-9b16-4fdf-923c-75def46227f9\") " pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"
Sep 08 15:00:17.866949 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:17.866847    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"
Sep 08 15:00:18.138707 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:18.138632    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"]
Sep 08 15:00:18.141975 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:00:18.141944    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bb2ab7a_9b16_4fdf_923c_75def46227f9.slice/crio-99948814d16411d80373962a3b3ede109c5087159af0eeefb18bafabda0d26c9 WatchSource:0}: Error finding container 99948814d16411d80373962a3b3ede109c5087159af0eeefb18bafabda0d26c9: Status 404 returned error can't find the container with id 99948814d16411d80373962a3b3ede109c5087159af0eeefb18bafabda0d26c9
Sep 08 15:00:18.496753 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:18.496719    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl" event={"ID":"5bb2ab7a-9b16-4fdf-923c-75def46227f9","Type":"ContainerStarted","Data":"99948814d16411d80373962a3b3ede109c5087159af0eeefb18bafabda0d26c9"}
Sep 08 15:00:20.506294 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:20.506255    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl" event={"ID":"5bb2ab7a-9b16-4fdf-923c-75def46227f9","Type":"ContainerStarted","Data":"d830f05aaed4d4adc80ca34924405c281802b8df12dee73e564b296daab26e28"}
Sep 08 15:00:20.506704 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:20.506338    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"
Sep 08 15:00:20.532034 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:20.531979    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl" podStartSLOduration=1.942912234 podStartE2EDuration="3.531962143s" totalImagesPullingTime="1.589049909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:00:20.531008101 +0000 UTC m=+299.863247648" watchObservedRunningTime="2026-09-08 15:00:20.531962143 +0000 UTC m=+299.864201739"
Sep 08 15:00:21.045998 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:21.045971    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 15:00:21.046198 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:21.046177    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 15:00:21.051687 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:21.051668    2580 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 15:00:23.464720 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.464687    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"]
Sep 08 15:00:23.466754 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.466737    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:23.469238 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.469214    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 15:00:23.469238 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.469236    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 15:00:23.469408 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.469374    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 15:00:23.469408 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.469386    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6bscm\""
Sep 08 15:00:23.469535 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.469471    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 15:00:23.484068 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.484039    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"]
Sep 08 15:00:23.615798 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.615750    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8dac890c-2121-4d99-bfae-a2a974fbe2de-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b574fc88f-7n6vv\" (UID: \"8dac890c-2121-4d99-bfae-a2a974fbe2de\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:23.616010 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.615824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8dac890c-2121-4d99-bfae-a2a974fbe2de-manifests\") pod \"opendatahub-operator-controller-manager-6b574fc88f-7n6vv\" (UID: \"8dac890c-2121-4d99-bfae-a2a974fbe2de\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:23.616010 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.615854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqdk7\" (UniqueName: \"kubernetes.io/projected/8dac890c-2121-4d99-bfae-a2a974fbe2de-kube-api-access-wqdk7\") pod \"opendatahub-operator-controller-manager-6b574fc88f-7n6vv\" (UID: \"8dac890c-2121-4d99-bfae-a2a974fbe2de\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:23.616010 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.615957    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dac890c-2121-4d99-bfae-a2a974fbe2de-tmp\") pod \"opendatahub-operator-controller-manager-6b574fc88f-7n6vv\" (UID: \"8dac890c-2121-4d99-bfae-a2a974fbe2de\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:23.616010 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.615994    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8dac890c-2121-4d99-bfae-a2a974fbe2de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b574fc88f-7n6vv\" (UID: \"8dac890c-2121-4d99-bfae-a2a974fbe2de\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:23.716446 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.716357    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8dac890c-2121-4d99-bfae-a2a974fbe2de-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b574fc88f-7n6vv\" (UID: \"8dac890c-2121-4d99-bfae-a2a974fbe2de\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:23.716446 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.716405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8dac890c-2121-4d99-bfae-a2a974fbe2de-manifests\") pod \"opendatahub-operator-controller-manager-6b574fc88f-7n6vv\" (UID: \"8dac890c-2121-4d99-bfae-a2a974fbe2de\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:23.716446 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.716430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqdk7\" (UniqueName: \"kubernetes.io/projected/8dac890c-2121-4d99-bfae-a2a974fbe2de-kube-api-access-wqdk7\") pod \"opendatahub-operator-controller-manager-6b574fc88f-7n6vv\" (UID: \"8dac890c-2121-4d99-bfae-a2a974fbe2de\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:23.716744 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.716470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dac890c-2121-4d99-bfae-a2a974fbe2de-tmp\") pod \"opendatahub-operator-controller-manager-6b574fc88f-7n6vv\" (UID: \"8dac890c-2121-4d99-bfae-a2a974fbe2de\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:23.716744 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.716486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8dac890c-2121-4d99-bfae-a2a974fbe2de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b574fc88f-7n6vv\" (UID: \"8dac890c-2121-4d99-bfae-a2a974fbe2de\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:23.716904 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.716880    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8dac890c-2121-4d99-bfae-a2a974fbe2de-manifests\") pod \"opendatahub-operator-controller-manager-6b574fc88f-7n6vv\" (UID: \"8dac890c-2121-4d99-bfae-a2a974fbe2de\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:23.718819 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.718791    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dac890c-2121-4d99-bfae-a2a974fbe2de-tmp\") pod \"opendatahub-operator-controller-manager-6b574fc88f-7n6vv\" (UID: \"8dac890c-2121-4d99-bfae-a2a974fbe2de\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:23.718924 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.718907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8dac890c-2121-4d99-bfae-a2a974fbe2de-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b574fc88f-7n6vv\" (UID: \"8dac890c-2121-4d99-bfae-a2a974fbe2de\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:23.719049 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.719034    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8dac890c-2121-4d99-bfae-a2a974fbe2de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b574fc88f-7n6vv\" (UID: \"8dac890c-2121-4d99-bfae-a2a974fbe2de\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:23.727290 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.727260    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqdk7\" (UniqueName: \"kubernetes.io/projected/8dac890c-2121-4d99-bfae-a2a974fbe2de-kube-api-access-wqdk7\") pod \"opendatahub-operator-controller-manager-6b574fc88f-7n6vv\" (UID: \"8dac890c-2121-4d99-bfae-a2a974fbe2de\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:23.777414 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:23.777382    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:24.064779 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:24.064755    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"]
Sep 08 15:00:24.067141 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:00:24.067118    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dac890c_2121_4d99_bfae_a2a974fbe2de.slice/crio-916459407edef2afc32714e2676122c7109302d990202b669a14ddf03a19c630 WatchSource:0}: Error finding container 916459407edef2afc32714e2676122c7109302d990202b669a14ddf03a19c630: Status 404 returned error can't find the container with id 916459407edef2afc32714e2676122c7109302d990202b669a14ddf03a19c630
Sep 08 15:00:24.069090 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:24.069073    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:00:24.522820 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:24.522793    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv" event={"ID":"8dac890c-2121-4d99-bfae-a2a974fbe2de","Type":"ContainerStarted","Data":"916459407edef2afc32714e2676122c7109302d990202b669a14ddf03a19c630"}
Sep 08 15:00:29.548097 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:29.548055    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv" event={"ID":"8dac890c-2121-4d99-bfae-a2a974fbe2de","Type":"ContainerStarted","Data":"479a61c99f12ebf4d7b199d125a47d8063ba8b1959cf23d2349e2f31b521d7e0"}
Sep 08 15:00:30.553347 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:30.553257    2580 generic.go:356] "Generic (PLEG): container finished" podID="8dac890c-2121-4d99-bfae-a2a974fbe2de" containerID="479a61c99f12ebf4d7b199d125a47d8063ba8b1959cf23d2349e2f31b521d7e0" exitCode=0
Sep 08 15:00:30.553714 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:30.553340    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv" event={"ID":"8dac890c-2121-4d99-bfae-a2a974fbe2de","Type":"ContainerDied","Data":"479a61c99f12ebf4d7b199d125a47d8063ba8b1959cf23d2349e2f31b521d7e0"}
Sep 08 15:00:31.513343 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:31.513257    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c458b45b4-rjkkl"
Sep 08 15:00:31.561423 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:31.561383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv" event={"ID":"8dac890c-2121-4d99-bfae-a2a974fbe2de","Type":"ContainerStarted","Data":"a82d50052cb62b4f5a9893d1edfb1dfa26a09551be4a061bd65f008677bba4bf"}
Sep 08 15:00:31.561909 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:31.561550    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:31.583897 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:31.583838    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv" podStartSLOduration=1.8012610310000001 podStartE2EDuration="8.583820592s" totalImagesPullingTime="5.713068838s" totalInitContainerRuntime="1.069490723s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:00:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:00:31.58263756 +0000 UTC m=+310.914877106" watchObservedRunningTime="2026-09-08 15:00:31.583820592 +0000 UTC m=+310.916060138"
Sep 08 15:00:42.568226 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:42.568196    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-7n6vv"
Sep 08 15:00:53.200528 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.200484    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"]
Sep 08 15:00:53.203234 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.203208    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.206297 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.206272    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 15:00:53.207091 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.207070    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cxfqz\""
Sep 08 15:00:53.207247 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.207230    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 15:00:53.207567 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.207550    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 15:00:53.215760 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.215738    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"]
Sep 08 15:00:53.259115 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.259082    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1debce1f-10a9-48f3-9478-8044c57ae2bf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.259299 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.259122    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1debce1f-10a9-48f3-9478-8044c57ae2bf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.259299 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.259155    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l84xk\" (UniqueName: \"kubernetes.io/projected/1debce1f-10a9-48f3-9478-8044c57ae2bf-kube-api-access-l84xk\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.259299 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.259232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1debce1f-10a9-48f3-9478-8044c57ae2bf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.259299 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.259274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1debce1f-10a9-48f3-9478-8044c57ae2bf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.259455 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.259359    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1debce1f-10a9-48f3-9478-8044c57ae2bf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.259455 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.259384    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1debce1f-10a9-48f3-9478-8044c57ae2bf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.259559 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.259537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1debce1f-10a9-48f3-9478-8044c57ae2bf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.259614 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.259566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1debce1f-10a9-48f3-9478-8044c57ae2bf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.360556 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.360496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1debce1f-10a9-48f3-9478-8044c57ae2bf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.360556 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.360562    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1debce1f-10a9-48f3-9478-8044c57ae2bf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.360796 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.360599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1debce1f-10a9-48f3-9478-8044c57ae2bf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.360796 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.360622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1debce1f-10a9-48f3-9478-8044c57ae2bf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.360796 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.360673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1debce1f-10a9-48f3-9478-8044c57ae2bf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.360796 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.360706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1debce1f-10a9-48f3-9478-8044c57ae2bf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.360796 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.360732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l84xk\" (UniqueName: \"kubernetes.io/projected/1debce1f-10a9-48f3-9478-8044c57ae2bf-kube-api-access-l84xk\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.360796 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.360759    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1debce1f-10a9-48f3-9478-8044c57ae2bf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.360796 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.360791    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1debce1f-10a9-48f3-9478-8044c57ae2bf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.361135 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.361029    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1debce1f-10a9-48f3-9478-8044c57ae2bf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.361365 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.361338    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1debce1f-10a9-48f3-9478-8044c57ae2bf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.361494 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.361380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1debce1f-10a9-48f3-9478-8044c57ae2bf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.361591 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.361492    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1debce1f-10a9-48f3-9478-8044c57ae2bf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.361713 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.361692    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1debce1f-10a9-48f3-9478-8044c57ae2bf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.363033 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.363006    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1debce1f-10a9-48f3-9478-8044c57ae2bf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.363134 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.363115    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1debce1f-10a9-48f3-9478-8044c57ae2bf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.372756 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.372731    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1debce1f-10a9-48f3-9478-8044c57ae2bf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.372981 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.372959    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l84xk\" (UniqueName: \"kubernetes.io/projected/1debce1f-10a9-48f3-9478-8044c57ae2bf-kube-api-access-l84xk\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq\" (UID: \"1debce1f-10a9-48f3-9478-8044c57ae2bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.515144 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.515107    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:53.801624 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:53.801596    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"]
Sep 08 15:00:53.803387 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:00:53.803351    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1debce1f_10a9_48f3_9478_8044c57ae2bf.slice/crio-06b742bab0149bf4321cddb1d538cfd78ace6eddb39e319be627038c6c427d6c WatchSource:0}: Error finding container 06b742bab0149bf4321cddb1d538cfd78ace6eddb39e319be627038c6c427d6c: Status 404 returned error can't find the container with id 06b742bab0149bf4321cddb1d538cfd78ace6eddb39e319be627038c6c427d6c
Sep 08 15:00:54.668954 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:54.668875    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq" event={"ID":"1debce1f-10a9-48f3-9478-8044c57ae2bf","Type":"ContainerStarted","Data":"06b742bab0149bf4321cddb1d538cfd78ace6eddb39e319be627038c6c427d6c"}
Sep 08 15:00:56.594874 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:56.594833    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:00:56.595227 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:56.594923    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:00:56.595227 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:56.594976    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:00:56.679958 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:56.679925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq" event={"ID":"1debce1f-10a9-48f3-9478-8044c57ae2bf","Type":"ContainerStarted","Data":"5206220983cf82fa4f995ad3a116eff0671e29b6c47091c7c989135107a08a8c"}
Sep 08 15:00:56.730754 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:56.730685    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq" podStartSLOduration=0.941799127 podStartE2EDuration="3.73066447s" totalImagesPullingTime="2.788865343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:00:56.728949406 +0000 UTC m=+336.061188960" watchObservedRunningTime="2026-09-08 15:00:56.73066447 +0000 UTC m=+336.062904016"
Sep 08 15:00:57.027297 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.027263    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jfjft"]
Sep 08 15:00:57.029452 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.029427    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jfjft"
Sep 08 15:00:57.031903 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.031882    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pwrfz\""
Sep 08 15:00:57.032059 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.032038    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 08 15:00:57.042715 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.042678    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jfjft"]
Sep 08 15:00:57.094210 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.094168    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ln4c\" (UniqueName: \"kubernetes.io/projected/6d3c97b7-cabb-4071-83c0-3dcc587c3c26-kube-api-access-2ln4c\") pod \"odh-model-controller-7998c67dc4-jfjft\" (UID: \"6d3c97b7-cabb-4071-83c0-3dcc587c3c26\") " pod="opendatahub/odh-model-controller-7998c67dc4-jfjft"
Sep 08 15:00:57.094210 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.094209    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d3c97b7-cabb-4071-83c0-3dcc587c3c26-cert\") pod \"odh-model-controller-7998c67dc4-jfjft\" (UID: \"6d3c97b7-cabb-4071-83c0-3dcc587c3c26\") " pod="opendatahub/odh-model-controller-7998c67dc4-jfjft"
Sep 08 15:00:57.194913 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.194868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d3c97b7-cabb-4071-83c0-3dcc587c3c26-cert\") pod \"odh-model-controller-7998c67dc4-jfjft\" (UID: \"6d3c97b7-cabb-4071-83c0-3dcc587c3c26\") " pod="opendatahub/odh-model-controller-7998c67dc4-jfjft"
Sep 08 15:00:57.195070 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.195003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ln4c\" (UniqueName: \"kubernetes.io/projected/6d3c97b7-cabb-4071-83c0-3dcc587c3c26-kube-api-access-2ln4c\") pod \"odh-model-controller-7998c67dc4-jfjft\" (UID: \"6d3c97b7-cabb-4071-83c0-3dcc587c3c26\") " pod="opendatahub/odh-model-controller-7998c67dc4-jfjft"
Sep 08 15:00:57.195070 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:00:57.195042    2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 08 15:00:57.195151 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:00:57.195143    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3c97b7-cabb-4071-83c0-3dcc587c3c26-cert podName:6d3c97b7-cabb-4071-83c0-3dcc587c3c26 nodeName:}" failed. No retries permitted until 2026-09-08 15:00:57.695118836 +0000 UTC m=+337.027358395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6d3c97b7-cabb-4071-83c0-3dcc587c3c26-cert") pod "odh-model-controller-7998c67dc4-jfjft" (UID: "6d3c97b7-cabb-4071-83c0-3dcc587c3c26") : secret "odh-model-controller-webhook-cert" not found
Sep 08 15:00:57.203988 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.203958    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ln4c\" (UniqueName: \"kubernetes.io/projected/6d3c97b7-cabb-4071-83c0-3dcc587c3c26-kube-api-access-2ln4c\") pod \"odh-model-controller-7998c67dc4-jfjft\" (UID: \"6d3c97b7-cabb-4071-83c0-3dcc587c3c26\") " pod="opendatahub/odh-model-controller-7998c67dc4-jfjft"
Sep 08 15:00:57.515720 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.515682    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:57.520734 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.520712    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:57.677600 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.677557    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tgcgq"]
Sep 08 15:00:57.680496 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.680470    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tgcgq"
Sep 08 15:00:57.683171 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.683145    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 08 15:00:57.686743 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.686720    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:57.688123 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.688099    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq"
Sep 08 15:00:57.694371 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.694349    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tgcgq"]
Sep 08 15:00:57.699358 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.699334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d3c97b7-cabb-4071-83c0-3dcc587c3c26-cert\") pod \"odh-model-controller-7998c67dc4-jfjft\" (UID: \"6d3c97b7-cabb-4071-83c0-3dcc587c3c26\") " pod="opendatahub/odh-model-controller-7998c67dc4-jfjft"
Sep 08 15:00:57.701861 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.701836    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d3c97b7-cabb-4071-83c0-3dcc587c3c26-cert\") pod \"odh-model-controller-7998c67dc4-jfjft\" (UID: \"6d3c97b7-cabb-4071-83c0-3dcc587c3c26\") " pod="opendatahub/odh-model-controller-7998c67dc4-jfjft"
Sep 08 15:00:57.800621 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.800499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ba86d35-3e5c-4cd5-a99d-f80f388d2396-tls-certs\") pod \"model-serving-api-54d89bd5fc-tgcgq\" (UID: \"5ba86d35-3e5c-4cd5-a99d-f80f388d2396\") " pod="opendatahub/model-serving-api-54d89bd5fc-tgcgq"
Sep 08 15:00:57.800621 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.800601    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc479\" (UniqueName: \"kubernetes.io/projected/5ba86d35-3e5c-4cd5-a99d-f80f388d2396-kube-api-access-fc479\") pod \"model-serving-api-54d89bd5fc-tgcgq\" (UID: \"5ba86d35-3e5c-4cd5-a99d-f80f388d2396\") " pod="opendatahub/model-serving-api-54d89bd5fc-tgcgq"
Sep 08 15:00:57.902094 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.902048    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ba86d35-3e5c-4cd5-a99d-f80f388d2396-tls-certs\") pod \"model-serving-api-54d89bd5fc-tgcgq\" (UID: \"5ba86d35-3e5c-4cd5-a99d-f80f388d2396\") " pod="opendatahub/model-serving-api-54d89bd5fc-tgcgq"
Sep 08 15:00:57.902297 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.902119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc479\" (UniqueName: \"kubernetes.io/projected/5ba86d35-3e5c-4cd5-a99d-f80f388d2396-kube-api-access-fc479\") pod \"model-serving-api-54d89bd5fc-tgcgq\" (UID: \"5ba86d35-3e5c-4cd5-a99d-f80f388d2396\") " pod="opendatahub/model-serving-api-54d89bd5fc-tgcgq"
Sep 08 15:00:57.902297 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:00:57.902212    2580 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 08 15:00:57.902428 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:00:57.902309    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba86d35-3e5c-4cd5-a99d-f80f388d2396-tls-certs podName:5ba86d35-3e5c-4cd5-a99d-f80f388d2396 nodeName:}" failed. No retries permitted until 2026-09-08 15:00:58.402285934 +0000 UTC m=+337.734525475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5ba86d35-3e5c-4cd5-a99d-f80f388d2396-tls-certs") pod "model-serving-api-54d89bd5fc-tgcgq" (UID: "5ba86d35-3e5c-4cd5-a99d-f80f388d2396") : secret "model-serving-api-tls" not found
Sep 08 15:00:57.915977 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.915942    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc479\" (UniqueName: \"kubernetes.io/projected/5ba86d35-3e5c-4cd5-a99d-f80f388d2396-kube-api-access-fc479\") pod \"model-serving-api-54d89bd5fc-tgcgq\" (UID: \"5ba86d35-3e5c-4cd5-a99d-f80f388d2396\") " pod="opendatahub/model-serving-api-54d89bd5fc-tgcgq"
Sep 08 15:00:57.946662 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:57.946592    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jfjft"
Sep 08 15:00:58.225089 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:58.225062    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jfjft"]
Sep 08 15:00:58.227912 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:00:58.227883    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3c97b7_cabb_4071_83c0_3dcc587c3c26.slice/crio-379371f14a6fb34f5ab7b00d65b71d8c9213d08820a453ed9d6dc8670327ed44 WatchSource:0}: Error finding container 379371f14a6fb34f5ab7b00d65b71d8c9213d08820a453ed9d6dc8670327ed44: Status 404 returned error can't find the container with id 379371f14a6fb34f5ab7b00d65b71d8c9213d08820a453ed9d6dc8670327ed44
Sep 08 15:00:58.406350 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:58.406319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ba86d35-3e5c-4cd5-a99d-f80f388d2396-tls-certs\") pod \"model-serving-api-54d89bd5fc-tgcgq\" (UID: \"5ba86d35-3e5c-4cd5-a99d-f80f388d2396\") " pod="opendatahub/model-serving-api-54d89bd5fc-tgcgq"
Sep 08 15:00:58.408672 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:58.408644    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ba86d35-3e5c-4cd5-a99d-f80f388d2396-tls-certs\") pod \"model-serving-api-54d89bd5fc-tgcgq\" (UID: \"5ba86d35-3e5c-4cd5-a99d-f80f388d2396\") " pod="opendatahub/model-serving-api-54d89bd5fc-tgcgq"
Sep 08 15:00:58.593524 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:58.593417    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tgcgq"
Sep 08 15:00:58.692014 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:58.691980    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jfjft" event={"ID":"6d3c97b7-cabb-4071-83c0-3dcc587c3c26","Type":"ContainerStarted","Data":"379371f14a6fb34f5ab7b00d65b71d8c9213d08820a453ed9d6dc8670327ed44"}
Sep 08 15:00:58.867486 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:58.867350    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tgcgq"]
Sep 08 15:00:58.870129 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:00:58.870086    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba86d35_3e5c_4cd5_a99d_f80f388d2396.slice/crio-0449c446682812f0c25e9dcd283fa0b6a336e8f91c4f138cf2f8b7492059539c WatchSource:0}: Error finding container 0449c446682812f0c25e9dcd283fa0b6a336e8f91c4f138cf2f8b7492059539c: Status 404 returned error can't find the container with id 0449c446682812f0c25e9dcd283fa0b6a336e8f91c4f138cf2f8b7492059539c
Sep 08 15:00:59.696752 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:00:59.696717    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tgcgq" event={"ID":"5ba86d35-3e5c-4cd5-a99d-f80f388d2396","Type":"ContainerStarted","Data":"0449c446682812f0c25e9dcd283fa0b6a336e8f91c4f138cf2f8b7492059539c"}
Sep 08 15:01:02.714086 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:02.714045    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jfjft" event={"ID":"6d3c97b7-cabb-4071-83c0-3dcc587c3c26","Type":"ContainerStarted","Data":"37e73f31beee2ba82c470dc009f0f1d990ef0b14c7e14364fa5442f9701a2e45"}
Sep 08 15:01:02.714577 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:02.714209    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-jfjft"
Sep 08 15:01:02.715946 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:02.715914    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tgcgq" event={"ID":"5ba86d35-3e5c-4cd5-a99d-f80f388d2396","Type":"ContainerStarted","Data":"c669caa9e1022c3d210074a105a2de327bcc7f73e6b53acd7f027425bc4ce936"}
Sep 08 15:01:02.716057 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:02.716021    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tgcgq"
Sep 08 15:01:02.731534 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:02.731456    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-jfjft" podStartSLOduration=1.3300092829999999 podStartE2EDuration="5.731437597s" totalImagesPullingTime="4.401428314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:01:02.72962616 +0000 UTC m=+342.061865708" watchObservedRunningTime="2026-09-08 15:01:02.731437597 +0000 UTC m=+342.063677142"
Sep 08 15:01:02.749301 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:02.749233    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tgcgq" podStartSLOduration=1.980146849 podStartE2EDuration="5.749207581s" totalImagesPullingTime="3.769060732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:01:02.747930817 +0000 UTC m=+342.080170365" watchObservedRunningTime="2026-09-08 15:01:02.749207581 +0000 UTC m=+342.081447130"
Sep 08 15:01:07.601695 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.601665    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9zkbx"]
Sep 08 15:01:07.604069 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.604047    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zkbx"
Sep 08 15:01:07.606932 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.606911    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qphgx\""
Sep 08 15:01:07.607745 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.607729    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 08 15:01:07.626410 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.626386    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6"]
Sep 08 15:01:07.629095 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.629076    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6"
Sep 08 15:01:07.629232 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.629201    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9zkbx"]
Sep 08 15:01:07.632398 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.632377    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-t96jd\""
Sep 08 15:01:07.632536 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.632383    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 08 15:01:07.647999 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.647969    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6"]
Sep 08 15:01:07.698647 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.698607    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm8xl\" (UniqueName: \"kubernetes.io/projected/a9b6c624-140c-4a56-b5c2-f7427873325b-kube-api-access-hm8xl\") pod \"kserve-controller-manager-d6f4b65b8-9zkbx\" (UID: \"a9b6c624-140c-4a56-b5c2-f7427873325b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zkbx"
Sep 08 15:01:07.698821 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.698679    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9b6c624-140c-4a56-b5c2-f7427873325b-cert\") pod \"kserve-controller-manager-d6f4b65b8-9zkbx\" (UID: \"a9b6c624-140c-4a56-b5c2-f7427873325b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zkbx"
Sep 08 15:01:07.799484 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.799442    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd23a109-8749-4cbe-978d-aa385c5bdd01-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rmnm6\" (UID: \"bd23a109-8749-4cbe-978d-aa385c5bdd01\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6"
Sep 08 15:01:07.799719 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.799499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98tg8\" (UniqueName: \"kubernetes.io/projected/bd23a109-8749-4cbe-978d-aa385c5bdd01-kube-api-access-98tg8\") pod \"llmisvc-controller-manager-777c6bd7d5-rmnm6\" (UID: \"bd23a109-8749-4cbe-978d-aa385c5bdd01\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6"
Sep 08 15:01:07.799829 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.799792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm8xl\" (UniqueName: \"kubernetes.io/projected/a9b6c624-140c-4a56-b5c2-f7427873325b-kube-api-access-hm8xl\") pod \"kserve-controller-manager-d6f4b65b8-9zkbx\" (UID: \"a9b6c624-140c-4a56-b5c2-f7427873325b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zkbx"
Sep 08 15:01:07.799905 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.799889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9b6c624-140c-4a56-b5c2-f7427873325b-cert\") pod \"kserve-controller-manager-d6f4b65b8-9zkbx\" (UID: \"a9b6c624-140c-4a56-b5c2-f7427873325b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zkbx"
Sep 08 15:01:07.803453 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.803425    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9b6c624-140c-4a56-b5c2-f7427873325b-cert\") pod \"kserve-controller-manager-d6f4b65b8-9zkbx\" (UID: \"a9b6c624-140c-4a56-b5c2-f7427873325b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zkbx"
Sep 08 15:01:07.821697 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.821652    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm8xl\" (UniqueName: \"kubernetes.io/projected/a9b6c624-140c-4a56-b5c2-f7427873325b-kube-api-access-hm8xl\") pod \"kserve-controller-manager-d6f4b65b8-9zkbx\" (UID: \"a9b6c624-140c-4a56-b5c2-f7427873325b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zkbx"
Sep 08 15:01:07.900554 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.900398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd23a109-8749-4cbe-978d-aa385c5bdd01-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rmnm6\" (UID: \"bd23a109-8749-4cbe-978d-aa385c5bdd01\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6"
Sep 08 15:01:07.900554 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.900462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98tg8\" (UniqueName: \"kubernetes.io/projected/bd23a109-8749-4cbe-978d-aa385c5bdd01-kube-api-access-98tg8\") pod \"llmisvc-controller-manager-777c6bd7d5-rmnm6\" (UID: \"bd23a109-8749-4cbe-978d-aa385c5bdd01\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6"
Sep 08 15:01:07.900760 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:01:07.900610    2580 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 08 15:01:07.900760 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:01:07.900687    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd23a109-8749-4cbe-978d-aa385c5bdd01-cert podName:bd23a109-8749-4cbe-978d-aa385c5bdd01 nodeName:}" failed. No retries permitted until 2026-09-08 15:01:08.400666627 +0000 UTC m=+347.732906166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bd23a109-8749-4cbe-978d-aa385c5bdd01-cert") pod "llmisvc-controller-manager-777c6bd7d5-rmnm6" (UID: "bd23a109-8749-4cbe-978d-aa385c5bdd01") : secret "llmisvc-webhook-server-cert" not found
Sep 08 15:01:07.914426 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.914398    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zkbx"
Sep 08 15:01:07.929938 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:07.929911    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98tg8\" (UniqueName: \"kubernetes.io/projected/bd23a109-8749-4cbe-978d-aa385c5bdd01-kube-api-access-98tg8\") pod \"llmisvc-controller-manager-777c6bd7d5-rmnm6\" (UID: \"bd23a109-8749-4cbe-978d-aa385c5bdd01\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6"
Sep 08 15:01:08.192141 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:08.192051    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9zkbx"]
Sep 08 15:01:08.194610 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:01:08.194582    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9b6c624_140c_4a56_b5c2_f7427873325b.slice/crio-c1158a0a90e0e2554828a756df40cddc7addbdc54d02647604999db309badce3 WatchSource:0}: Error finding container c1158a0a90e0e2554828a756df40cddc7addbdc54d02647604999db309badce3: Status 404 returned error can't find the container with id c1158a0a90e0e2554828a756df40cddc7addbdc54d02647604999db309badce3
Sep 08 15:01:08.404775 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:08.404746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd23a109-8749-4cbe-978d-aa385c5bdd01-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rmnm6\" (UID: \"bd23a109-8749-4cbe-978d-aa385c5bdd01\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6"
Sep 08 15:01:08.406961 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:08.406941    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd23a109-8749-4cbe-978d-aa385c5bdd01-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rmnm6\" (UID: \"bd23a109-8749-4cbe-978d-aa385c5bdd01\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6"
Sep 08 15:01:08.539912 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:08.539878    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6"
Sep 08 15:01:08.743098 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:08.743064    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zkbx" event={"ID":"a9b6c624-140c-4a56-b5c2-f7427873325b","Type":"ContainerStarted","Data":"c1158a0a90e0e2554828a756df40cddc7addbdc54d02647604999db309badce3"}
Sep 08 15:01:08.839546 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:08.839504    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6"]
Sep 08 15:01:08.842007 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:01:08.841982    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbd23a109_8749_4cbe_978d_aa385c5bdd01.slice/crio-fa750e660f5e04e98734b41f7b35a1d0bc84568f459d810f78624bf2ff161639 WatchSource:0}: Error finding container fa750e660f5e04e98734b41f7b35a1d0bc84568f459d810f78624bf2ff161639: Status 404 returned error can't find the container with id fa750e660f5e04e98734b41f7b35a1d0bc84568f459d810f78624bf2ff161639
Sep 08 15:01:09.749897 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:09.749860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6" event={"ID":"bd23a109-8749-4cbe-978d-aa385c5bdd01","Type":"ContainerStarted","Data":"fa750e660f5e04e98734b41f7b35a1d0bc84568f459d810f78624bf2ff161639"}
Sep 08 15:01:11.760412 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:11.760370    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zkbx" event={"ID":"a9b6c624-140c-4a56-b5c2-f7427873325b","Type":"ContainerStarted","Data":"cc9dd73c76be8a90c38ce960ea2e7c37ff9388134abfb7289c547204af4bc7ab"}
Sep 08 15:01:11.760828 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:11.760463    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zkbx"
Sep 08 15:01:11.780637 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:11.780588    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zkbx" podStartSLOduration=2.090242 podStartE2EDuration="4.78057148s" totalImagesPullingTime="2.69032948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:01:11.778157717 +0000 UTC m=+351.110397263" watchObservedRunningTime="2026-09-08 15:01:11.78057148 +0000 UTC m=+351.112811025"
Sep 08 15:01:13.723023 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:13.722945    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-jfjft"
Sep 08 15:01:13.724888 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:13.724872    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tgcgq"
Sep 08 15:01:15.780042 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:15.780007    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6" event={"ID":"bd23a109-8749-4cbe-978d-aa385c5bdd01","Type":"ContainerStarted","Data":"207a57803081519774606bdd5cea10bec31610051cc50574dc7f2a555f4be49b"}
Sep 08 15:01:15.780426 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:15.780141    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6"
Sep 08 15:01:15.809886 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:15.809832    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6" podStartSLOduration=2.827893684 podStartE2EDuration="8.809811463s" totalImagesPullingTime="5.981917779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:01:15.807376204 +0000 UTC m=+355.139615750" watchObservedRunningTime="2026-09-08 15:01:15.809811463 +0000 UTC m=+355.142051009"
Sep 08 15:01:42.770257 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:42.770226    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zkbx"
Sep 08 15:01:46.786455 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:01:46.786424    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmnm6"
Sep 08 15:03:36.684237 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:36.684204    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"]
Sep 08 15:03:36.687783 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:36.687763    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"
Sep 08 15:03:36.690261 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:36.690235    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 15:03:36.690381 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:36.690300    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2zmq6\""
Sep 08 15:03:36.690381 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:36.690301    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 15:03:36.699790 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:36.699731    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"]
Sep 08 15:03:36.798043 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:36.798009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0d4c8fe-99c6-448c-b692-9024a7dffb13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-flkvt\" (UID: \"c0d4c8fe-99c6-448c-b692-9024a7dffb13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"
Sep 08 15:03:36.798216 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:36.798063    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rprb\" (UniqueName: \"kubernetes.io/projected/c0d4c8fe-99c6-448c-b692-9024a7dffb13-kube-api-access-4rprb\") pod \"kuadrant-operator-controller-manager-6bd956ccf-flkvt\" (UID: \"c0d4c8fe-99c6-448c-b692-9024a7dffb13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"
Sep 08 15:03:36.829546 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:36.829498    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"]
Sep 08 15:03:36.829789 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:03:36.829769    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-4rprb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt" podUID="c0d4c8fe-99c6-448c-b692-9024a7dffb13"
Sep 08 15:03:36.899297 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:36.899260    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0d4c8fe-99c6-448c-b692-9024a7dffb13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-flkvt\" (UID: \"c0d4c8fe-99c6-448c-b692-9024a7dffb13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"
Sep 08 15:03:36.899457 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:36.899314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rprb\" (UniqueName: \"kubernetes.io/projected/c0d4c8fe-99c6-448c-b692-9024a7dffb13-kube-api-access-4rprb\") pod \"kuadrant-operator-controller-manager-6bd956ccf-flkvt\" (UID: \"c0d4c8fe-99c6-448c-b692-9024a7dffb13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"
Sep 08 15:03:36.899680 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:36.899658    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0d4c8fe-99c6-448c-b692-9024a7dffb13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-flkvt\" (UID: \"c0d4c8fe-99c6-448c-b692-9024a7dffb13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"
Sep 08 15:03:36.911343 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:36.911305    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rprb\" (UniqueName: \"kubernetes.io/projected/c0d4c8fe-99c6-448c-b692-9024a7dffb13-kube-api-access-4rprb\") pod \"kuadrant-operator-controller-manager-6bd956ccf-flkvt\" (UID: \"c0d4c8fe-99c6-448c-b692-9024a7dffb13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"
Sep 08 15:03:37.386623 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:37.386588    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"]
Sep 08 15:03:37.394707 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:37.394679    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"
Sep 08 15:03:37.402954 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:37.402925    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"
Sep 08 15:03:37.404793 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:37.404767    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"]
Sep 08 15:03:37.408293 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:03:37.408262    2580 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c0d4c8fe-99c6-448c-b692-9024a7dffb13\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-6bd956ccf-flkvt\": pods \"kuadrant-operator-controller-manager-6bd956ccf-flkvt\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"
Sep 08 15:03:37.410249 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:03:37.410224    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-flkvt\" is forbidden: User \"system:node:ip-10-0-134-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-147.ec2.internal' and this object" podUID="c0d4c8fe-99c6-448c-b692-9024a7dffb13" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"
Sep 08 15:03:37.503687 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:37.503651    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0d4c8fe-99c6-448c-b692-9024a7dffb13-extensions-socket-volume\") pod \"c0d4c8fe-99c6-448c-b692-9024a7dffb13\" (UID: \"c0d4c8fe-99c6-448c-b692-9024a7dffb13\") "
Sep 08 15:03:37.503868 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:37.503758    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rprb\" (UniqueName: \"kubernetes.io/projected/c0d4c8fe-99c6-448c-b692-9024a7dffb13-kube-api-access-4rprb\") pod \"c0d4c8fe-99c6-448c-b692-9024a7dffb13\" (UID: \"c0d4c8fe-99c6-448c-b692-9024a7dffb13\") "
Sep 08 15:03:37.503982 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:37.503959    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d4c8fe-99c6-448c-b692-9024a7dffb13-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c0d4c8fe-99c6-448c-b692-9024a7dffb13" (UID: "c0d4c8fe-99c6-448c-b692-9024a7dffb13"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:03:37.504057 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:37.504043    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0d4c8fe-99c6-448c-b692-9024a7dffb13-extensions-socket-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:03:37.505751 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:37.505721    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0d4c8fe-99c6-448c-b692-9024a7dffb13-kube-api-access-4rprb" (OuterVolumeSpecName: "kube-api-access-4rprb") pod "c0d4c8fe-99c6-448c-b692-9024a7dffb13" (UID: "c0d4c8fe-99c6-448c-b692-9024a7dffb13"). InnerVolumeSpecName "kube-api-access-4rprb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:03:37.604585 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:37.604551    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rprb\" (UniqueName: \"kubernetes.io/projected/c0d4c8fe-99c6-448c-b692-9024a7dffb13-kube-api-access-4rprb\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:03:38.399053 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:38.399023    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"
Sep 08 15:03:38.401263 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:03:38.401227    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-flkvt\" is forbidden: User \"system:node:ip-10-0-134-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-147.ec2.internal' and this object" podUID="c0d4c8fe-99c6-448c-b692-9024a7dffb13" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"
Sep 08 15:03:38.407639 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:03:38.407605    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-flkvt\" is forbidden: User \"system:node:ip-10-0-134-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-147.ec2.internal' and this object" podUID="c0d4c8fe-99c6-448c-b692-9024a7dffb13" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-flkvt"
Sep 08 15:03:39.156131 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:03:39.156093    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0d4c8fe-99c6-448c-b692-9024a7dffb13" path="/var/lib/kubelet/pods/c0d4c8fe-99c6-448c-b692-9024a7dffb13/volumes"
Sep 08 15:04:14.188462 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.188344    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"]
Sep 08 15:04:14.192057 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.192037    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.194530 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.194497    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-t49nv\""
Sep 08 15:04:14.202845 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.202820    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"]
Sep 08 15:04:14.320936 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.320899    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d05e790c-f20b-4a8f-8e15-d88b08d529e7-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.320936 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.320945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d05e790c-f20b-4a8f-8e15-d88b08d529e7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.321150 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.320965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d05e790c-f20b-4a8f-8e15-d88b08d529e7-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.321150 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.321053    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d05e790c-f20b-4a8f-8e15-d88b08d529e7-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.321150 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.321106    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d05e790c-f20b-4a8f-8e15-d88b08d529e7-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.321150 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.321140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrl7z\" (UniqueName: \"kubernetes.io/projected/d05e790c-f20b-4a8f-8e15-d88b08d529e7-kube-api-access-lrl7z\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.321315 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.321166    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d05e790c-f20b-4a8f-8e15-d88b08d529e7-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.321315 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.321186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d05e790c-f20b-4a8f-8e15-d88b08d529e7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.321315 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.321223    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d05e790c-f20b-4a8f-8e15-d88b08d529e7-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.422391 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.422359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d05e790c-f20b-4a8f-8e15-d88b08d529e7-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.422391 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.422401    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrl7z\" (UniqueName: \"kubernetes.io/projected/d05e790c-f20b-4a8f-8e15-d88b08d529e7-kube-api-access-lrl7z\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.422671 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.422426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d05e790c-f20b-4a8f-8e15-d88b08d529e7-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.422671 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.422444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d05e790c-f20b-4a8f-8e15-d88b08d529e7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.422671 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.422567    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d05e790c-f20b-4a8f-8e15-d88b08d529e7-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.422671 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.422669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d05e790c-f20b-4a8f-8e15-d88b08d529e7-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.422877 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.422702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d05e790c-f20b-4a8f-8e15-d88b08d529e7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.422877 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.422838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d05e790c-f20b-4a8f-8e15-d88b08d529e7-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.423141 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.423102    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d05e790c-f20b-4a8f-8e15-d88b08d529e7-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.423261 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.422926    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d05e790c-f20b-4a8f-8e15-d88b08d529e7-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.423261 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.423107    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d05e790c-f20b-4a8f-8e15-d88b08d529e7-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.423261 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.422843    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d05e790c-f20b-4a8f-8e15-d88b08d529e7-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.423261 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.423228    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d05e790c-f20b-4a8f-8e15-d88b08d529e7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.423480 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.423315    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d05e790c-f20b-4a8f-8e15-d88b08d529e7-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.424989 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.424961    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d05e790c-f20b-4a8f-8e15-d88b08d529e7-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.425311 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.425292    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d05e790c-f20b-4a8f-8e15-d88b08d529e7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.430445 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.430413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d05e790c-f20b-4a8f-8e15-d88b08d529e7-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.430926 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.430902    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrl7z\" (UniqueName: \"kubernetes.io/projected/d05e790c-f20b-4a8f-8e15-d88b08d529e7-kube-api-access-lrl7z\") pod \"maas-default-gateway-openshift-default-5ccb968c66-f8qzg\" (UID: \"d05e790c-f20b-4a8f-8e15-d88b08d529e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.502617 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.502577    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:14.778029 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.778003    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"]
Sep 08 15:04:14.780184 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:04:14.780157    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd05e790c_f20b_4a8f_8e15_d88b08d529e7.slice/crio-f84f12c618f0d4ed2492f710debc9e87d1bb53a0fb23f8d31e85154ff11d9f41 WatchSource:0}: Error finding container f84f12c618f0d4ed2492f710debc9e87d1bb53a0fb23f8d31e85154ff11d9f41: Status 404 returned error can't find the container with id f84f12c618f0d4ed2492f710debc9e87d1bb53a0fb23f8d31e85154ff11d9f41
Sep 08 15:04:14.782209 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.782175    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:04:14.782299 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.782246    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:04:14.782299 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:14.782278    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:04:15.570700 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:15.570663    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg" event={"ID":"d05e790c-f20b-4a8f-8e15-d88b08d529e7","Type":"ContainerStarted","Data":"1a6863b20e2c71c09794179cf261de9214c3d8120716e38620ef3502c4f75967"}
Sep 08 15:04:15.571185 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:15.570720    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg" event={"ID":"d05e790c-f20b-4a8f-8e15-d88b08d529e7","Type":"ContainerStarted","Data":"f84f12c618f0d4ed2492f710debc9e87d1bb53a0fb23f8d31e85154ff11d9f41"}
Sep 08 15:04:15.591443 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:15.591394    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg" podStartSLOduration=1.591377986 podStartE2EDuration="1.591377986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:04:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:04:15.590213388 +0000 UTC m=+534.922452936" watchObservedRunningTime="2026-09-08 15:04:15.591377986 +0000 UTC m=+534.923617531"
Sep 08 15:04:16.502831 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:16.502786    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:16.507745 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:16.507715    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:16.575775 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:16.575743    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:16.576755 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:16.576736    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:04:18.318831 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:18.318793    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:04:18.322256 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:18.322237    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"
Sep 08 15:04:18.328901 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:18.328861    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8wkr4\""
Sep 08 15:04:18.329278 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:18.329255    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 15:04:18.329671 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:18.329651    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 15:04:18.329875 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:18.329857    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 15:04:18.331323 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:18.331304    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:04:18.364131 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:18.364098    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:04:18.458141 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:18.458083    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f31b9e16-e542-407a-8925-cce16945f442-config-file\") pod \"limitador-limitador-85d9db4d5d-6psdp\" (UID: \"f31b9e16-e542-407a-8925-cce16945f442\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"
Sep 08 15:04:18.458322 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:18.458225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv8nh\" (UniqueName: \"kubernetes.io/projected/f31b9e16-e542-407a-8925-cce16945f442-kube-api-access-wv8nh\") pod \"limitador-limitador-85d9db4d5d-6psdp\" (UID: \"f31b9e16-e542-407a-8925-cce16945f442\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"
Sep 08 15:04:18.558829 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:18.558792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv8nh\" (UniqueName: \"kubernetes.io/projected/f31b9e16-e542-407a-8925-cce16945f442-kube-api-access-wv8nh\") pod \"limitador-limitador-85d9db4d5d-6psdp\" (UID: \"f31b9e16-e542-407a-8925-cce16945f442\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"
Sep 08 15:04:18.559001 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:18.558892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f31b9e16-e542-407a-8925-cce16945f442-config-file\") pod \"limitador-limitador-85d9db4d5d-6psdp\" (UID: \"f31b9e16-e542-407a-8925-cce16945f442\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"
Sep 08 15:04:18.559564 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:18.559546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f31b9e16-e542-407a-8925-cce16945f442-config-file\") pod \"limitador-limitador-85d9db4d5d-6psdp\" (UID: \"f31b9e16-e542-407a-8925-cce16945f442\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"
Sep 08 15:04:18.567349 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:18.567293    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv8nh\" (UniqueName: \"kubernetes.io/projected/f31b9e16-e542-407a-8925-cce16945f442-kube-api-access-wv8nh\") pod \"limitador-limitador-85d9db4d5d-6psdp\" (UID: \"f31b9e16-e542-407a-8925-cce16945f442\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"
Sep 08 15:04:18.639244 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:18.639161    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"
Sep 08 15:04:18.922150 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:18.922125    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:04:18.924446 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:04:18.924409    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf31b9e16_e542_407a_8925_cce16945f442.slice/crio-4b9ae6bd11d57e4934c81252595c08c1c3f6f0388d939938d6f39b8a8fa5d30d WatchSource:0}: Error finding container 4b9ae6bd11d57e4934c81252595c08c1c3f6f0388d939938d6f39b8a8fa5d30d: Status 404 returned error can't find the container with id 4b9ae6bd11d57e4934c81252595c08c1c3f6f0388d939938d6f39b8a8fa5d30d
Sep 08 15:04:19.590521 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:19.590482    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6psdp" event={"ID":"f31b9e16-e542-407a-8925-cce16945f442","Type":"ContainerStarted","Data":"4b9ae6bd11d57e4934c81252595c08c1c3f6f0388d939938d6f39b8a8fa5d30d"}
Sep 08 15:04:21.601970 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:21.601930    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6psdp" event={"ID":"f31b9e16-e542-407a-8925-cce16945f442","Type":"ContainerStarted","Data":"b2bf119e42d27a2f96a904901c9e4579cffc0dbca274cdf6461a24ff219dc60d"}
Sep 08 15:04:21.602339 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:21.602036    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"
Sep 08 15:04:21.618239 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:21.618190    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6psdp" podStartSLOduration=1.3523121169999999 podStartE2EDuration="3.618173373s" totalImagesPullingTime="2.265861256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:04:21.617217369 +0000 UTC m=+540.949456915" watchObservedRunningTime="2026-09-08 15:04:21.618173373 +0000 UTC m=+540.950412918"
Sep 08 15:04:32.608202 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:04:32.608170    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"
Sep 08 15:05:21.073355 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:21.073322    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 15:05:21.074721 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:21.074700    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 15:05:35.690012 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:35.689972    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:05:35.778198 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:35.778166    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-zbtzp"]
Sep 08 15:05:35.780557 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:35.780541    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zbtzp"
Sep 08 15:05:35.783274 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:35.783255    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-s67w9\""
Sep 08 15:05:35.785272 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:35.785255    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 08 15:05:35.795698 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:35.795672    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-zbtzp"]
Sep 08 15:05:35.860618 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:35.860580    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80e35f98-1e75-4fbb-b44a-bfd930bb8458-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-zbtzp\" (UID: \"80e35f98-1e75-4fbb-b44a-bfd930bb8458\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zbtzp"
Sep 08 15:05:35.860791 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:35.860704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw9dw\" (UniqueName: \"kubernetes.io/projected/80e35f98-1e75-4fbb-b44a-bfd930bb8458-kube-api-access-hw9dw\") pod \"payload-pre-processing-59fbc47bf8-zbtzp\" (UID: \"80e35f98-1e75-4fbb-b44a-bfd930bb8458\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zbtzp"
Sep 08 15:05:35.961368 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:35.961274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80e35f98-1e75-4fbb-b44a-bfd930bb8458-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-zbtzp\" (UID: \"80e35f98-1e75-4fbb-b44a-bfd930bb8458\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zbtzp"
Sep 08 15:05:35.961368 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:35.961356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw9dw\" (UniqueName: \"kubernetes.io/projected/80e35f98-1e75-4fbb-b44a-bfd930bb8458-kube-api-access-hw9dw\") pod \"payload-pre-processing-59fbc47bf8-zbtzp\" (UID: \"80e35f98-1e75-4fbb-b44a-bfd930bb8458\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zbtzp"
Sep 08 15:05:35.962064 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:35.962041    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80e35f98-1e75-4fbb-b44a-bfd930bb8458-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-zbtzp\" (UID: \"80e35f98-1e75-4fbb-b44a-bfd930bb8458\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zbtzp"
Sep 08 15:05:35.969922 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:35.969895    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw9dw\" (UniqueName: \"kubernetes.io/projected/80e35f98-1e75-4fbb-b44a-bfd930bb8458-kube-api-access-hw9dw\") pod \"payload-pre-processing-59fbc47bf8-zbtzp\" (UID: \"80e35f98-1e75-4fbb-b44a-bfd930bb8458\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zbtzp"
Sep 08 15:05:36.091067 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:36.091030    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zbtzp"
Sep 08 15:05:36.394594 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:36.394532    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-zbtzp"]
Sep 08 15:05:36.396771 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:05:36.396744    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e35f98_1e75_4fbb_b44a_bfd930bb8458.slice/crio-1e7dba3ebe00a09766e53fdf6cfb4fd8ce9ca162201c4587467f95ee0006f879 WatchSource:0}: Error finding container 1e7dba3ebe00a09766e53fdf6cfb4fd8ce9ca162201c4587467f95ee0006f879: Status 404 returned error can't find the container with id 1e7dba3ebe00a09766e53fdf6cfb4fd8ce9ca162201c4587467f95ee0006f879
Sep 08 15:05:36.398693 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:36.398677    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:05:36.948413 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:36.948366    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zbtzp" event={"ID":"80e35f98-1e75-4fbb-b44a-bfd930bb8458","Type":"ContainerStarted","Data":"1e7dba3ebe00a09766e53fdf6cfb4fd8ce9ca162201c4587467f95ee0006f879"}
Sep 08 15:05:39.969442 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:39.969401    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zbtzp" event={"ID":"80e35f98-1e75-4fbb-b44a-bfd930bb8458","Type":"ContainerStarted","Data":"3ac23ad2b17cd11ce220c69b1df4d625d0103b0617a8cd4a19dd3a5557cb8a67"}
Sep 08 15:05:39.969853 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:39.969532    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zbtzp"
Sep 08 15:05:39.985882 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:39.985810    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zbtzp" podStartSLOduration=2.084980662 podStartE2EDuration="4.985795898s" totalImagesPullingTime="2.900815236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:05:39.985489296 +0000 UTC m=+619.317728841" watchObservedRunningTime="2026-09-08 15:05:39.985795898 +0000 UTC m=+619.318035444"
Sep 08 15:05:44.994155 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:44.994114    2580 generic.go:356] "Generic (PLEG): container finished" podID="d05e790c-f20b-4a8f-8e15-d88b08d529e7" containerID="1a6863b20e2c71c09794179cf261de9214c3d8120716e38620ef3502c4f75967" exitCode=0
Sep 08 15:05:44.994575 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:44.994184    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg" event={"ID":"d05e790c-f20b-4a8f-8e15-d88b08d529e7","Type":"ContainerDied","Data":"1a6863b20e2c71c09794179cf261de9214c3d8120716e38620ef3502c4f75967"}
Sep 08 15:05:44.994640 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:44.994624    2580 scope.go:117] "RemoveContainer" containerID="1a6863b20e2c71c09794179cf261de9214c3d8120716e38620ef3502c4f75967"
Sep 08 15:05:44.995654 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:44.995621    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:05:44.995726 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:44.995708    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:05:44.995774 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:44.995759    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:05:46.000636 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:46.000604    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg" event={"ID":"d05e790c-f20b-4a8f-8e15-d88b08d529e7","Type":"ContainerStarted","Data":"60f082862ea825ba37b48fd4b24fad32501226738b294db7ff6458558207be2e"}
Sep 08 15:05:46.502925 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:46.502886    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:05:46.504111 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:46.504081    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-f8qzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 08 15:05:46.504224 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:46.504139    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg" podUID="d05e790c-f20b-4a8f-8e15-d88b08d529e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 08 15:05:46.576446 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:46.576410    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:05:47.503742 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:47.503701    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-f8qzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 08 15:05:47.504170 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:47.503773    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg" podUID="d05e790c-f20b-4a8f-8e15-d88b08d529e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 08 15:05:48.503922 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:48.503873    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-f8qzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 08 15:05:48.504348 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:48.503943    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg" podUID="d05e790c-f20b-4a8f-8e15-d88b08d529e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 08 15:05:49.503269 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:49.503228    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-f8qzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 08 15:05:49.503477 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:49.503297    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg" podUID="d05e790c-f20b-4a8f-8e15-d88b08d529e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 08 15:05:50.504017 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:50.503980    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-f8qzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 08 15:05:50.504486 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:50.504043    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg" podUID="d05e790c-f20b-4a8f-8e15-d88b08d529e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 08 15:05:50.976684 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:50.976646    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zbtzp"
Sep 08 15:05:51.396008 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.395921    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"]
Sep 08 15:05:51.400921 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.400893    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.403409 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.403379    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 15:05:51.403609 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.403379    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 15:05:51.404549 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.404178    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mw2sm\""
Sep 08 15:05:51.405088 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.405066    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 08 15:05:51.407621 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.407595    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"]
Sep 08 15:05:51.506203 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.506164    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd24f357-0c38-461c-bebd-93623fe82120-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.506675 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.506214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbz7s\" (UniqueName: \"kubernetes.io/projected/fd24f357-0c38-461c-bebd-93623fe82120-kube-api-access-rbz7s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.506675 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.506354    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd24f357-0c38-461c-bebd-93623fe82120-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.506675 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.506385    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd24f357-0c38-461c-bebd-93623fe82120-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.506675 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.506404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd24f357-0c38-461c-bebd-93623fe82120-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.506675 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.506465    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd24f357-0c38-461c-bebd-93623fe82120-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.507716 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.507699    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:05:51.508767 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.508737    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-f8qzg"
Sep 08 15:05:51.607249 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.607208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd24f357-0c38-461c-bebd-93623fe82120-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.607427 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.607266    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd24f357-0c38-461c-bebd-93623fe82120-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.607427 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.607294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd24f357-0c38-461c-bebd-93623fe82120-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.607427 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.607359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd24f357-0c38-461c-bebd-93623fe82120-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.607427 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.607392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd24f357-0c38-461c-bebd-93623fe82120-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.607683 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.607437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbz7s\" (UniqueName: \"kubernetes.io/projected/fd24f357-0c38-461c-bebd-93623fe82120-kube-api-access-rbz7s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.607990 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.607920    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd24f357-0c38-461c-bebd-93623fe82120-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.607990 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.607935    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd24f357-0c38-461c-bebd-93623fe82120-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.608223 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.608202    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd24f357-0c38-461c-bebd-93623fe82120-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.610205 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.610181    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd24f357-0c38-461c-bebd-93623fe82120-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.610444 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.610428    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd24f357-0c38-461c-bebd-93623fe82120-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.615956 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.615928    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbz7s\" (UniqueName: \"kubernetes.io/projected/fd24f357-0c38-461c-bebd-93623fe82120-kube-api-access-rbz7s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s\" (UID: \"fd24f357-0c38-461c-bebd-93623fe82120\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.714918 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.714876    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:05:51.999861 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:51.999826    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"]
Sep 08 15:05:52.002363 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:05:52.002338    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd24f357_0c38_461c_bebd_93623fe82120.slice/crio-5f69f9d226857ba58de1ab2c1a6fcf0ab95deec25475342506258bcd5e150570 WatchSource:0}: Error finding container 5f69f9d226857ba58de1ab2c1a6fcf0ab95deec25475342506258bcd5e150570: Status 404 returned error can't find the container with id 5f69f9d226857ba58de1ab2c1a6fcf0ab95deec25475342506258bcd5e150570
Sep 08 15:05:52.019799 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:52.019769    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:05:52.030107 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:52.030074    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s" event={"ID":"fd24f357-0c38-461c-bebd-93623fe82120","Type":"ContainerStarted","Data":"5f69f9d226857ba58de1ab2c1a6fcf0ab95deec25475342506258bcd5e150570"}
Sep 08 15:05:54.044268 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:54.044226    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s" event={"ID":"fd24f357-0c38-461c-bebd-93623fe82120","Type":"ContainerStarted","Data":"ef60c529c6b7f279f1f146176069a55fd7ffc0db3eb16936d87842716852d356"}
Sep 08 15:05:54.061502 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:05:54.061451    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s" podStartSLOduration=1.945092826 podStartE2EDuration="3.06143546s" totalImagesPullingTime="1.116342634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:05:54.060216705 +0000 UTC m=+633.392456251" watchObservedRunningTime="2026-09-08 15:05:54.06143546 +0000 UTC m=+633.393675006"
Sep 08 15:06:01.715038 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:01.714977    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:06:01.715562 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:01.715064    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:06:01.727623 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:01.727596    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:06:02.092059 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:02.091971    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s"
Sep 08 15:06:06.915574 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:06.915533    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:06:18.016301 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:18.016267    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:06:24.910111 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:24.910071    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:06:44.092741 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.092709    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"]
Sep 08 15:06:44.096634 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.096612    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.099254 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.099233    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 08 15:06:44.108640 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.108613    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"]
Sep 08 15:06:44.193171 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.193130    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.193171 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.193173    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2wgq\" (UniqueName: \"kubernetes.io/projected/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-kube-api-access-c2wgq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.193376 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.193203    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.193376 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.193286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.193376 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.193321    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.193376 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.193360    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.293951 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.293917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.294126 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.294016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.294126 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.294045    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2wgq\" (UniqueName: \"kubernetes.io/projected/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-kube-api-access-c2wgq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.294126 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.294084    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.294285 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.294115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.294285 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.294160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.294428 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.294408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.294501 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.294483    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.294576 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.294489    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.296475 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.296450    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.296897 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.296880    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.302663 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.302641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2wgq\" (UniqueName: \"kubernetes.io/projected/e3230790-1c5a-4c7e-ad0c-8a374ca5087c-kube-api-access-c2wgq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89\" (UID: \"e3230790-1c5a-4c7e-ad0c-8a374ca5087c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.408694 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.408594    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:44.680330 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:44.680303    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"]
Sep 08 15:06:44.682741 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:06:44.682708    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3230790_1c5a_4c7e_ad0c_8a374ca5087c.slice/crio-ce542e68e66cd6fd2404cab76b785d3b9b133ae81199a73c5bdcc55e1d230dc0 WatchSource:0}: Error finding container ce542e68e66cd6fd2404cab76b785d3b9b133ae81199a73c5bdcc55e1d230dc0: Status 404 returned error can't find the container with id ce542e68e66cd6fd2404cab76b785d3b9b133ae81199a73c5bdcc55e1d230dc0
Sep 08 15:06:45.304082 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:45.304047    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89" event={"ID":"e3230790-1c5a-4c7e-ad0c-8a374ca5087c","Type":"ContainerStarted","Data":"c666929b4108b59cb653b56d211f20983e3617285df60316d7464948fb6b9882"}
Sep 08 15:06:45.304525 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:45.304103    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89" event={"ID":"e3230790-1c5a-4c7e-ad0c-8a374ca5087c","Type":"ContainerStarted","Data":"ce542e68e66cd6fd2404cab76b785d3b9b133ae81199a73c5bdcc55e1d230dc0"}
Sep 08 15:06:45.322176 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:45.322118    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89" podStartSLOduration=1.117228435 podStartE2EDuration="1.322100429s" totalImagesPullingTime="204.871994ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:06:45.32086595 +0000 UTC m=+684.653105495" watchObservedRunningTime="2026-09-08 15:06:45.322100429 +0000 UTC m=+684.654339975"
Sep 08 15:06:45.514180 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:45.514144    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:06:54.408723 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:54.408690    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:54.409238 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:54.408774    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:54.421544 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:54.421501    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:06:55.363641 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:06:55.363612    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89"
Sep 08 15:07:00.303676 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:07:00.303640    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:07:15.711729 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:07:15.711647    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:08:28.567281 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.567249    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"]
Sep 08 15:08:28.570608 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.570587    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.574264 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.574242    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a1592f-openshift-default-dockercfg-dql56\""
Sep 08 15:08:28.587239 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.587208    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"]
Sep 08 15:08:28.747950 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.747910    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-istio-data\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.747950 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.747957    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-workload-socket\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.748264 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.748057    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f583cf51-15ca-41e3-9c90-1777460151c5-istio-token\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.748264 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.748104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-istio-envoy\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.748264 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.748146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npxcl\" (UniqueName: \"kubernetes.io/projected/f583cf51-15ca-41e3-9c90-1777460151c5-kube-api-access-npxcl\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.748264 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.748188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f583cf51-15ca-41e3-9c90-1777460151c5-istio-podinfo\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.748264 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.748233    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-credential-socket\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.748264 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.748252    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-workload-certs\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.748264 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.748268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f583cf51-15ca-41e3-9c90-1777460151c5-istiod-ca-cert\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.849092 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.848990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-istio-data\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.849092 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.849030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-workload-socket\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.849092 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.849074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f583cf51-15ca-41e3-9c90-1777460151c5-istio-token\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.849389 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.849105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-istio-envoy\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.849389 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.849128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npxcl\" (UniqueName: \"kubernetes.io/projected/f583cf51-15ca-41e3-9c90-1777460151c5-kube-api-access-npxcl\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.849389 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.849251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f583cf51-15ca-41e3-9c90-1777460151c5-istio-podinfo\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.849389 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.849298    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-credential-socket\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.849389 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.849332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-workload-certs\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.849389 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.849355    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f583cf51-15ca-41e3-9c90-1777460151c5-istiod-ca-cert\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.849707 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.849458    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-istio-data\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.849766 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.849735    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-credential-socket\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.849925 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.849905    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-workload-socket\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.850269 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.850241    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f583cf51-15ca-41e3-9c90-1777460151c5-istiod-ca-cert\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.850391 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.850241    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-workload-certs\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.851754 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.851720    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-istio-envoy\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.851916 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.851899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f583cf51-15ca-41e3-9c90-1777460151c5-istio-podinfo\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.857406 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.857376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f583cf51-15ca-41e3-9c90-1777460151c5-istio-token\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.858019 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.857984    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npxcl\" (UniqueName: \"kubernetes.io/projected/f583cf51-15ca-41e3-9c90-1777460151c5-kube-api-access-npxcl\") pod \"e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") " pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:28.884889 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:28.884846    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:29.181229 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:29.181205    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"]
Sep 08 15:08:29.183398 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:08:29.183365    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf583cf51_15ca_41e3_9c90_1777460151c5.slice/crio-3120b36fdbef9339d7201ad1220c12effd5ef65d83d39faf62adf9312708d6f5 WatchSource:0}: Error finding container 3120b36fdbef9339d7201ad1220c12effd5ef65d83d39faf62adf9312708d6f5: Status 404 returned error can't find the container with id 3120b36fdbef9339d7201ad1220c12effd5ef65d83d39faf62adf9312708d6f5
Sep 08 15:08:29.186086 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:29.186028    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:08:29.186363 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:29.186338    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:08:29.186568 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:29.186544    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:08:29.835786 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:29.835747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt" event={"ID":"f583cf51-15ca-41e3-9c90-1777460151c5","Type":"ContainerStarted","Data":"dd75fe57c63704b673596ee93d3279390fc2e590ffc04b1958278920597a947d"}
Sep 08 15:08:29.836195 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:29.835844    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt" event={"ID":"f583cf51-15ca-41e3-9c90-1777460151c5","Type":"ContainerStarted","Data":"3120b36fdbef9339d7201ad1220c12effd5ef65d83d39faf62adf9312708d6f5"}
Sep 08 15:08:29.858278 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:29.858203    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt" podStartSLOduration=1.858182517 podStartE2EDuration="1.858182517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:08:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:08:29.858051787 +0000 UTC m=+789.190291378" watchObservedRunningTime="2026-09-08 15:08:29.858182517 +0000 UTC m=+789.190422065"
Sep 08 15:08:29.884998 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:29.884961    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:30.891096 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:30.891064    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:31.708826 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:31.708792    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:08:31.845327 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:31.845294    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:31.846252 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:31.846227    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:33.307986 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:33.307955    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7752-140253605945136"]
Sep 08 15:08:33.311369 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:33.311350    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7752-140253605945136"
Sep 08 15:08:33.313572 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:33.313550    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sd75n\""
Sep 08 15:08:33.318192 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:33.318167    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7752-140253605945136"]
Sep 08 15:08:33.497812 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:33.497772    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nptcx\" (UniqueName: \"kubernetes.io/projected/f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0-kube-api-access-nptcx\") pod \"test-curl-7752-140253605945136\" (UID: \"f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0\") " pod="opendatahub/test-curl-7752-140253605945136"
Sep 08 15:08:33.599144 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:33.599047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nptcx\" (UniqueName: \"kubernetes.io/projected/f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0-kube-api-access-nptcx\") pod \"test-curl-7752-140253605945136\" (UID: \"f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0\") " pod="opendatahub/test-curl-7752-140253605945136"
Sep 08 15:08:33.610150 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:33.610124    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nptcx\" (UniqueName: \"kubernetes.io/projected/f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0-kube-api-access-nptcx\") pod \"test-curl-7752-140253605945136\" (UID: \"f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0\") " pod="opendatahub/test-curl-7752-140253605945136"
Sep 08 15:08:33.623025 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:33.622994    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7752-140253605945136"
Sep 08 15:08:33.755240 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:33.755203    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"]
Sep 08 15:08:33.761830 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:33.761796    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"
Sep 08 15:08:33.765581 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:33.765549    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-a1592f\""
Sep 08 15:08:33.765581 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:33.765553    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-a1592f-dockercfg-5c2fp\""
Sep 08 15:08:33.774366 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:33.774336    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"]
Sep 08 15:08:33.902072 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:33.901983    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7zn2\" (UniqueName: \"kubernetes.io/projected/42b7b7b5-9625-4a77-86fe-17c5525882db-kube-api-access-g7zn2\") pod \"payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2\" (UID: \"42b7b7b5-9625-4a77-86fe-17c5525882db\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"
Sep 08 15:08:33.902248 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:33.902123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42b7b7b5-9625-4a77-86fe-17c5525882db-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2\" (UID: \"42b7b7b5-9625-4a77-86fe-17c5525882db\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"
Sep 08 15:08:33.904242 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:33.904217    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7752-140253605945136"]
Sep 08 15:08:33.906826 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:08:33.906797    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6cff041_b4dd_4ca3_bd45_032d8fc6b8c0.slice/crio-7a56c61000359815703d0b9ba9c0bd9c54ff5042527a1ee7fd5d55f8ff05621e WatchSource:0}: Error finding container 7a56c61000359815703d0b9ba9c0bd9c54ff5042527a1ee7fd5d55f8ff05621e: Status 404 returned error can't find the container with id 7a56c61000359815703d0b9ba9c0bd9c54ff5042527a1ee7fd5d55f8ff05621e
Sep 08 15:08:34.003406 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:34.003358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7zn2\" (UniqueName: \"kubernetes.io/projected/42b7b7b5-9625-4a77-86fe-17c5525882db-kube-api-access-g7zn2\") pod \"payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2\" (UID: \"42b7b7b5-9625-4a77-86fe-17c5525882db\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"
Sep 08 15:08:34.003624 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:34.003458    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42b7b7b5-9625-4a77-86fe-17c5525882db-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2\" (UID: \"42b7b7b5-9625-4a77-86fe-17c5525882db\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"
Sep 08 15:08:34.004216 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:34.004192    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42b7b7b5-9625-4a77-86fe-17c5525882db-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2\" (UID: \"42b7b7b5-9625-4a77-86fe-17c5525882db\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"
Sep 08 15:08:34.012360 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:34.012336    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7zn2\" (UniqueName: \"kubernetes.io/projected/42b7b7b5-9625-4a77-86fe-17c5525882db-kube-api-access-g7zn2\") pod \"payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2\" (UID: \"42b7b7b5-9625-4a77-86fe-17c5525882db\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"
Sep 08 15:08:34.075323 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:34.075284    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"
Sep 08 15:08:34.349774 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:34.349746    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"]
Sep 08 15:08:34.351712 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:08:34.351684    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b7b7b5_9625_4a77_86fe_17c5525882db.slice/crio-8efe9ec83347b1deb7b4d959b539a096841b4912a086d8a146fb854a3279adb2 WatchSource:0}: Error finding container 8efe9ec83347b1deb7b4d959b539a096841b4912a086d8a146fb854a3279adb2: Status 404 returned error can't find the container with id 8efe9ec83347b1deb7b4d959b539a096841b4912a086d8a146fb854a3279adb2
Sep 08 15:08:34.863995 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:34.863959    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2" event={"ID":"42b7b7b5-9625-4a77-86fe-17c5525882db","Type":"ContainerStarted","Data":"69f2a64cdea29d2f4d587a9ec2755174bdc82ba4de9dc83558b0193c88785c96"}
Sep 08 15:08:34.864196 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:34.864015    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2" event={"ID":"42b7b7b5-9625-4a77-86fe-17c5525882db","Type":"ContainerStarted","Data":"8efe9ec83347b1deb7b4d959b539a096841b4912a086d8a146fb854a3279adb2"}
Sep 08 15:08:34.864196 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:34.864045    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"
Sep 08 15:08:34.865294 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:34.865265    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7752-140253605945136" event={"ID":"f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0","Type":"ContainerStarted","Data":"7a56c61000359815703d0b9ba9c0bd9c54ff5042527a1ee7fd5d55f8ff05621e"}
Sep 08 15:08:34.880658 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:34.880579    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2" podStartSLOduration=1.8805640879999999 podStartE2EDuration="1.880564088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:08:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:08:34.879382852 +0000 UTC m=+794.211622400" watchObservedRunningTime="2026-09-08 15:08:34.880564088 +0000 UTC m=+794.212803635"
Sep 08 15:08:36.878804 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:36.878771    2580 generic.go:356] "Generic (PLEG): container finished" podID="f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0" containerID="a1a535fae42f1998baaf9a8c68a6153c7c14f5b655793da3a64c92f96c585935" exitCode=0
Sep 08 15:08:36.879204 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:36.878872    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7752-140253605945136" event={"ID":"f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0","Type":"ContainerDied","Data":"a1a535fae42f1998baaf9a8c68a6153c7c14f5b655793da3a64c92f96c585935"}
Sep 08 15:08:38.018917 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:38.018891    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7752-140253605945136"
Sep 08 15:08:38.068359 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:38.068327    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7752-140253605945136_f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0/test-curl-7752-140253605945136/0.log"
Sep 08 15:08:38.095854 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:38.095817    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7752-140253605945136"]
Sep 08 15:08:38.100383 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:38.100347    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7752-140253605945136"]
Sep 08 15:08:38.141573 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:38.141468    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nptcx\" (UniqueName: \"kubernetes.io/projected/f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0-kube-api-access-nptcx\") pod \"f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0\" (UID: \"f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0\") "
Sep 08 15:08:38.143783 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:38.143747    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0-kube-api-access-nptcx" (OuterVolumeSpecName: "kube-api-access-nptcx") pod "f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0" (UID: "f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0"). InnerVolumeSpecName "kube-api-access-nptcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:08:38.242107 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:38.242067    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nptcx\" (UniqueName: \"kubernetes.io/projected/f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0-kube-api-access-nptcx\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:08:38.891653 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:38.891626    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a56c61000359815703d0b9ba9c0bd9c54ff5042527a1ee7fd5d55f8ff05621e"
Sep 08 15:08:38.891960 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:38.891943    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7752-140253605945136"
Sep 08 15:08:38.904597 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:38.904563    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"]
Sep 08 15:08:38.905132 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:38.905114    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0" containerName="test-curl-7752-140253605945136"
Sep 08 15:08:38.905179 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:38.905134    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0" containerName="test-curl-7752-140253605945136"
Sep 08 15:08:38.905213 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:38.905194    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0" containerName="test-curl-7752-140253605945136"
Sep 08 15:08:38.906769 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:08:38.906739    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7752-140253605945136\" is forbidden: User \"system:node:ip-10-0-134-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-147.ec2.internal' and this object" podUID="f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0" pod="opendatahub/test-curl-7752-140253605945136"
Sep 08 15:08:38.908576 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:38.908561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:38.910557 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:08:38.910494    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7752-140253605945136\" is forbidden: User \"system:node:ip-10-0-134-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-147.ec2.internal' and this object" podUID="f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0" pod="opendatahub/test-curl-7752-140253605945136"
Sep 08 15:08:38.910934 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:38.910917    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-6b2b2e-openshift-default-dockercfg-b7t9l\""
Sep 08 15:08:38.945657 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:38.930870    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"]
Sep 08 15:08:39.050532 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.050001    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-credential-socket\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.050532 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.050084    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-workload-socket\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.050532 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.050113    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq8c6\" (UniqueName: \"kubernetes.io/projected/7994a1be-f043-49f5-9601-efe59dd1d6e8-kube-api-access-tq8c6\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.050532 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.050140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-envoy\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.050532 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.050206    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-workload-certs\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.050532 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.050249    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7994a1be-f043-49f5-9601-efe59dd1d6e8-istiod-ca-cert\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.050532 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.050282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-data\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.050532 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.050305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-podinfo\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.050532 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.050348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-token\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.152146 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.152052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-token\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.152828 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.152798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-credential-socket\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.152986 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.152875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-workload-socket\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.152986 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.152913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq8c6\" (UniqueName: \"kubernetes.io/projected/7994a1be-f043-49f5-9601-efe59dd1d6e8-kube-api-access-tq8c6\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.152986 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.152942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-envoy\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.153148 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.153016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-workload-certs\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.153148 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.153060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7994a1be-f043-49f5-9601-efe59dd1d6e8-istiod-ca-cert\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.153148 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.153092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-data\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.153148 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.153116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-podinfo\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.153913 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.153888    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-workload-socket\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.154265 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.154243    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-data\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.154601 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.154559    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-workload-certs\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.154767 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.154746    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-credential-socket\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.155494 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.155469    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7994a1be-f043-49f5-9601-efe59dd1d6e8-istiod-ca-cert\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.156495 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.156472    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-podinfo\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.158153 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.158129    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-envoy\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.159870 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.159844    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0" path="/var/lib/kubelet/pods/f6cff041-b4dd-4ca3-bd45-032d8fc6b8c0/volumes"
Sep 08 15:08:39.160953 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.160928    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-token\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.162288 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.162270    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq8c6\" (UniqueName: \"kubernetes.io/projected/7994a1be-f043-49f5-9601-efe59dd1d6e8-kube-api-access-tq8c6\") pod \"e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") " pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.226731 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.226701    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:39.527950 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.527913    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"]
Sep 08 15:08:39.532031 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:08:39.531990    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7994a1be_f043_49f5_9601_efe59dd1d6e8.slice/crio-1172aa65f6b4fe25b74f8b0e8c99b2f2e5be68fcd3c2d6c5e93191bcf0d2c6d1 WatchSource:0}: Error finding container 1172aa65f6b4fe25b74f8b0e8c99b2f2e5be68fcd3c2d6c5e93191bcf0d2c6d1: Status 404 returned error can't find the container with id 1172aa65f6b4fe25b74f8b0e8c99b2f2e5be68fcd3c2d6c5e93191bcf0d2c6d1
Sep 08 15:08:39.545635 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.545586    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:08:39.545781 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.545686    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:08:39.545781 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.545736    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:08:39.898036 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.897937    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph" event={"ID":"7994a1be-f043-49f5-9601-efe59dd1d6e8","Type":"ContainerStarted","Data":"539f126e5ef752cdb4be9c7cb0aea97e58f2a3852f03116661aeee5ac9e9ab25"}
Sep 08 15:08:39.898036 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.898006    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph" event={"ID":"7994a1be-f043-49f5-9601-efe59dd1d6e8","Type":"ContainerStarted","Data":"1172aa65f6b4fe25b74f8b0e8c99b2f2e5be68fcd3c2d6c5e93191bcf0d2c6d1"}
Sep 08 15:08:39.918664 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:39.918610    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph" podStartSLOduration=1.918590891 podStartE2EDuration="1.918590891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:08:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:08:39.917010382 +0000 UTC m=+799.249249943" watchObservedRunningTime="2026-09-08 15:08:39.918590891 +0000 UTC m=+799.250830481"
Sep 08 15:08:40.227880 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:40.227837    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:40.240075 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:40.240040    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:40.902850 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:40.902822    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:40.903965 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:40.903945    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:08:43.817479 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:43.817389    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"]
Sep 08 15:08:43.821119 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:43.821101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"
Sep 08 15:08:43.824032 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:43.824006    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-6b2b2e-dockercfg-szl27\""
Sep 08 15:08:43.824162 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:43.824009    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-6b2b2e\""
Sep 08 15:08:43.839081 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:43.839041    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"]
Sep 08 15:08:43.898929 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:43.898888    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03d93fa1-c73a-4c9f-82d2-fabf7b623d7d-plugins-config-volume\") pod \"payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq\" (UID: \"03d93fa1-c73a-4c9f-82d2-fabf7b623d7d\") " pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"
Sep 08 15:08:43.899101 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:43.898945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v6z9\" (UniqueName: \"kubernetes.io/projected/03d93fa1-c73a-4c9f-82d2-fabf7b623d7d-kube-api-access-9v6z9\") pod \"payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq\" (UID: \"03d93fa1-c73a-4c9f-82d2-fabf7b623d7d\") " pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"
Sep 08 15:08:43.999782 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:43.999737    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v6z9\" (UniqueName: \"kubernetes.io/projected/03d93fa1-c73a-4c9f-82d2-fabf7b623d7d-kube-api-access-9v6z9\") pod \"payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq\" (UID: \"03d93fa1-c73a-4c9f-82d2-fabf7b623d7d\") " pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"
Sep 08 15:08:43.999957 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:43.999857    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03d93fa1-c73a-4c9f-82d2-fabf7b623d7d-plugins-config-volume\") pod \"payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq\" (UID: \"03d93fa1-c73a-4c9f-82d2-fabf7b623d7d\") " pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"
Sep 08 15:08:44.000540 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.000496    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03d93fa1-c73a-4c9f-82d2-fabf7b623d7d-plugins-config-volume\") pod \"payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq\" (UID: \"03d93fa1-c73a-4c9f-82d2-fabf7b623d7d\") " pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"
Sep 08 15:08:44.008252 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.008230    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v6z9\" (UniqueName: \"kubernetes.io/projected/03d93fa1-c73a-4c9f-82d2-fabf7b623d7d-kube-api-access-9v6z9\") pod \"payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq\" (UID: \"03d93fa1-c73a-4c9f-82d2-fabf7b623d7d\") " pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"
Sep 08 15:08:44.143803 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.143709    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"
Sep 08 15:08:44.428575 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.428543    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"]
Sep 08 15:08:44.430827 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:08:44.430795    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d93fa1_c73a_4c9f_82d2_fabf7b623d7d.slice/crio-4668b7356975cc3e0bb7226992241390cd59f7ef715355f3e4e96d31db06c00b WatchSource:0}: Error finding container 4668b7356975cc3e0bb7226992241390cd59f7ef715355f3e4e96d31db06c00b: Status 404 returned error can't find the container with id 4668b7356975cc3e0bb7226992241390cd59f7ef715355f3e4e96d31db06c00b
Sep 08 15:08:44.605995 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.605910    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:08:44.743122 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.743090    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"]
Sep 08 15:08:44.747127 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.747101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"
Sep 08 15:08:44.749586 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.749558    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4510c66e\""
Sep 08 15:08:44.758344 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.758077    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"]
Sep 08 15:08:44.808468 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.808430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc9ce8c1-ad80-4868-b17d-4671877107ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj\" (UID: \"dc9ce8c1-ad80-4868-b17d-4671877107ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"
Sep 08 15:08:44.808695 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.808588    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lfhg\" (UniqueName: \"kubernetes.io/projected/dc9ce8c1-ad80-4868-b17d-4671877107ff-kube-api-access-9lfhg\") pod \"payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj\" (UID: \"dc9ce8c1-ad80-4868-b17d-4671877107ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"
Sep 08 15:08:44.909565 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.909500    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lfhg\" (UniqueName: \"kubernetes.io/projected/dc9ce8c1-ad80-4868-b17d-4671877107ff-kube-api-access-9lfhg\") pod \"payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj\" (UID: \"dc9ce8c1-ad80-4868-b17d-4671877107ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"
Sep 08 15:08:44.910031 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.909614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc9ce8c1-ad80-4868-b17d-4671877107ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj\" (UID: \"dc9ce8c1-ad80-4868-b17d-4671877107ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"
Sep 08 15:08:44.910266 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.910248    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc9ce8c1-ad80-4868-b17d-4671877107ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj\" (UID: \"dc9ce8c1-ad80-4868-b17d-4671877107ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"
Sep 08 15:08:44.917476 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.917448    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lfhg\" (UniqueName: \"kubernetes.io/projected/dc9ce8c1-ad80-4868-b17d-4671877107ff-kube-api-access-9lfhg\") pod \"payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj\" (UID: \"dc9ce8c1-ad80-4868-b17d-4671877107ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"
Sep 08 15:08:44.928927 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.928881    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq" event={"ID":"03d93fa1-c73a-4c9f-82d2-fabf7b623d7d","Type":"ContainerStarted","Data":"e686d273efaf45d3a9f1f72a589e8c9a26c7f4ac464708ec2eda3114e2488849"}
Sep 08 15:08:44.929058 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.928956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq" event={"ID":"03d93fa1-c73a-4c9f-82d2-fabf7b623d7d","Type":"ContainerStarted","Data":"4668b7356975cc3e0bb7226992241390cd59f7ef715355f3e4e96d31db06c00b"}
Sep 08 15:08:44.929757 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.929736    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"
Sep 08 15:08:44.947825 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:44.947768    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq" podStartSLOduration=1.947750917 podStartE2EDuration="1.947750917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:08:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:08:44.945670597 +0000 UTC m=+804.277910173" watchObservedRunningTime="2026-09-08 15:08:44.947750917 +0000 UTC m=+804.279990463"
Sep 08 15:08:45.061549 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:45.061394    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"
Sep 08 15:08:45.336910 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:45.336875    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"]
Sep 08 15:08:45.339957 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:08:45.339918    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc9ce8c1_ad80_4868_b17d_4671877107ff.slice/crio-7072bcf9eb7a2efc06454603c3a5a8e9ba52fd190f8f54aa13ae7dc7df06dc55 WatchSource:0}: Error finding container 7072bcf9eb7a2efc06454603c3a5a8e9ba52fd190f8f54aa13ae7dc7df06dc55: Status 404 returned error can't find the container with id 7072bcf9eb7a2efc06454603c3a5a8e9ba52fd190f8f54aa13ae7dc7df06dc55
Sep 08 15:08:45.873124 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:45.873090    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"
Sep 08 15:08:45.937210 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:45.937173    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj" event={"ID":"dc9ce8c1-ad80-4868-b17d-4671877107ff","Type":"ContainerStarted","Data":"315d210c16566f41cb228848b56e475a9df1204237c640fe8890f7aafdf80b66"}
Sep 08 15:08:45.938066 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:45.937240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj" event={"ID":"dc9ce8c1-ad80-4868-b17d-4671877107ff","Type":"ContainerStarted","Data":"7072bcf9eb7a2efc06454603c3a5a8e9ba52fd190f8f54aa13ae7dc7df06dc55"}
Sep 08 15:08:45.938066 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:45.937286    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"
Sep 08 15:08:45.954017 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:45.953957    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj" podStartSLOduration=1.9539333239999999 podStartE2EDuration="1.953933324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:08:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:08:45.951718471 +0000 UTC m=+805.283958029" watchObservedRunningTime="2026-09-08 15:08:45.953933324 +0000 UTC m=+805.286172870"
Sep 08 15:08:47.266419 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:47.266056    2580 patch_prober.go:28] interesting pod/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": read tcp 10.133.0.2:35358->10.133.0.36:15021: read: connection reset by peer" start-of-body=
Sep 08 15:08:47.266419 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:47.266126    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt" podUID="f583cf51-15ca-41e3-9c90-1777460151c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": read tcp 10.133.0.2:35358->10.133.0.36:15021: read: connection reset by peer"
Sep 08 15:08:47.959206 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:47.959169    2580 generic.go:356] "Generic (PLEG): container finished" podID="f583cf51-15ca-41e3-9c90-1777460151c5" containerID="dd75fe57c63704b673596ee93d3279390fc2e590ffc04b1958278920597a947d" exitCode=0
Sep 08 15:08:47.959408 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:47.959243    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt" event={"ID":"f583cf51-15ca-41e3-9c90-1777460151c5","Type":"ContainerDied","Data":"dd75fe57c63704b673596ee93d3279390fc2e590ffc04b1958278920597a947d"}
Sep 08 15:08:47.959696 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:47.959682    2580 scope.go:117] "RemoveContainer" containerID="dd75fe57c63704b673596ee93d3279390fc2e590ffc04b1958278920597a947d"
Sep 08 15:08:47.960766 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:47.960738    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:08:47.960840 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:47.960805    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:08:47.960840 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:47.960835    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:08:48.967649 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:48.967616    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt" event={"ID":"f583cf51-15ca-41e3-9c90-1777460151c5","Type":"ContainerStarted","Data":"a67134915dbf3e0389a9772839e802ec22dbea893f8e3b2b07661daa7b19feee"}
Sep 08 15:08:49.885306 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:49.885265    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:49.885618 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:49.885595    2580 patch_prober.go:28] interesting pod/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 08 15:08:49.885719 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:49.885649    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt" podUID="f583cf51-15ca-41e3-9c90-1777460151c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 08 15:08:50.885700 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:50.885655    2580 patch_prober.go:28] interesting pod/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 08 15:08:50.886122 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:50.885722    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt" podUID="f583cf51-15ca-41e3-9c90-1777460151c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 08 15:08:51.886022 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:51.885979    2580 patch_prober.go:28] interesting pod/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 08 15:08:51.886400 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:51.886055    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt" podUID="f583cf51-15ca-41e3-9c90-1777460151c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 08 15:08:52.885723 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:52.885683    2580 patch_prober.go:28] interesting pod/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 08 15:08:52.885947 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:52.885765    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt" podUID="f583cf51-15ca-41e3-9c90-1777460151c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 08 15:08:53.886191 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:53.886154    2580 patch_prober.go:28] interesting pod/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 08 15:08:53.886620 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:53.886213    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt" podUID="f583cf51-15ca-41e3-9c90-1777460151c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 08 15:08:54.890834 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:54.890801    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:54.891299 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:54.891183    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:54.892462 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:54.892435    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:08:56.953721 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:56.953690    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"
Sep 08 15:08:56.954207 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:56.954185    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"
Sep 08 15:08:57.540536 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.538221    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"]
Sep 08 15:08:57.561534 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.560753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.563638 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.563610    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-eba68d-openshift-default-dockercfg-rzwcf\""
Sep 08 15:08:57.563825 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.563802    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"]
Sep 08 15:08:57.660125 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.660071    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-workload-socket\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.660329 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.660197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-data\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.660329 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.660245    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-token\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.660329 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.660270    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istiod-ca-cert\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.660329 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.660325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-credential-socket\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.660588 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.660371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-envoy\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.660588 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.660400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-podinfo\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.660588 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.660426    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbg7g\" (UniqueName: \"kubernetes.io/projected/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-kube-api-access-xbg7g\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.660588 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.660459    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-workload-certs\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.761834 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.761798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-token\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.761834 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.761833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istiod-ca-cert\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.762290 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.761875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-credential-socket\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.762290 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.761915    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-envoy\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.762290 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.761944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-podinfo\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.762290 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.761969    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbg7g\" (UniqueName: \"kubernetes.io/projected/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-kube-api-access-xbg7g\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.762290 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.762005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-workload-certs\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.762290 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.762046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-workload-socket\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.762290 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.762138    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-data\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.762733 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.762550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-workload-socket\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.762733 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.762723    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istiod-ca-cert\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.762842 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.762793    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-credential-socket\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.762992 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.762975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-data\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.763059 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.763017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-workload-certs\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.765050 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.765024    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-envoy\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.765265 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.765228    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-podinfo\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.771038 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.771005    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-token\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.771137 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.771007    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbg7g\" (UniqueName: \"kubernetes.io/projected/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-kube-api-access-xbg7g\") pod \"e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") " pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:57.877421 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:57.877329    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:58.186340 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:58.186314    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"]
Sep 08 15:08:58.188735 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:08:58.188700    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e5463bc_4403_40b9_9a95_8c0a1fefb3cd.slice/crio-f5afc9d705499b0bfc3a1bd6661354feb30dba978feb2430c1baaa4555485495 WatchSource:0}: Error finding container f5afc9d705499b0bfc3a1bd6661354feb30dba978feb2430c1baaa4555485495: Status 404 returned error can't find the container with id f5afc9d705499b0bfc3a1bd6661354feb30dba978feb2430c1baaa4555485495
Sep 08 15:08:58.191587 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:58.191538    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:08:58.191664 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:58.191642    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:08:58.191711 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:58.191688    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:08:59.021315 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:59.021273    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr" event={"ID":"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd","Type":"ContainerStarted","Data":"f8c7cfba26728ea6def0bd25ba325e96cd558e53b656364b2248df9d9d37c63c"}
Sep 08 15:08:59.021485 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:59.021333    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr" event={"ID":"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd","Type":"ContainerStarted","Data":"f5afc9d705499b0bfc3a1bd6661354feb30dba978feb2430c1baaa4555485495"}
Sep 08 15:08:59.046960 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:59.046910    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr" podStartSLOduration=2.046894906 podStartE2EDuration="2.046894906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:08:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:08:59.044972692 +0000 UTC m=+818.377212238" watchObservedRunningTime="2026-09-08 15:08:59.046894906 +0000 UTC m=+818.379134452"
Sep 08 15:08:59.877661 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:59.877628    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:59.883144 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:59.883117    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:08:59.916829 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:08:59.916794    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:09:00.027163 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:00.027124    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:09:00.028237 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:00.028216    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:09:02.041596 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:02.041563    2580 generic.go:356] "Generic (PLEG): container finished" podID="7994a1be-f043-49f5-9601-efe59dd1d6e8" containerID="539f126e5ef752cdb4be9c7cb0aea97e58f2a3852f03116661aeee5ac9e9ab25" exitCode=0
Sep 08 15:09:02.041998 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:02.041636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph" event={"ID":"7994a1be-f043-49f5-9601-efe59dd1d6e8","Type":"ContainerDied","Data":"539f126e5ef752cdb4be9c7cb0aea97e58f2a3852f03116661aeee5ac9e9ab25"}
Sep 08 15:09:02.042239 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:02.042222    2580 scope.go:117] "RemoveContainer" containerID="539f126e5ef752cdb4be9c7cb0aea97e58f2a3852f03116661aeee5ac9e9ab25"
Sep 08 15:09:02.043320 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:02.043286    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:09:02.043426 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:02.043374    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:09:02.043426 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:02.043419    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:09:03.056534 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.054424    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph" event={"ID":"7994a1be-f043-49f5-9601-efe59dd1d6e8","Type":"ContainerStarted","Data":"c893558059f5df94cb8262ad5306487d847c4bd7ce31c03d67c5afc858693433"}
Sep 08 15:09:03.069547 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.066386    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"]
Sep 08 15:09:03.071853 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.071825    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"
Sep 08 15:09:03.077191 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.077161    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"]
Sep 08 15:09:03.078619 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.077846    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-eba68d-dockercfg-6wqwx\""
Sep 08 15:09:03.078619 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.078159    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-eba68d\""
Sep 08 15:09:03.222720 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.222668    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fff8132-b098-4e33-8f52-e98924802997-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl\" (UID: \"5fff8132-b098-4e33-8f52-e98924802997\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"
Sep 08 15:09:03.222939 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.222818    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz4hm\" (UniqueName: \"kubernetes.io/projected/5fff8132-b098-4e33-8f52-e98924802997-kube-api-access-zz4hm\") pod \"payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl\" (UID: \"5fff8132-b098-4e33-8f52-e98924802997\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"
Sep 08 15:09:03.227501 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.227471    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:09:03.227747 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.227497    2580 patch_prober.go:28] interesting pod/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 08 15:09:03.227903 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.227881    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph" podUID="7994a1be-f043-49f5-9601-efe59dd1d6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 08 15:09:03.324114 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.324008    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz4hm\" (UniqueName: \"kubernetes.io/projected/5fff8132-b098-4e33-8f52-e98924802997-kube-api-access-zz4hm\") pod \"payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl\" (UID: \"5fff8132-b098-4e33-8f52-e98924802997\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"
Sep 08 15:09:03.324294 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.324157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fff8132-b098-4e33-8f52-e98924802997-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl\" (UID: \"5fff8132-b098-4e33-8f52-e98924802997\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"
Sep 08 15:09:03.325273 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.325246    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fff8132-b098-4e33-8f52-e98924802997-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl\" (UID: \"5fff8132-b098-4e33-8f52-e98924802997\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"
Sep 08 15:09:03.334212 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.334172    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz4hm\" (UniqueName: \"kubernetes.io/projected/5fff8132-b098-4e33-8f52-e98924802997-kube-api-access-zz4hm\") pod \"payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl\" (UID: \"5fff8132-b098-4e33-8f52-e98924802997\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"
Sep 08 15:09:03.400271 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.400226    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"
Sep 08 15:09:03.710318 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:03.710265    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"]
Sep 08 15:09:03.712448 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:09:03.712421    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fff8132_b098_4e33_8f52_e98924802997.slice/crio-30561273360db55b7f29003e7874c272c2582ebf41f63c9041e386a7079d9b2c WatchSource:0}: Error finding container 30561273360db55b7f29003e7874c272c2582ebf41f63c9041e386a7079d9b2c: Status 404 returned error can't find the container with id 30561273360db55b7f29003e7874c272c2582ebf41f63c9041e386a7079d9b2c
Sep 08 15:09:04.062919 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:04.062877    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl" event={"ID":"5fff8132-b098-4e33-8f52-e98924802997","Type":"ContainerStarted","Data":"1a025923ab51d32325534eba026d8b7bd845064586dfd304be1234613c01ef34"}
Sep 08 15:09:04.063401 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:04.063200    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"
Sep 08 15:09:04.063401 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:04.063246    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl" event={"ID":"5fff8132-b098-4e33-8f52-e98924802997","Type":"ContainerStarted","Data":"30561273360db55b7f29003e7874c272c2582ebf41f63c9041e386a7079d9b2c"}
Sep 08 15:09:04.082728 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:04.082670    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl" podStartSLOduration=1.082653377 podStartE2EDuration="1.082653377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:09:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:04.080619481 +0000 UTC m=+823.412859028" watchObservedRunningTime="2026-09-08 15:09:04.082653377 +0000 UTC m=+823.414892922"
Sep 08 15:09:04.228484 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:04.228440    2580 patch_prober.go:28] interesting pod/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 08 15:09:04.228690 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:04.228521    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph" podUID="7994a1be-f043-49f5-9601-efe59dd1d6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 08 15:09:05.228361 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:05.228319    2580 patch_prober.go:28] interesting pod/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 08 15:09:05.228976 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:05.228940    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph" podUID="7994a1be-f043-49f5-9601-efe59dd1d6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 08 15:09:06.231056 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:06.231015    2580 patch_prober.go:28] interesting pod/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 08 15:09:06.231652 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:06.231618    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph" podUID="7994a1be-f043-49f5-9601-efe59dd1d6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 08 15:09:07.227646 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:07.227607    2580 patch_prober.go:28] interesting pod/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 08 15:09:07.227936 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:07.227905    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph" podUID="7994a1be-f043-49f5-9601-efe59dd1d6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 08 15:09:07.593575 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:07.593459    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4510c66e-scwfh"]
Sep 08 15:09:07.597584 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:07.597560    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4510c66e-scwfh"
Sep 08 15:09:07.600437 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:07.600416    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:09:07.600580 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:07.600457    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:09:07.605042 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:07.604978    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4510c66e-scwfh"]
Sep 08 15:09:07.780531 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:07.780485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/328c9cdc-f63c-4f1c-aa1f-b79e503077a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4510c66e-scwfh\" (UID: \"328c9cdc-f63c-4f1c-aa1f-b79e503077a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4510c66e-scwfh"
Sep 08 15:09:07.882082 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:07.881969    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/328c9cdc-f63c-4f1c-aa1f-b79e503077a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4510c66e-scwfh\" (UID: \"328c9cdc-f63c-4f1c-aa1f-b79e503077a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4510c66e-scwfh"
Sep 08 15:09:07.882869 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:07.882843    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/328c9cdc-f63c-4f1c-aa1f-b79e503077a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4510c66e-scwfh\" (UID: \"328c9cdc-f63c-4f1c-aa1f-b79e503077a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4510c66e-scwfh"
Sep 08 15:09:07.909031 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:07.908996    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4510c66e-scwfh"
Sep 08 15:09:08.206644 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:08.206619    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4510c66e-scwfh"]
Sep 08 15:09:08.208783 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:09:08.208658    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod328c9cdc_f63c_4f1c_aa1f_b79e503077a2.slice/crio-08859a887e0caeaf9fb36f83307297e70ace0caed710da73c477d21e8de2d251 WatchSource:0}: Error finding container 08859a887e0caeaf9fb36f83307297e70ace0caed710da73c477d21e8de2d251: Status 404 returned error can't find the container with id 08859a887e0caeaf9fb36f83307297e70ace0caed710da73c477d21e8de2d251
Sep 08 15:09:08.237409 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:08.236965    2580 patch_prober.go:28] interesting pod/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 08 15:09:08.237409 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:08.237032    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph" podUID="7994a1be-f043-49f5-9601-efe59dd1d6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 08 15:09:09.089244 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:09.089203    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4510c66e-scwfh" event={"ID":"328c9cdc-f63c-4f1c-aa1f-b79e503077a2","Type":"ContainerStarted","Data":"08859a887e0caeaf9fb36f83307297e70ace0caed710da73c477d21e8de2d251"}
Sep 08 15:09:09.232382 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:09.232348    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:09:09.232745 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:09.232724    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:09:09.233417 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:09.233398    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:09:13.111951 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:13.111860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4510c66e-scwfh" event={"ID":"328c9cdc-f63c-4f1c-aa1f-b79e503077a2","Type":"ContainerStarted","Data":"3141b3ef5832aa0d823f45409216e4499d5c4b592f4567a09608e342904f2e17"}
Sep 08 15:09:14.119054 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:14.119016    2580 generic.go:356] "Generic (PLEG): container finished" podID="328c9cdc-f63c-4f1c-aa1f-b79e503077a2" containerID="3141b3ef5832aa0d823f45409216e4499d5c4b592f4567a09608e342904f2e17" exitCode=0
Sep 08 15:09:14.119435 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:14.119100    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4510c66e-scwfh" event={"ID":"328c9cdc-f63c-4f1c-aa1f-b79e503077a2","Type":"ContainerDied","Data":"3141b3ef5832aa0d823f45409216e4499d5c4b592f4567a09608e342904f2e17"}
Sep 08 15:09:15.071123 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:15.071084    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"
Sep 08 15:09:15.310519 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:15.310484    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4510c66e-scwfh"
Sep 08 15:09:15.374670 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:15.374580    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/328c9cdc-f63c-4f1c-aa1f-b79e503077a2-maas-api-service-ca\") pod \"328c9cdc-f63c-4f1c-aa1f-b79e503077a2\" (UID: \"328c9cdc-f63c-4f1c-aa1f-b79e503077a2\") "
Sep 08 15:09:15.374937 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:15.374910    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/328c9cdc-f63c-4f1c-aa1f-b79e503077a2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "328c9cdc-f63c-4f1c-aa1f-b79e503077a2" (UID: "328c9cdc-f63c-4f1c-aa1f-b79e503077a2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:09:15.375020 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:15.375007    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/328c9cdc-f63c-4f1c-aa1f-b79e503077a2-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:09:16.131585 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:16.131547    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4510c66e-scwfh" event={"ID":"328c9cdc-f63c-4f1c-aa1f-b79e503077a2","Type":"ContainerDied","Data":"08859a887e0caeaf9fb36f83307297e70ace0caed710da73c477d21e8de2d251"}
Sep 08 15:09:16.132066 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:16.132023    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08859a887e0caeaf9fb36f83307297e70ace0caed710da73c477d21e8de2d251"
Sep 08 15:09:16.132224 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:16.131880    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4510c66e-scwfh"
Sep 08 15:09:17.001179 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:17.001147    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:09:22.174138 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:22.174104    2580 generic.go:356] "Generic (PLEG): container finished" podID="0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" containerID="f8c7cfba26728ea6def0bd25ba325e96cd558e53b656364b2248df9d9d37c63c" exitCode=0
Sep 08 15:09:22.174592 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:22.174169    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr" event={"ID":"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd","Type":"ContainerDied","Data":"f8c7cfba26728ea6def0bd25ba325e96cd558e53b656364b2248df9d9d37c63c"}
Sep 08 15:09:22.174592 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:22.174570    2580 scope.go:117] "RemoveContainer" containerID="f8c7cfba26728ea6def0bd25ba325e96cd558e53b656364b2248df9d9d37c63c"
Sep 08 15:09:22.175845 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:22.175787    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:09:22.175917 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:22.175900    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:09:22.175956 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:22.175935    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:09:23.180357 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:23.180320    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr" event={"ID":"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd","Type":"ContainerStarted","Data":"ff5ae8f84dfe973fc2c04ace7583a4e7554d3ab69a63f59be83ceca864e3ae3a"}
Sep 08 15:09:23.877689 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:23.877648    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:09:23.877990 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:23.877964    2580 patch_prober.go:28] interesting pod/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 08 15:09:23.878081 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:23.878036    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr" podUID="0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 08 15:09:24.039702 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:24.039579    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"]
Sep 08 15:09:24.040730 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:24.040410    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj" podUID="dc9ce8c1-ad80-4868-b17d-4671877107ff" containerName="payload-pre-processing" containerID="cri-o://315d210c16566f41cb228848b56e475a9df1204237c640fe8890f7aafdf80b66" gracePeriod=30
Sep 08 15:09:24.187849 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:24.187813    2580 generic.go:356] "Generic (PLEG): container finished" podID="dc9ce8c1-ad80-4868-b17d-4671877107ff" containerID="315d210c16566f41cb228848b56e475a9df1204237c640fe8890f7aafdf80b66" exitCode=0
Sep 08 15:09:24.188652 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:24.188612    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj" event={"ID":"dc9ce8c1-ad80-4868-b17d-4671877107ff","Type":"ContainerDied","Data":"315d210c16566f41cb228848b56e475a9df1204237c640fe8890f7aafdf80b66"}
Sep 08 15:09:24.209794 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:24.209706    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4510c66e-scwfh"]
Sep 08 15:09:24.212265 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:24.212234    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4510c66e-scwfh"]
Sep 08 15:09:24.365697 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:24.365391    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"
Sep 08 15:09:24.473357 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:24.473325    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc9ce8c1-ad80-4868-b17d-4671877107ff-plugins-config-volume\") pod \"dc9ce8c1-ad80-4868-b17d-4671877107ff\" (UID: \"dc9ce8c1-ad80-4868-b17d-4671877107ff\") "
Sep 08 15:09:24.473592 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:24.473406    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lfhg\" (UniqueName: \"kubernetes.io/projected/dc9ce8c1-ad80-4868-b17d-4671877107ff-kube-api-access-9lfhg\") pod \"dc9ce8c1-ad80-4868-b17d-4671877107ff\" (UID: \"dc9ce8c1-ad80-4868-b17d-4671877107ff\") "
Sep 08 15:09:24.474085 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:24.474042    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc9ce8c1-ad80-4868-b17d-4671877107ff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dc9ce8c1-ad80-4868-b17d-4671877107ff" (UID: "dc9ce8c1-ad80-4868-b17d-4671877107ff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:09:24.478672 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:24.478645    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc9ce8c1-ad80-4868-b17d-4671877107ff-kube-api-access-9lfhg" (OuterVolumeSpecName: "kube-api-access-9lfhg") pod "dc9ce8c1-ad80-4868-b17d-4671877107ff" (UID: "dc9ce8c1-ad80-4868-b17d-4671877107ff"). InnerVolumeSpecName "kube-api-access-9lfhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:09:24.574711 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:24.574667    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc9ce8c1-ad80-4868-b17d-4671877107ff-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:09:24.574711 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:24.574707    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lfhg\" (UniqueName: \"kubernetes.io/projected/dc9ce8c1-ad80-4868-b17d-4671877107ff-kube-api-access-9lfhg\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:09:24.878211 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:24.878124    2580 patch_prober.go:28] interesting pod/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 08 15:09:24.878211 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:24.878195    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr" podUID="0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 08 15:09:25.161157 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:25.161063    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="328c9cdc-f63c-4f1c-aa1f-b79e503077a2" path="/var/lib/kubelet/pods/328c9cdc-f63c-4f1c-aa1f-b79e503077a2/volumes"
Sep 08 15:09:25.194299 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:25.194271    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"
Sep 08 15:09:25.194299 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:25.194283    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj" event={"ID":"dc9ce8c1-ad80-4868-b17d-4671877107ff","Type":"ContainerDied","Data":"7072bcf9eb7a2efc06454603c3a5a8e9ba52fd190f8f54aa13ae7dc7df06dc55"}
Sep 08 15:09:25.194757 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:25.194345    2580 scope.go:117] "RemoveContainer" containerID="315d210c16566f41cb228848b56e475a9df1204237c640fe8890f7aafdf80b66"
Sep 08 15:09:25.243897 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:25.243854    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"]
Sep 08 15:09:25.247682 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:25.247646    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4510c66e-64869fb7fd-jszdj"]
Sep 08 15:09:25.877900 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:25.877849    2580 patch_prober.go:28] interesting pod/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 08 15:09:25.878116 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:25.877922    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr" podUID="0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 08 15:09:26.878675 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:26.878639    2580 patch_prober.go:28] interesting pod/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 08 15:09:26.879063 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:26.878698    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr" podUID="0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 08 15:09:27.172791 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:27.172711    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc9ce8c1-ad80-4868-b17d-4671877107ff" path="/var/lib/kubelet/pods/dc9ce8c1-ad80-4868-b17d-4671877107ff/volumes"
Sep 08 15:09:27.878089 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:27.878046    2580 patch_prober.go:28] interesting pod/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 08 15:09:27.878266 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:27.878122    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr" podUID="0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 08 15:09:28.889388 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:28.889348    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:09:28.890313 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:28.890281    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:09:28.891420 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:28.891399    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:09:29.590455 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.590424    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"]
Sep 08 15:09:29.590877 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.590863    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="328c9cdc-f63c-4f1c-aa1f-b79e503077a2" containerName="revoke-keys"
Sep 08 15:09:29.590926 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.590879    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="328c9cdc-f63c-4f1c-aa1f-b79e503077a2" containerName="revoke-keys"
Sep 08 15:09:29.590926 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.590899    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9ce8c1-ad80-4868-b17d-4671877107ff" containerName="payload-pre-processing"
Sep 08 15:09:29.590926 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.590905    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9ce8c1-ad80-4868-b17d-4671877107ff" containerName="payload-pre-processing"
Sep 08 15:09:29.591015 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.590965    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc9ce8c1-ad80-4868-b17d-4671877107ff" containerName="payload-pre-processing"
Sep 08 15:09:29.591015 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.590979    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="328c9cdc-f63c-4f1c-aa1f-b79e503077a2" containerName="revoke-keys"
Sep 08 15:09:29.597071 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.597049    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"
Sep 08 15:09:29.599475 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.599456    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-b19c8836\""
Sep 08 15:09:29.599574 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.599456    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-b19c8836-dockercfg-lqpgg\""
Sep 08 15:09:29.611755 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.611728    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"]
Sep 08 15:09:29.725063 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.725017    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkg2m\" (UniqueName: \"kubernetes.io/projected/f0a7c58d-d11e-4a0e-9bf0-8890839ba036-kube-api-access-vkg2m\") pod \"payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6\" (UID: \"f0a7c58d-d11e-4a0e-9bf0-8890839ba036\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"
Sep 08 15:09:29.725265 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.725172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0a7c58d-d11e-4a0e-9bf0-8890839ba036-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6\" (UID: \"f0a7c58d-d11e-4a0e-9bf0-8890839ba036\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"
Sep 08 15:09:29.826665 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.826623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0a7c58d-d11e-4a0e-9bf0-8890839ba036-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6\" (UID: \"f0a7c58d-d11e-4a0e-9bf0-8890839ba036\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"
Sep 08 15:09:29.826856 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.826720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkg2m\" (UniqueName: \"kubernetes.io/projected/f0a7c58d-d11e-4a0e-9bf0-8890839ba036-kube-api-access-vkg2m\") pod \"payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6\" (UID: \"f0a7c58d-d11e-4a0e-9bf0-8890839ba036\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"
Sep 08 15:09:29.827376 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.827357    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0a7c58d-d11e-4a0e-9bf0-8890839ba036-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6\" (UID: \"f0a7c58d-d11e-4a0e-9bf0-8890839ba036\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"
Sep 08 15:09:29.834925 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.834892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkg2m\" (UniqueName: \"kubernetes.io/projected/f0a7c58d-d11e-4a0e-9bf0-8890839ba036-kube-api-access-vkg2m\") pod \"payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6\" (UID: \"f0a7c58d-d11e-4a0e-9bf0-8890839ba036\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"
Sep 08 15:09:29.907956 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:29.907873    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"
Sep 08 15:09:30.182868 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:30.182840    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"]
Sep 08 15:09:30.184586 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:09:30.184563    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a7c58d_d11e_4a0e_9bf0_8890839ba036.slice/crio-0947cc0ddda8cf557573e51bb0691ed105f2b6b4a1ce2db909ee81e8d060bfb6 WatchSource:0}: Error finding container 0947cc0ddda8cf557573e51bb0691ed105f2b6b4a1ce2db909ee81e8d060bfb6: Status 404 returned error can't find the container with id 0947cc0ddda8cf557573e51bb0691ed105f2b6b4a1ce2db909ee81e8d060bfb6
Sep 08 15:09:30.232892 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:30.232860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6" event={"ID":"f0a7c58d-d11e-4a0e-9bf0-8890839ba036","Type":"ContainerStarted","Data":"0947cc0ddda8cf557573e51bb0691ed105f2b6b4a1ce2db909ee81e8d060bfb6"}
Sep 08 15:09:31.239594 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:31.239549    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6" event={"ID":"f0a7c58d-d11e-4a0e-9bf0-8890839ba036","Type":"ContainerStarted","Data":"0f28bd7ca160f7f1b317ae4b31984e0ae8967c06c172939cf59d6af38cdcf5ec"}
Sep 08 15:09:31.240112 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:31.239682    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"
Sep 08 15:09:31.256275 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:31.256214    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6" podStartSLOduration=2.256195219 podStartE2EDuration="2.256195219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:09:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:31.255266061 +0000 UTC m=+850.587505607" watchObservedRunningTime="2026-09-08 15:09:31.256195219 +0000 UTC m=+850.588434765"
Sep 08 15:09:32.519109 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:32.519074    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:09:42.247905 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:42.247872    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"
Sep 08 15:09:53.498463 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:53.498422    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj"]
Sep 08 15:09:53.501873 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:53.501855    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj"
Sep 08 15:09:53.504082 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:53.504059    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:09:53.504181 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:53.504068    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:09:53.508670 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:53.508644    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj"]
Sep 08 15:09:53.562577 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:53.562540    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a097920b-4d0a-4f23-a468-d1556838339a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj\" (UID: \"a097920b-4d0a-4f23-a468-d1556838339a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj"
Sep 08 15:09:53.663960 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:53.663915    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a097920b-4d0a-4f23-a468-d1556838339a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj\" (UID: \"a097920b-4d0a-4f23-a468-d1556838339a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj"
Sep 08 15:09:53.664597 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:53.664578    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a097920b-4d0a-4f23-a468-d1556838339a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj\" (UID: \"a097920b-4d0a-4f23-a468-d1556838339a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj"
Sep 08 15:09:53.813106 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:53.813020    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj"
Sep 08 15:09:54.084067 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:54.084038    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj"]
Sep 08 15:09:54.086170 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:09:54.086135    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda097920b_4d0a_4f23_a468_d1556838339a.slice/crio-cf63ef1d185a12025440df099a7c5de0a5ea6ffd54d2f7b995002d38e9db6a5c WatchSource:0}: Error finding container cf63ef1d185a12025440df099a7c5de0a5ea6ffd54d2f7b995002d38e9db6a5c: Status 404 returned error can't find the container with id cf63ef1d185a12025440df099a7c5de0a5ea6ffd54d2f7b995002d38e9db6a5c
Sep 08 15:09:54.105645 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:54.105617    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:09:54.368898 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:54.368857    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj" event={"ID":"a097920b-4d0a-4f23-a468-d1556838339a","Type":"ContainerStarted","Data":"cf63ef1d185a12025440df099a7c5de0a5ea6ffd54d2f7b995002d38e9db6a5c"}
Sep 08 15:09:55.376221 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:55.376186    2580 generic.go:356] "Generic (PLEG): container finished" podID="a097920b-4d0a-4f23-a468-d1556838339a" containerID="88e92eac77659c19e2f48d56fe444ee47e97d22ec1affd3852df77e50bbf8402" exitCode=0
Sep 08 15:09:55.376681 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:55.376277    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj" event={"ID":"a097920b-4d0a-4f23-a468-d1556838339a","Type":"ContainerDied","Data":"88e92eac77659c19e2f48d56fe444ee47e97d22ec1affd3852df77e50bbf8402"}
Sep 08 15:09:56.522664 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:56.522643    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj"
Sep 08 15:09:56.594455 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:56.594419    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a097920b-4d0a-4f23-a468-d1556838339a-maas-api-service-ca\") pod \"a097920b-4d0a-4f23-a468-d1556838339a\" (UID: \"a097920b-4d0a-4f23-a468-d1556838339a\") "
Sep 08 15:09:56.594859 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:56.594833    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a097920b-4d0a-4f23-a468-d1556838339a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a097920b-4d0a-4f23-a468-d1556838339a" (UID: "a097920b-4d0a-4f23-a468-d1556838339a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:09:56.695705 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:56.695616    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a097920b-4d0a-4f23-a468-d1556838339a-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:09:57.388526 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:57.388484    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj"
Sep 08 15:09:57.388675 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:57.388536    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj" event={"ID":"a097920b-4d0a-4f23-a468-d1556838339a","Type":"ContainerDied","Data":"cf63ef1d185a12025440df099a7c5de0a5ea6ffd54d2f7b995002d38e9db6a5c"}
Sep 08 15:09:57.388675 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:57.388591    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf63ef1d185a12025440df099a7c5de0a5ea6ffd54d2f7b995002d38e9db6a5c"
Sep 08 15:09:59.572299 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:59.572256    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"]
Sep 08 15:09:59.572800 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:59.572529    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6" podUID="f0a7c58d-d11e-4a0e-9bf0-8890839ba036" containerName="payload-pre-processing" containerID="cri-o://0f28bd7ca160f7f1b317ae4b31984e0ae8967c06c172939cf59d6af38cdcf5ec" gracePeriod=30
Sep 08 15:09:59.750935 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:59.750905    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj"]
Sep 08 15:09:59.752953 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:59.752930    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b19c8836-9j5fj"]
Sep 08 15:09:59.877575 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:59.877545    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"
Sep 08 15:09:59.938311 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:59.938278    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0a7c58d-d11e-4a0e-9bf0-8890839ba036-plugins-config-volume\") pod \"f0a7c58d-d11e-4a0e-9bf0-8890839ba036\" (UID: \"f0a7c58d-d11e-4a0e-9bf0-8890839ba036\") "
Sep 08 15:09:59.941541 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:59.938793    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkg2m\" (UniqueName: \"kubernetes.io/projected/f0a7c58d-d11e-4a0e-9bf0-8890839ba036-kube-api-access-vkg2m\") pod \"f0a7c58d-d11e-4a0e-9bf0-8890839ba036\" (UID: \"f0a7c58d-d11e-4a0e-9bf0-8890839ba036\") "
Sep 08 15:09:59.941541 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:59.939150    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0a7c58d-d11e-4a0e-9bf0-8890839ba036-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f0a7c58d-d11e-4a0e-9bf0-8890839ba036" (UID: "f0a7c58d-d11e-4a0e-9bf0-8890839ba036"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:09:59.941541 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:59.939458    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0a7c58d-d11e-4a0e-9bf0-8890839ba036-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:09:59.946574 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:09:59.946545    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0a7c58d-d11e-4a0e-9bf0-8890839ba036-kube-api-access-vkg2m" (OuterVolumeSpecName: "kube-api-access-vkg2m") pod "f0a7c58d-d11e-4a0e-9bf0-8890839ba036" (UID: "f0a7c58d-d11e-4a0e-9bf0-8890839ba036"). InnerVolumeSpecName "kube-api-access-vkg2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:10:00.040070 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:00.040029    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkg2m\" (UniqueName: \"kubernetes.io/projected/f0a7c58d-d11e-4a0e-9bf0-8890839ba036-kube-api-access-vkg2m\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:10:00.405814 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:00.405777    2580 generic.go:356] "Generic (PLEG): container finished" podID="f0a7c58d-d11e-4a0e-9bf0-8890839ba036" containerID="0f28bd7ca160f7f1b317ae4b31984e0ae8967c06c172939cf59d6af38cdcf5ec" exitCode=0
Sep 08 15:10:00.405987 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:00.405845    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"
Sep 08 15:10:00.405987 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:00.405869    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6" event={"ID":"f0a7c58d-d11e-4a0e-9bf0-8890839ba036","Type":"ContainerDied","Data":"0f28bd7ca160f7f1b317ae4b31984e0ae8967c06c172939cf59d6af38cdcf5ec"}
Sep 08 15:10:00.405987 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:00.405931    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6" event={"ID":"f0a7c58d-d11e-4a0e-9bf0-8890839ba036","Type":"ContainerDied","Data":"0947cc0ddda8cf557573e51bb0691ed105f2b6b4a1ce2db909ee81e8d060bfb6"}
Sep 08 15:10:00.405987 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:00.405960    2580 scope.go:117] "RemoveContainer" containerID="0f28bd7ca160f7f1b317ae4b31984e0ae8967c06c172939cf59d6af38cdcf5ec"
Sep 08 15:10:00.415419 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:00.415398    2580 scope.go:117] "RemoveContainer" containerID="0f28bd7ca160f7f1b317ae4b31984e0ae8967c06c172939cf59d6af38cdcf5ec"
Sep 08 15:10:00.415754 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:10:00.415729    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f28bd7ca160f7f1b317ae4b31984e0ae8967c06c172939cf59d6af38cdcf5ec\": container with ID starting with 0f28bd7ca160f7f1b317ae4b31984e0ae8967c06c172939cf59d6af38cdcf5ec not found: ID does not exist" containerID="0f28bd7ca160f7f1b317ae4b31984e0ae8967c06c172939cf59d6af38cdcf5ec"
Sep 08 15:10:00.415859 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:00.415762    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f28bd7ca160f7f1b317ae4b31984e0ae8967c06c172939cf59d6af38cdcf5ec"} err="failed to get container status \"0f28bd7ca160f7f1b317ae4b31984e0ae8967c06c172939cf59d6af38cdcf5ec\": rpc error: code = NotFound desc = could not find container \"0f28bd7ca160f7f1b317ae4b31984e0ae8967c06c172939cf59d6af38cdcf5ec\": container with ID starting with 0f28bd7ca160f7f1b317ae4b31984e0ae8967c06c172939cf59d6af38cdcf5ec not found: ID does not exist"
Sep 08 15:10:00.431938 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:00.431905    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"]
Sep 08 15:10:00.434158 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:00.434136    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b19c8836-75fccf8cf4-5bkw6"]
Sep 08 15:10:01.157461 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:01.157424    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a097920b-4d0a-4f23-a468-d1556838339a" path="/var/lib/kubelet/pods/a097920b-4d0a-4f23-a468-d1556838339a/volumes"
Sep 08 15:10:01.157930 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:01.157913    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0a7c58d-d11e-4a0e-9bf0-8890839ba036" path="/var/lib/kubelet/pods/f0a7c58d-d11e-4a0e-9bf0-8890839ba036/volumes"
Sep 08 15:10:10.308068 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:10.308030    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:10:21.105865 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:21.105834    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 15:10:21.108071 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:21.108049    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 15:10:29.390398 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:29.390361    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w"]
Sep 08 15:10:29.390873 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:29.390856    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a7c58d-d11e-4a0e-9bf0-8890839ba036" containerName="payload-pre-processing"
Sep 08 15:10:29.390873 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:29.390874    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a7c58d-d11e-4a0e-9bf0-8890839ba036" containerName="payload-pre-processing"
Sep 08 15:10:29.390954 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:29.390888    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a097920b-4d0a-4f23-a468-d1556838339a" containerName="revoke-keys"
Sep 08 15:10:29.390954 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:29.390894    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a097920b-4d0a-4f23-a468-d1556838339a" containerName="revoke-keys"
Sep 08 15:10:29.391031 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:29.390958    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a7c58d-d11e-4a0e-9bf0-8890839ba036" containerName="payload-pre-processing"
Sep 08 15:10:29.391031 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:29.390967    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a097920b-4d0a-4f23-a468-d1556838339a" containerName="revoke-keys"
Sep 08 15:10:29.395236 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:29.395214    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w"
Sep 08 15:10:29.397693 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:29.397663    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:10:29.397816 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:29.397735    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:10:29.401383 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:29.401347    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w"]
Sep 08 15:10:29.429890 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:29.429856    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d69a3e4-e18d-4237-bb0c-affaac316b00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w\" (UID: \"8d69a3e4-e18d-4237-bb0c-affaac316b00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w"
Sep 08 15:10:29.530671 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:29.530627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d69a3e4-e18d-4237-bb0c-affaac316b00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w\" (UID: \"8d69a3e4-e18d-4237-bb0c-affaac316b00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w"
Sep 08 15:10:29.531227 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:29.531207    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d69a3e4-e18d-4237-bb0c-affaac316b00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w\" (UID: \"8d69a3e4-e18d-4237-bb0c-affaac316b00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w"
Sep 08 15:10:29.707236 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:29.707135    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w"
Sep 08 15:10:29.980543 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:29.980500    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w"]
Sep 08 15:10:29.982251 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:10:29.982222    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d69a3e4_e18d_4237_bb0c_affaac316b00.slice/crio-300a58c86b6e0c1f78bf7c02ab3d1ca1aeed24715e3591a7baa4fed153588911 WatchSource:0}: Error finding container 300a58c86b6e0c1f78bf7c02ab3d1ca1aeed24715e3591a7baa4fed153588911: Status 404 returned error can't find the container with id 300a58c86b6e0c1f78bf7c02ab3d1ca1aeed24715e3591a7baa4fed153588911
Sep 08 15:10:30.567097 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:30.567066    2580 generic.go:356] "Generic (PLEG): container finished" podID="8d69a3e4-e18d-4237-bb0c-affaac316b00" containerID="15ff4feb4d34a0724b12a0b03b1a5b50c70ca249df7c143b534c938b2b58bfb8" exitCode=0
Sep 08 15:10:30.567619 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:30.567115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w" event={"ID":"8d69a3e4-e18d-4237-bb0c-affaac316b00","Type":"ContainerDied","Data":"15ff4feb4d34a0724b12a0b03b1a5b50c70ca249df7c143b534c938b2b58bfb8"}
Sep 08 15:10:30.567619 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:30.567164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w" event={"ID":"8d69a3e4-e18d-4237-bb0c-affaac316b00","Type":"ContainerStarted","Data":"300a58c86b6e0c1f78bf7c02ab3d1ca1aeed24715e3591a7baa4fed153588911"}
Sep 08 15:10:31.707070 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:31.707039    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w"
Sep 08 15:10:31.752607 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:31.752579    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d69a3e4-e18d-4237-bb0c-affaac316b00-maas-api-service-ca\") pod \"8d69a3e4-e18d-4237-bb0c-affaac316b00\" (UID: \"8d69a3e4-e18d-4237-bb0c-affaac316b00\") "
Sep 08 15:10:31.752997 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:31.752971    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d69a3e4-e18d-4237-bb0c-affaac316b00-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8d69a3e4-e18d-4237-bb0c-affaac316b00" (UID: "8d69a3e4-e18d-4237-bb0c-affaac316b00"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:10:31.803953 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:31.803918    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:10:31.853846 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:31.853758    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d69a3e4-e18d-4237-bb0c-affaac316b00-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:10:32.579532 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:32.579480    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w"
Sep 08 15:10:32.579705 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:32.579502    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w" event={"ID":"8d69a3e4-e18d-4237-bb0c-affaac316b00","Type":"ContainerDied","Data":"300a58c86b6e0c1f78bf7c02ab3d1ca1aeed24715e3591a7baa4fed153588911"}
Sep 08 15:10:32.579705 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:32.579578    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="300a58c86b6e0c1f78bf7c02ab3d1ca1aeed24715e3591a7baa4fed153588911"
Sep 08 15:10:35.657839 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:35.657805    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w"]
Sep 08 15:10:35.659742 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:35.659719    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cc8fbdcf-4499w"]
Sep 08 15:10:37.156903 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:37.156873    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d69a3e4-e18d-4237-bb0c-affaac316b00" path="/var/lib/kubelet/pods/8d69a3e4-e18d-4237-bb0c-affaac316b00/volumes"
Sep 08 15:10:44.800402 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:44.800364    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k"]
Sep 08 15:10:44.800829 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:44.800791    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d69a3e4-e18d-4237-bb0c-affaac316b00" containerName="revoke-keys"
Sep 08 15:10:44.800829 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:44.800802    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d69a3e4-e18d-4237-bb0c-affaac316b00" containerName="revoke-keys"
Sep 08 15:10:44.800908 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:44.800872    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d69a3e4-e18d-4237-bb0c-affaac316b00" containerName="revoke-keys"
Sep 08 15:10:44.804421 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:44.804402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k"
Sep 08 15:10:44.807007 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:44.806987    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:10:44.807101 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:44.807020    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:10:44.822845 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:44.822801    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k"]
Sep 08 15:10:44.886797 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:44.886757    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eeeeea81-4673-49f4-a2ed-81f5410b78c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k\" (UID: \"eeeeea81-4673-49f4-a2ed-81f5410b78c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k"
Sep 08 15:10:44.987768 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:44.987719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eeeeea81-4673-49f4-a2ed-81f5410b78c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k\" (UID: \"eeeeea81-4673-49f4-a2ed-81f5410b78c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k"
Sep 08 15:10:44.988421 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:44.988396    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eeeeea81-4673-49f4-a2ed-81f5410b78c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k\" (UID: \"eeeeea81-4673-49f4-a2ed-81f5410b78c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k"
Sep 08 15:10:45.124852 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.124761    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k"
Sep 08 15:10:45.395591 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.395566    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k"]
Sep 08 15:10:45.397701 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:10:45.397674    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeeeea81_4673_49f4_a2ed_81f5410b78c2.slice/crio-628cc9657fdd9d1f4d7e31863d847847603a14a62dbb158b7311cb15be65c2de WatchSource:0}: Error finding container 628cc9657fdd9d1f4d7e31863d847847603a14a62dbb158b7311cb15be65c2de: Status 404 returned error can't find the container with id 628cc9657fdd9d1f4d7e31863d847847603a14a62dbb158b7311cb15be65c2de
Sep 08 15:10:45.469401 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.469365    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"]
Sep 08 15:10:45.474183 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.474165    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.478303 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.477736    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a1592f\"/\"default-dockercfg-55xw2\""
Sep 08 15:10:45.478303 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.478064    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a1592f\"/\"test-model-a1592f-kserve-self-signed-certs\""
Sep 08 15:10:45.478500 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.478479    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a1592f\"/\"kube-root-ca.crt\""
Sep 08 15:10:45.478578 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.478499    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a1592f\"/\"openshift-service-ca.crt\""
Sep 08 15:10:45.480741 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.480684    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"]
Sep 08 15:10:45.594315 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.594284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-dshm\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.594471 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.594318    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9t6h\" (UniqueName: \"kubernetes.io/projected/58d59c05-b846-4baf-b357-5bf2f07e9664-kube-api-access-v9t6h\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.594471 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.594357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-tmp-dir\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.594471 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.594399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58d59c05-b846-4baf-b357-5bf2f07e9664-tls-certs\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.594471 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.594419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-model-cache\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.594471 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.594448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-home\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.653770 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.653696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k" event={"ID":"eeeeea81-4673-49f4-a2ed-81f5410b78c2","Type":"ContainerStarted","Data":"628cc9657fdd9d1f4d7e31863d847847603a14a62dbb158b7311cb15be65c2de"}
Sep 08 15:10:45.695311 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.695274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-dshm\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.695311 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.695316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9t6h\" (UniqueName: \"kubernetes.io/projected/58d59c05-b846-4baf-b357-5bf2f07e9664-kube-api-access-v9t6h\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.695478 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.695343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-tmp-dir\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.695478 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.695366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58d59c05-b846-4baf-b357-5bf2f07e9664-tls-certs\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.695478 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.695383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-model-cache\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.695478 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.695408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-home\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.695826 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.695796    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-tmp-dir\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.695826 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.695820    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-model-cache\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.695986 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.695885    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-home\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.697955 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.697931    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-dshm\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.698151 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.698134    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58d59c05-b846-4baf-b357-5bf2f07e9664-tls-certs\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.703037 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.703012    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9t6h\" (UniqueName: \"kubernetes.io/projected/58d59c05-b846-4baf-b357-5bf2f07e9664-kube-api-access-v9t6h\") pod \"test-model-a1592f-kserve-8fcc54b6f-l5tz6\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") " pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:45.785623 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:45.785587    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:46.057740 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:46.057715    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"]
Sep 08 15:10:46.059781 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:10:46.059746    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58d59c05_b846_4baf_b357_5bf2f07e9664.slice/crio-3a50ada19817acba1b5782b0ef67a0f2e9e54da7e52036789d1250c0100961bc WatchSource:0}: Error finding container 3a50ada19817acba1b5782b0ef67a0f2e9e54da7e52036789d1250c0100961bc: Status 404 returned error can't find the container with id 3a50ada19817acba1b5782b0ef67a0f2e9e54da7e52036789d1250c0100961bc
Sep 08 15:10:46.660409 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:46.660377    2580 generic.go:356] "Generic (PLEG): container finished" podID="eeeeea81-4673-49f4-a2ed-81f5410b78c2" containerID="dacddc9040dd81f3e65268632011472526738b534e48ec1e69159650c77640df" exitCode=0
Sep 08 15:10:46.660593 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:46.660451    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k" event={"ID":"eeeeea81-4673-49f4-a2ed-81f5410b78c2","Type":"ContainerDied","Data":"dacddc9040dd81f3e65268632011472526738b534e48ec1e69159650c77640df"}
Sep 08 15:10:46.662055 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:46.662030    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6" event={"ID":"58d59c05-b846-4baf-b357-5bf2f07e9664","Type":"ContainerStarted","Data":"b1a4252499a141f07338efefac668c4847f7eba202ae7534b5dbe61c5654884d"}
Sep 08 15:10:46.662183 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:46.662066    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6" event={"ID":"58d59c05-b846-4baf-b357-5bf2f07e9664","Type":"ContainerStarted","Data":"3a50ada19817acba1b5782b0ef67a0f2e9e54da7e52036789d1250c0100961bc"}
Sep 08 15:10:46.707267 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:46.707197    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6" podStartSLOduration=1.707174164 podStartE2EDuration="1.707174164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:10:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:10:46.704425199 +0000 UTC m=+926.036664750" watchObservedRunningTime="2026-09-08 15:10:46.707174164 +0000 UTC m=+926.039413712"
Sep 08 15:10:47.808324 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:47.808296    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k"
Sep 08 15:10:47.917102 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:47.917056    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eeeeea81-4673-49f4-a2ed-81f5410b78c2-maas-api-service-ca\") pod \"eeeeea81-4673-49f4-a2ed-81f5410b78c2\" (UID: \"eeeeea81-4673-49f4-a2ed-81f5410b78c2\") "
Sep 08 15:10:47.917558 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:47.917476    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeeeea81-4673-49f4-a2ed-81f5410b78c2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eeeeea81-4673-49f4-a2ed-81f5410b78c2" (UID: "eeeeea81-4673-49f4-a2ed-81f5410b78c2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:10:48.017882 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:48.017844    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eeeeea81-4673-49f4-a2ed-81f5410b78c2-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:10:48.682805 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:48.682766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k" event={"ID":"eeeeea81-4673-49f4-a2ed-81f5410b78c2","Type":"ContainerDied","Data":"628cc9657fdd9d1f4d7e31863d847847603a14a62dbb158b7311cb15be65c2de"}
Sep 08 15:10:48.682805 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:48.682793    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k"
Sep 08 15:10:48.683358 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:48.682861    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="628cc9657fdd9d1f4d7e31863d847847603a14a62dbb158b7311cb15be65c2de"
Sep 08 15:10:53.412068 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:53.412035    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:10:55.496617 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:55.496579    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"]
Sep 08 15:10:55.497086 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:55.496945    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq" podUID="03d93fa1-c73a-4c9f-82d2-fabf7b623d7d" containerName="payload-processing" containerID="cri-o://e686d273efaf45d3a9f1f72a589e8c9a26c7f4ac464708ec2eda3114e2488849" gracePeriod=30
Sep 08 15:10:55.653834 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:55.653739    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k"]
Sep 08 15:10:55.656987 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:55.656942    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6b2b2e-snk7k"]
Sep 08 15:10:55.721980 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:55.721946    2580 generic.go:356] "Generic (PLEG): container finished" podID="03d93fa1-c73a-4c9f-82d2-fabf7b623d7d" containerID="e686d273efaf45d3a9f1f72a589e8c9a26c7f4ac464708ec2eda3114e2488849" exitCode=0
Sep 08 15:10:55.722169 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:55.722021    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq" event={"ID":"03d93fa1-c73a-4c9f-82d2-fabf7b623d7d","Type":"ContainerDied","Data":"e686d273efaf45d3a9f1f72a589e8c9a26c7f4ac464708ec2eda3114e2488849"}
Sep 08 15:10:55.779355 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:55.779328    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"
Sep 08 15:10:55.786271 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:55.786243    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:55.786430 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:55.786400    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:55.800086 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:55.800057    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:55.901188 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:55.901156    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v6z9\" (UniqueName: \"kubernetes.io/projected/03d93fa1-c73a-4c9f-82d2-fabf7b623d7d-kube-api-access-9v6z9\") pod \"03d93fa1-c73a-4c9f-82d2-fabf7b623d7d\" (UID: \"03d93fa1-c73a-4c9f-82d2-fabf7b623d7d\") "
Sep 08 15:10:55.901355 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:55.901252    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03d93fa1-c73a-4c9f-82d2-fabf7b623d7d-plugins-config-volume\") pod \"03d93fa1-c73a-4c9f-82d2-fabf7b623d7d\" (UID: \"03d93fa1-c73a-4c9f-82d2-fabf7b623d7d\") "
Sep 08 15:10:55.901603 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:55.901565    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03d93fa1-c73a-4c9f-82d2-fabf7b623d7d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "03d93fa1-c73a-4c9f-82d2-fabf7b623d7d" (UID: "03d93fa1-c73a-4c9f-82d2-fabf7b623d7d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:10:55.903186 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:55.903165    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03d93fa1-c73a-4c9f-82d2-fabf7b623d7d-kube-api-access-9v6z9" (OuterVolumeSpecName: "kube-api-access-9v6z9") pod "03d93fa1-c73a-4c9f-82d2-fabf7b623d7d" (UID: "03d93fa1-c73a-4c9f-82d2-fabf7b623d7d"). InnerVolumeSpecName "kube-api-access-9v6z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:10:56.002054 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:56.002006    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v6z9\" (UniqueName: \"kubernetes.io/projected/03d93fa1-c73a-4c9f-82d2-fabf7b623d7d-kube-api-access-9v6z9\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:10:56.002054 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:56.002038    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03d93fa1-c73a-4c9f-82d2-fabf7b623d7d-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:10:56.728419 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:56.728383    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"
Sep 08 15:10:56.728930 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:56.728417    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq" event={"ID":"03d93fa1-c73a-4c9f-82d2-fabf7b623d7d","Type":"ContainerDied","Data":"4668b7356975cc3e0bb7226992241390cd59f7ef715355f3e4e96d31db06c00b"}
Sep 08 15:10:56.728930 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:56.728481    2580 scope.go:117] "RemoveContainer" containerID="e686d273efaf45d3a9f1f72a589e8c9a26c7f4ac464708ec2eda3114e2488849"
Sep 08 15:10:56.740671 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:56.740650    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:10:56.755035 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:56.755002    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"]
Sep 08 15:10:56.761601 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:56.761550    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6b2b2e-6dcf85694c-rmfmq"]
Sep 08 15:10:57.156741 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:57.156661    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03d93fa1-c73a-4c9f-82d2-fabf7b623d7d" path="/var/lib/kubelet/pods/03d93fa1-c73a-4c9f-82d2-fabf7b623d7d/volumes"
Sep 08 15:10:57.157044 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:10:57.157031    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeeeea81-4673-49f4-a2ed-81f5410b78c2" path="/var/lib/kubelet/pods/eeeeea81-4673-49f4-a2ed-81f5410b78c2/volumes"
Sep 08 15:11:04.774918 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:04.774884    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc"]
Sep 08 15:11:04.775496 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:04.775480    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeeeea81-4673-49f4-a2ed-81f5410b78c2" containerName="revoke-keys"
Sep 08 15:11:04.775575 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:04.775500    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeeeea81-4673-49f4-a2ed-81f5410b78c2" containerName="revoke-keys"
Sep 08 15:11:04.775575 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:04.775537    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03d93fa1-c73a-4c9f-82d2-fabf7b623d7d" containerName="payload-processing"
Sep 08 15:11:04.775575 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:04.775548    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="03d93fa1-c73a-4c9f-82d2-fabf7b623d7d" containerName="payload-processing"
Sep 08 15:11:04.775664 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:04.775657    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="03d93fa1-c73a-4c9f-82d2-fabf7b623d7d" containerName="payload-processing"
Sep 08 15:11:04.775698 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:04.775671    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeeeea81-4673-49f4-a2ed-81f5410b78c2" containerName="revoke-keys"
Sep 08 15:11:04.780254 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:04.780229    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc"
Sep 08 15:11:04.786224 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:04.785303    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:11:04.786224 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:04.785549    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc"]
Sep 08 15:11:04.786224 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:04.785605    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:11:04.893959 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:04.893926    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec5bb00a-7b37-40b3-97c2-29ce9d227d0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9b84af36-28tcc\" (UID: \"ec5bb00a-7b37-40b3-97c2-29ce9d227d0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc"
Sep 08 15:11:04.994896 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:04.994864    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec5bb00a-7b37-40b3-97c2-29ce9d227d0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9b84af36-28tcc\" (UID: \"ec5bb00a-7b37-40b3-97c2-29ce9d227d0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc"
Sep 08 15:11:04.995540 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:04.995490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec5bb00a-7b37-40b3-97c2-29ce9d227d0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9b84af36-28tcc\" (UID: \"ec5bb00a-7b37-40b3-97c2-29ce9d227d0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc"
Sep 08 15:11:05.097591 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:05.097457    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc"
Sep 08 15:11:05.370614 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:05.370581    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc"]
Sep 08 15:11:05.372345 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:11:05.372316    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5bb00a_7b37_40b3_97c2_29ce9d227d0c.slice/crio-198edf7e1a779447a4141e6f1ffac3d81e72107d6297f1b7c71f7a85108ea4ff WatchSource:0}: Error finding container 198edf7e1a779447a4141e6f1ffac3d81e72107d6297f1b7c71f7a85108ea4ff: Status 404 returned error can't find the container with id 198edf7e1a779447a4141e6f1ffac3d81e72107d6297f1b7c71f7a85108ea4ff
Sep 08 15:11:05.780067 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:05.780024    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc" event={"ID":"ec5bb00a-7b37-40b3-97c2-29ce9d227d0c","Type":"ContainerStarted","Data":"1c2818ed5882ace394c6be10837b2656487d3a34f272c295cda2710f4c783dfe"}
Sep 08 15:11:05.780496 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:05.780086    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc" event={"ID":"ec5bb00a-7b37-40b3-97c2-29ce9d227d0c","Type":"ContainerStarted","Data":"198edf7e1a779447a4141e6f1ffac3d81e72107d6297f1b7c71f7a85108ea4ff"}
Sep 08 15:11:05.794731 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:05.794675    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc" podStartSLOduration=1.7946609740000001 podStartE2EDuration="1.794660974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:11:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:11:05.793879159 +0000 UTC m=+945.126118705" watchObservedRunningTime="2026-09-08 15:11:05.794660974 +0000 UTC m=+945.126900520"
Sep 08 15:11:06.787401 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:06.787370    2580 generic.go:356] "Generic (PLEG): container finished" podID="ec5bb00a-7b37-40b3-97c2-29ce9d227d0c" containerID="1c2818ed5882ace394c6be10837b2656487d3a34f272c295cda2710f4c783dfe" exitCode=0
Sep 08 15:11:06.787797 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:06.787455    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc" event={"ID":"ec5bb00a-7b37-40b3-97c2-29ce9d227d0c","Type":"ContainerDied","Data":"1c2818ed5882ace394c6be10837b2656487d3a34f272c295cda2710f4c783dfe"}
Sep 08 15:11:07.940129 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:07.940103    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc"
Sep 08 15:11:08.026081 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:08.026050    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec5bb00a-7b37-40b3-97c2-29ce9d227d0c-maas-api-service-ca\") pod \"ec5bb00a-7b37-40b3-97c2-29ce9d227d0c\" (UID: \"ec5bb00a-7b37-40b3-97c2-29ce9d227d0c\") "
Sep 08 15:11:08.026393 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:08.026369    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec5bb00a-7b37-40b3-97c2-29ce9d227d0c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ec5bb00a-7b37-40b3-97c2-29ce9d227d0c" (UID: "ec5bb00a-7b37-40b3-97c2-29ce9d227d0c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:11:08.127582 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:08.127457    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec5bb00a-7b37-40b3-97c2-29ce9d227d0c-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:11:08.800229 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:08.800197    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc"
Sep 08 15:11:08.800419 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:08.800199    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc" event={"ID":"ec5bb00a-7b37-40b3-97c2-29ce9d227d0c","Type":"ContainerDied","Data":"198edf7e1a779447a4141e6f1ffac3d81e72107d6297f1b7c71f7a85108ea4ff"}
Sep 08 15:11:08.800419 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:08.800338    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="198edf7e1a779447a4141e6f1ffac3d81e72107d6297f1b7c71f7a85108ea4ff"
Sep 08 15:11:11.904947 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:11.904912    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc"]
Sep 08 15:11:11.907401 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:11.907373    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b84af36-28tcc"]
Sep 08 15:11:13.156950 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:13.156917    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec5bb00a-7b37-40b3-97c2-29ce9d227d0c" path="/var/lib/kubelet/pods/ec5bb00a-7b37-40b3-97c2-29ce9d227d0c/volumes"
Sep 08 15:11:13.710588 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:13.710545    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:11:28.908438 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:28.908404    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:11:33.764926 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:33.764885    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"]
Sep 08 15:11:33.765317 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:33.765160    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph" podUID="7994a1be-f043-49f5-9601-efe59dd1d6e8" containerName="istio-proxy" containerID="cri-o://c893558059f5df94cb8262ad5306487d847c4bd7ce31c03d67c5afc858693433" gracePeriod=30
Sep 08 15:11:38.968413 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:38.968377    2580 generic.go:356] "Generic (PLEG): container finished" podID="7994a1be-f043-49f5-9601-efe59dd1d6e8" containerID="c893558059f5df94cb8262ad5306487d847c4bd7ce31c03d67c5afc858693433" exitCode=0
Sep 08 15:11:38.968792 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:38.968443    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph" event={"ID":"7994a1be-f043-49f5-9601-efe59dd1d6e8","Type":"ContainerDied","Data":"c893558059f5df94cb8262ad5306487d847c4bd7ce31c03d67c5afc858693433"}
Sep 08 15:11:38.968792 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:38.968527    2580 scope.go:117] "RemoveContainer" containerID="539f126e5ef752cdb4be9c7cb0aea97e58f2a3852f03116661aeee5ac9e9ab25"
Sep 08 15:11:39.032935 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.032847    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:11:39.150214 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150176    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-credential-socket\") pod \"7994a1be-f043-49f5-9601-efe59dd1d6e8\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") "
Sep 08 15:11:39.150418 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150223    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-envoy\") pod \"7994a1be-f043-49f5-9601-efe59dd1d6e8\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") "
Sep 08 15:11:39.150418 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150276    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-workload-socket\") pod \"7994a1be-f043-49f5-9601-efe59dd1d6e8\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") "
Sep 08 15:11:39.150418 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150305    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-workload-certs\") pod \"7994a1be-f043-49f5-9601-efe59dd1d6e8\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") "
Sep 08 15:11:39.150418 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150333    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7994a1be-f043-49f5-9601-efe59dd1d6e8-istiod-ca-cert\") pod \"7994a1be-f043-49f5-9601-efe59dd1d6e8\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") "
Sep 08 15:11:39.150418 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150359    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-token\") pod \"7994a1be-f043-49f5-9601-efe59dd1d6e8\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") "
Sep 08 15:11:39.150418 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150407    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq8c6\" (UniqueName: \"kubernetes.io/projected/7994a1be-f043-49f5-9601-efe59dd1d6e8-kube-api-access-tq8c6\") pod \"7994a1be-f043-49f5-9601-efe59dd1d6e8\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") "
Sep 08 15:11:39.150806 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150486    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-data\") pod \"7994a1be-f043-49f5-9601-efe59dd1d6e8\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") "
Sep 08 15:11:39.150806 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150484    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7994a1be-f043-49f5-9601-efe59dd1d6e8" (UID: "7994a1be-f043-49f5-9601-efe59dd1d6e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:11:39.150806 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150596    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-podinfo\") pod \"7994a1be-f043-49f5-9601-efe59dd1d6e8\" (UID: \"7994a1be-f043-49f5-9601-efe59dd1d6e8\") "
Sep 08 15:11:39.150806 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150624    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7994a1be-f043-49f5-9601-efe59dd1d6e8" (UID: "7994a1be-f043-49f5-9601-efe59dd1d6e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:11:39.150806 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150638    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7994a1be-f043-49f5-9601-efe59dd1d6e8" (UID: "7994a1be-f043-49f5-9601-efe59dd1d6e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:11:39.151072 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150853    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "7994a1be-f043-49f5-9601-efe59dd1d6e8" (UID: "7994a1be-f043-49f5-9601-efe59dd1d6e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:11:39.151072 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150904    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:11:39.151072 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150923    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:11:39.151072 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150937    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:11:39.151072 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.150957    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7994a1be-f043-49f5-9601-efe59dd1d6e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7994a1be-f043-49f5-9601-efe59dd1d6e8" (UID: "7994a1be-f043-49f5-9601-efe59dd1d6e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:11:39.152796 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.152749    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7994a1be-f043-49f5-9601-efe59dd1d6e8" (UID: "7994a1be-f043-49f5-9601-efe59dd1d6e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:11:39.152905 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.152856    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7994a1be-f043-49f5-9601-efe59dd1d6e8" (UID: "7994a1be-f043-49f5-9601-efe59dd1d6e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:11:39.153114 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.153092    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "7994a1be-f043-49f5-9601-efe59dd1d6e8" (UID: "7994a1be-f043-49f5-9601-efe59dd1d6e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:11:39.153184 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.153113    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7994a1be-f043-49f5-9601-efe59dd1d6e8-kube-api-access-tq8c6" (OuterVolumeSpecName: "kube-api-access-tq8c6") pod "7994a1be-f043-49f5-9601-efe59dd1d6e8" (UID: "7994a1be-f043-49f5-9601-efe59dd1d6e8"). InnerVolumeSpecName "kube-api-access-tq8c6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:11:39.252437 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.252394    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:11:39.252437 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.252426    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7994a1be-f043-49f5-9601-efe59dd1d6e8-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:11:39.252437 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.252436    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:11:39.252437 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.252444    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq8c6\" (UniqueName: \"kubernetes.io/projected/7994a1be-f043-49f5-9601-efe59dd1d6e8-kube-api-access-tq8c6\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:11:39.252800 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.252452    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:11:39.252800 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.252461    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7994a1be-f043-49f5-9601-efe59dd1d6e8-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:11:39.975524 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.975487    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"
Sep 08 15:11:39.975954 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.975535    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph" event={"ID":"7994a1be-f043-49f5-9601-efe59dd1d6e8","Type":"ContainerDied","Data":"1172aa65f6b4fe25b74f8b0e8c99b2f2e5be68fcd3c2d6c5e93191bcf0d2c6d1"}
Sep 08 15:11:39.975954 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.975586    2580 scope.go:117] "RemoveContainer" containerID="c893558059f5df94cb8262ad5306487d847c4bd7ce31c03d67c5afc858693433"
Sep 08 15:11:39.993149 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.993119    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"]
Sep 08 15:11:39.997838 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:39.997804    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-6b2b2e-openshift-default-5b66f8cc48-9sdph"]
Sep 08 15:11:41.156590 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:41.156562    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7994a1be-f043-49f5-9601-efe59dd1d6e8" path="/var/lib/kubelet/pods/7994a1be-f043-49f5-9601-efe59dd1d6e8/volumes"
Sep 08 15:11:43.715437 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:11:43.715352    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:12:02.799532 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:02.799476    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:12:18.915552 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:18.915517    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:12:22.059321 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.059281    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8"]
Sep 08 15:12:22.059743 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.059728    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7994a1be-f043-49f5-9601-efe59dd1d6e8" containerName="istio-proxy"
Sep 08 15:12:22.059743 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.059744    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7994a1be-f043-49f5-9601-efe59dd1d6e8" containerName="istio-proxy"
Sep 08 15:12:22.059825 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.059766    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec5bb00a-7b37-40b3-97c2-29ce9d227d0c" containerName="revoke-keys"
Sep 08 15:12:22.059825 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.059771    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec5bb00a-7b37-40b3-97c2-29ce9d227d0c" containerName="revoke-keys"
Sep 08 15:12:22.059825 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.059784    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7994a1be-f043-49f5-9601-efe59dd1d6e8" containerName="istio-proxy"
Sep 08 15:12:22.059825 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.059791    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7994a1be-f043-49f5-9601-efe59dd1d6e8" containerName="istio-proxy"
Sep 08 15:12:22.059944 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.059847    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7994a1be-f043-49f5-9601-efe59dd1d6e8" containerName="istio-proxy"
Sep 08 15:12:22.059944 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.059859    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec5bb00a-7b37-40b3-97c2-29ce9d227d0c" containerName="revoke-keys"
Sep 08 15:12:22.063848 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.063828    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8"
Sep 08 15:12:22.066522 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.066486    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:12:22.066653 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.066533    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:12:22.071248 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.071218    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8"]
Sep 08 15:12:22.177094 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.177048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ac43b2-646b8\" (UID: \"bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8"
Sep 08 15:12:22.278166 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.278119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ac43b2-646b8\" (UID: \"bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8"
Sep 08 15:12:22.278839 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.278818    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ac43b2-646b8\" (UID: \"bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8"
Sep 08 15:12:22.376137 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.376052    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8"
Sep 08 15:12:22.646743 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:22.646713    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8"]
Sep 08 15:12:22.648479 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:12:22.648455    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde9f4f9_87ab_4552_b1ac_0fa3616d0fc8.slice/crio-0e32637047852aa288dd5cba11ce8b9589d9a9f33e599fe76b20abef9efb6569 WatchSource:0}: Error finding container 0e32637047852aa288dd5cba11ce8b9589d9a9f33e599fe76b20abef9efb6569: Status 404 returned error can't find the container with id 0e32637047852aa288dd5cba11ce8b9589d9a9f33e599fe76b20abef9efb6569
Sep 08 15:12:23.203681 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:23.203589    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8" event={"ID":"bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8","Type":"ContainerStarted","Data":"f7dbd1d93fab8ef045a634d210b9702a1bb842757b36775e57215bfa79a84986"}
Sep 08 15:12:23.203681 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:23.203640    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8" event={"ID":"bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8","Type":"ContainerStarted","Data":"0e32637047852aa288dd5cba11ce8b9589d9a9f33e599fe76b20abef9efb6569"}
Sep 08 15:12:23.220999 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:23.220948    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8" podStartSLOduration=1.2209320830000001 podStartE2EDuration="1.220932083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:12:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:12:23.219063115 +0000 UTC m=+1022.551302673" watchObservedRunningTime="2026-09-08 15:12:23.220932083 +0000 UTC m=+1022.553171629"
Sep 08 15:12:24.210641 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:24.210605    2580 generic.go:356] "Generic (PLEG): container finished" podID="bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8" containerID="f7dbd1d93fab8ef045a634d210b9702a1bb842757b36775e57215bfa79a84986" exitCode=0
Sep 08 15:12:24.211048 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:24.210648    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8" event={"ID":"bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8","Type":"ContainerDied","Data":"f7dbd1d93fab8ef045a634d210b9702a1bb842757b36775e57215bfa79a84986"}
Sep 08 15:12:25.352673 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:25.352648    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8"
Sep 08 15:12:25.510684 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:25.510598    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8-maas-api-service-ca\") pod \"bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8\" (UID: \"bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8\") "
Sep 08 15:12:25.510966 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:25.510941    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8" (UID: "bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:12:25.611994 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:25.611953    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:12:26.222164 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:26.222132    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8"
Sep 08 15:12:26.222164 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:26.222161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8" event={"ID":"bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8","Type":"ContainerDied","Data":"0e32637047852aa288dd5cba11ce8b9589d9a9f33e599fe76b20abef9efb6569"}
Sep 08 15:12:26.222372 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:26.222203    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e32637047852aa288dd5cba11ce8b9589d9a9f33e599fe76b20abef9efb6569"
Sep 08 15:12:32.884732 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:32.884696    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8"]
Sep 08 15:12:32.887519 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:32.887480    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac43b2-646b8"]
Sep 08 15:12:33.156306 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:33.156222    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8" path="/var/lib/kubelet/pods/bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8/volumes"
Sep 08 15:12:37.703824 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:37.703784    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:12:51.477192 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:51.477148    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"]
Sep 08 15:12:53.105101 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:12:53.105061    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:13:00.005045 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:00.005012    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd"]
Sep 08 15:13:00.005448 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:00.005424    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8" containerName="revoke-keys"
Sep 08 15:13:00.005448 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:00.005439    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8" containerName="revoke-keys"
Sep 08 15:13:00.005697 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:00.005539    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bde9f4f9-87ab-4552-b1ac-0fa3616d0fc8" containerName="revoke-keys"
Sep 08 15:13:00.005697 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:00.005549    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7994a1be-f043-49f5-9601-efe59dd1d6e8" containerName="istio-proxy"
Sep 08 15:13:00.008728 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:00.008707    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd"
Sep 08 15:13:00.011564 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:00.011491    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:13:00.011917 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:00.011902    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:13:00.016698 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:00.016674    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd"]
Sep 08 15:13:00.151860 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:00.151814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b12e01d7-3b25-4fb6-aa34-5836527097ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd\" (UID: \"b12e01d7-3b25-4fb6-aa34-5836527097ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd"
Sep 08 15:13:00.253287 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:00.253246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b12e01d7-3b25-4fb6-aa34-5836527097ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd\" (UID: \"b12e01d7-3b25-4fb6-aa34-5836527097ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd"
Sep 08 15:13:00.253900 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:00.253876    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b12e01d7-3b25-4fb6-aa34-5836527097ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd\" (UID: \"b12e01d7-3b25-4fb6-aa34-5836527097ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd"
Sep 08 15:13:00.321446 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:00.321351    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd"
Sep 08 15:13:00.593543 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:00.593502    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd"]
Sep 08 15:13:00.595729 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:13:00.595706    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12e01d7_3b25_4fb6_aa34_5836527097ec.slice/crio-0b21d4e2291f18e47a2c14011d74e9f70417eef03e2e2993be1a1a053e023ff7 WatchSource:0}: Error finding container 0b21d4e2291f18e47a2c14011d74e9f70417eef03e2e2993be1a1a053e023ff7: Status 404 returned error can't find the container with id 0b21d4e2291f18e47a2c14011d74e9f70417eef03e2e2993be1a1a053e023ff7
Sep 08 15:13:01.413985 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:01.413950    2580 generic.go:356] "Generic (PLEG): container finished" podID="b12e01d7-3b25-4fb6-aa34-5836527097ec" containerID="06a44e6c6ff6df087737d9c3af78efc55aa7c5efb1df91df5120c61fd6e4a3a3" exitCode=0
Sep 08 15:13:01.414373 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:01.414043    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd" event={"ID":"b12e01d7-3b25-4fb6-aa34-5836527097ec","Type":"ContainerDied","Data":"06a44e6c6ff6df087737d9c3af78efc55aa7c5efb1df91df5120c61fd6e4a3a3"}
Sep 08 15:13:01.414373 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:01.414101    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd" event={"ID":"b12e01d7-3b25-4fb6-aa34-5836527097ec","Type":"ContainerStarted","Data":"0b21d4e2291f18e47a2c14011d74e9f70417eef03e2e2993be1a1a053e023ff7"}
Sep 08 15:13:02.560331 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:02.560298    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd"
Sep 08 15:13:02.678913 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:02.678819    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b12e01d7-3b25-4fb6-aa34-5836527097ec-maas-api-service-ca\") pod \"b12e01d7-3b25-4fb6-aa34-5836527097ec\" (UID: \"b12e01d7-3b25-4fb6-aa34-5836527097ec\") "
Sep 08 15:13:02.679236 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:02.679206    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b12e01d7-3b25-4fb6-aa34-5836527097ec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b12e01d7-3b25-4fb6-aa34-5836527097ec" (UID: "b12e01d7-3b25-4fb6-aa34-5836527097ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:02.780311 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:02.780276    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b12e01d7-3b25-4fb6-aa34-5836527097ec-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:03.426271 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:03.426189    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd"
Sep 08 15:13:03.426434 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:03.426192    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd" event={"ID":"b12e01d7-3b25-4fb6-aa34-5836527097ec","Type":"ContainerDied","Data":"0b21d4e2291f18e47a2c14011d74e9f70417eef03e2e2993be1a1a053e023ff7"}
Sep 08 15:13:03.426434 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:03.426308    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b21d4e2291f18e47a2c14011d74e9f70417eef03e2e2993be1a1a053e023ff7"
Sep 08 15:13:06.500757 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.500719    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6" podUID="58d59c05-b846-4baf-b357-5bf2f07e9664" containerName="main" containerID="cri-o://b1a4252499a141f07338efefac668c4847f7eba202ae7534b5dbe61c5654884d" gracePeriod=45
Sep 08 15:13:06.745232 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.745204    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:13:06.819838 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.819746    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-tmp-dir\") pod \"58d59c05-b846-4baf-b357-5bf2f07e9664\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") "
Sep 08 15:13:06.819838 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.819787    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-model-cache\") pod \"58d59c05-b846-4baf-b357-5bf2f07e9664\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") "
Sep 08 15:13:06.819838 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.819839    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-home\") pod \"58d59c05-b846-4baf-b357-5bf2f07e9664\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") "
Sep 08 15:13:06.820118 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.819883    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9t6h\" (UniqueName: \"kubernetes.io/projected/58d59c05-b846-4baf-b357-5bf2f07e9664-kube-api-access-v9t6h\") pod \"58d59c05-b846-4baf-b357-5bf2f07e9664\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") "
Sep 08 15:13:06.820118 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.819936    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-dshm\") pod \"58d59c05-b846-4baf-b357-5bf2f07e9664\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") "
Sep 08 15:13:06.820118 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.819965    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58d59c05-b846-4baf-b357-5bf2f07e9664-tls-certs\") pod \"58d59c05-b846-4baf-b357-5bf2f07e9664\" (UID: \"58d59c05-b846-4baf-b357-5bf2f07e9664\") "
Sep 08 15:13:06.820263 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.820116    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "58d59c05-b846-4baf-b357-5bf2f07e9664" (UID: "58d59c05-b846-4baf-b357-5bf2f07e9664"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:06.820263 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.820148    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-model-cache" (OuterVolumeSpecName: "model-cache") pod "58d59c05-b846-4baf-b357-5bf2f07e9664" (UID: "58d59c05-b846-4baf-b357-5bf2f07e9664"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:06.820263 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.820196    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-home" (OuterVolumeSpecName: "home") pod "58d59c05-b846-4baf-b357-5bf2f07e9664" (UID: "58d59c05-b846-4baf-b357-5bf2f07e9664"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:06.820423 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.820352    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-tmp-dir\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:06.820423 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.820368    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-model-cache\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:06.820423 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.820376    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-home\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:06.822281 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.822256    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58d59c05-b846-4baf-b357-5bf2f07e9664-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "58d59c05-b846-4baf-b357-5bf2f07e9664" (UID: "58d59c05-b846-4baf-b357-5bf2f07e9664"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:13:06.822371 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.822309    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58d59c05-b846-4baf-b357-5bf2f07e9664-kube-api-access-v9t6h" (OuterVolumeSpecName: "kube-api-access-v9t6h") pod "58d59c05-b846-4baf-b357-5bf2f07e9664" (UID: "58d59c05-b846-4baf-b357-5bf2f07e9664"). InnerVolumeSpecName "kube-api-access-v9t6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:06.822371 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.822319    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-dshm" (OuterVolumeSpecName: "dshm") pod "58d59c05-b846-4baf-b357-5bf2f07e9664" (UID: "58d59c05-b846-4baf-b357-5bf2f07e9664"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:06.921877 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.921834    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9t6h\" (UniqueName: \"kubernetes.io/projected/58d59c05-b846-4baf-b357-5bf2f07e9664-kube-api-access-v9t6h\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:06.921877 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.921868    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58d59c05-b846-4baf-b357-5bf2f07e9664-dshm\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:06.921877 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:06.921879    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58d59c05-b846-4baf-b357-5bf2f07e9664-tls-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:07.420928 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:07.420821    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:13:07.450611 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:07.450576    2580 generic.go:356] "Generic (PLEG): container finished" podID="58d59c05-b846-4baf-b357-5bf2f07e9664" containerID="b1a4252499a141f07338efefac668c4847f7eba202ae7534b5dbe61c5654884d" exitCode=0
Sep 08 15:13:07.450792 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:07.450635    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"
Sep 08 15:13:07.450792 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:07.450660    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6" event={"ID":"58d59c05-b846-4baf-b357-5bf2f07e9664","Type":"ContainerDied","Data":"b1a4252499a141f07338efefac668c4847f7eba202ae7534b5dbe61c5654884d"}
Sep 08 15:13:07.450792 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:07.450705    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6" event={"ID":"58d59c05-b846-4baf-b357-5bf2f07e9664","Type":"ContainerDied","Data":"3a50ada19817acba1b5782b0ef67a0f2e9e54da7e52036789d1250c0100961bc"}
Sep 08 15:13:07.450792 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:07.450723    2580 scope.go:117] "RemoveContainer" containerID="b1a4252499a141f07338efefac668c4847f7eba202ae7534b5dbe61c5654884d"
Sep 08 15:13:07.459615 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:07.459561    2580 scope.go:117] "RemoveContainer" containerID="b1a4252499a141f07338efefac668c4847f7eba202ae7534b5dbe61c5654884d"
Sep 08 15:13:07.459885 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:13:07.459868    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1a4252499a141f07338efefac668c4847f7eba202ae7534b5dbe61c5654884d\": container with ID starting with b1a4252499a141f07338efefac668c4847f7eba202ae7534b5dbe61c5654884d not found: ID does not exist" containerID="b1a4252499a141f07338efefac668c4847f7eba202ae7534b5dbe61c5654884d"
Sep 08 15:13:07.459935 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:07.459897    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1a4252499a141f07338efefac668c4847f7eba202ae7534b5dbe61c5654884d"} err="failed to get container status \"b1a4252499a141f07338efefac668c4847f7eba202ae7534b5dbe61c5654884d\": rpc error: code = NotFound desc = could not find container \"b1a4252499a141f07338efefac668c4847f7eba202ae7534b5dbe61c5654884d\": container with ID starting with b1a4252499a141f07338efefac668c4847f7eba202ae7534b5dbe61c5654884d not found: ID does not exist"
Sep 08 15:13:07.466817 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:07.466787    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"]
Sep 08 15:13:07.472637 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:07.472608    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6"]
Sep 08 15:13:09.156135 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:09.156094    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58d59c05-b846-4baf-b357-5bf2f07e9664" path="/var/lib/kubelet/pods/58d59c05-b846-4baf-b357-5bf2f07e9664/volumes"
Sep 08 15:13:10.530334 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:10.530294    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"]
Sep 08 15:13:10.530817 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:10.530581    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2" podUID="42b7b7b5-9625-4a77-86fe-17c5525882db" containerName="payload-processing" containerID="cri-o://69f2a64cdea29d2f4d587a9ec2755174bdc82ba4de9dc83558b0193c88785c96" gracePeriod=30
Sep 08 15:13:10.690707 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:10.690669    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd"]
Sep 08 15:13:10.694001 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:10.693976    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1592f-q5mcd"]
Sep 08 15:13:10.805653 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:10.805625    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"
Sep 08 15:13:10.962470 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:10.962439    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7zn2\" (UniqueName: \"kubernetes.io/projected/42b7b7b5-9625-4a77-86fe-17c5525882db-kube-api-access-g7zn2\") pod \"42b7b7b5-9625-4a77-86fe-17c5525882db\" (UID: \"42b7b7b5-9625-4a77-86fe-17c5525882db\") "
Sep 08 15:13:10.962641 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:10.962488    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42b7b7b5-9625-4a77-86fe-17c5525882db-plugins-config-volume\") pod \"42b7b7b5-9625-4a77-86fe-17c5525882db\" (UID: \"42b7b7b5-9625-4a77-86fe-17c5525882db\") "
Sep 08 15:13:10.962863 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:10.962841    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42b7b7b5-9625-4a77-86fe-17c5525882db-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "42b7b7b5-9625-4a77-86fe-17c5525882db" (UID: "42b7b7b5-9625-4a77-86fe-17c5525882db"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:10.964537 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:10.964499    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42b7b7b5-9625-4a77-86fe-17c5525882db-kube-api-access-g7zn2" (OuterVolumeSpecName: "kube-api-access-g7zn2") pod "42b7b7b5-9625-4a77-86fe-17c5525882db" (UID: "42b7b7b5-9625-4a77-86fe-17c5525882db"). InnerVolumeSpecName "kube-api-access-g7zn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:11.064080 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:11.063989    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7zn2\" (UniqueName: \"kubernetes.io/projected/42b7b7b5-9625-4a77-86fe-17c5525882db-kube-api-access-g7zn2\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:11.064080 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:11.064023    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42b7b7b5-9625-4a77-86fe-17c5525882db-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:11.156083 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:11.156043    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b12e01d7-3b25-4fb6-aa34-5836527097ec" path="/var/lib/kubelet/pods/b12e01d7-3b25-4fb6-aa34-5836527097ec/volumes"
Sep 08 15:13:11.475794 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:11.475757    2580 generic.go:356] "Generic (PLEG): container finished" podID="42b7b7b5-9625-4a77-86fe-17c5525882db" containerID="69f2a64cdea29d2f4d587a9ec2755174bdc82ba4de9dc83558b0193c88785c96" exitCode=0
Sep 08 15:13:11.475960 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:11.475806    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"
Sep 08 15:13:11.475960 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:11.475836    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2" event={"ID":"42b7b7b5-9625-4a77-86fe-17c5525882db","Type":"ContainerDied","Data":"69f2a64cdea29d2f4d587a9ec2755174bdc82ba4de9dc83558b0193c88785c96"}
Sep 08 15:13:11.475960 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:11.475887    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2" event={"ID":"42b7b7b5-9625-4a77-86fe-17c5525882db","Type":"ContainerDied","Data":"8efe9ec83347b1deb7b4d959b539a096841b4912a086d8a146fb854a3279adb2"}
Sep 08 15:13:11.475960 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:11.475911    2580 scope.go:117] "RemoveContainer" containerID="69f2a64cdea29d2f4d587a9ec2755174bdc82ba4de9dc83558b0193c88785c96"
Sep 08 15:13:11.484260 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:11.484244    2580 scope.go:117] "RemoveContainer" containerID="69f2a64cdea29d2f4d587a9ec2755174bdc82ba4de9dc83558b0193c88785c96"
Sep 08 15:13:11.484582 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:13:11.484552    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69f2a64cdea29d2f4d587a9ec2755174bdc82ba4de9dc83558b0193c88785c96\": container with ID starting with 69f2a64cdea29d2f4d587a9ec2755174bdc82ba4de9dc83558b0193c88785c96 not found: ID does not exist" containerID="69f2a64cdea29d2f4d587a9ec2755174bdc82ba4de9dc83558b0193c88785c96"
Sep 08 15:13:11.484641 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:11.484591    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69f2a64cdea29d2f4d587a9ec2755174bdc82ba4de9dc83558b0193c88785c96"} err="failed to get container status \"69f2a64cdea29d2f4d587a9ec2755174bdc82ba4de9dc83558b0193c88785c96\": rpc error: code = NotFound desc = could not find container \"69f2a64cdea29d2f4d587a9ec2755174bdc82ba4de9dc83558b0193c88785c96\": container with ID starting with 69f2a64cdea29d2f4d587a9ec2755174bdc82ba4de9dc83558b0193c88785c96 not found: ID does not exist"
Sep 08 15:13:11.492666 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:11.492638    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"]
Sep 08 15:13:11.495634 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:11.495613    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a1592f-859779b6c7-kgdm2"]
Sep 08 15:13:11.730387 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:11.730296    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-inf-a-a1592f/test-model-a1592f-kserve-8fcc54b6f-l5tz6" podUID="58d59c05-b846-4baf-b357-5bf2f07e9664" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": context deadline exceeded"
Sep 08 15:13:13.157005 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:13.156969    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42b7b7b5-9625-4a77-86fe-17c5525882db" path="/var/lib/kubelet/pods/42b7b7b5-9625-4a77-86fe-17c5525882db/volumes"
Sep 08 15:13:18.393007 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.392971    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"]
Sep 08 15:13:18.393412 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.393229    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt" podUID="f583cf51-15ca-41e3-9c90-1777460151c5" containerName="istio-proxy" containerID="cri-o://a67134915dbf3e0389a9772839e802ec22dbea893f8e3b2b07661daa7b19feee" gracePeriod=30
Sep 08 15:13:18.761281 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.761247    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6"]
Sep 08 15:13:18.761656 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.761644    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42b7b7b5-9625-4a77-86fe-17c5525882db" containerName="payload-processing"
Sep 08 15:13:18.761706 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.761658    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="42b7b7b5-9625-4a77-86fe-17c5525882db" containerName="payload-processing"
Sep 08 15:13:18.761706 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.761669    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b12e01d7-3b25-4fb6-aa34-5836527097ec" containerName="revoke-keys"
Sep 08 15:13:18.761706 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.761674    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b12e01d7-3b25-4fb6-aa34-5836527097ec" containerName="revoke-keys"
Sep 08 15:13:18.761706 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.761686    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58d59c05-b846-4baf-b357-5bf2f07e9664" containerName="main"
Sep 08 15:13:18.761706 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.761691    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="58d59c05-b846-4baf-b357-5bf2f07e9664" containerName="main"
Sep 08 15:13:18.761901 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.761748    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b12e01d7-3b25-4fb6-aa34-5836527097ec" containerName="revoke-keys"
Sep 08 15:13:18.761901 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.761757    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="58d59c05-b846-4baf-b357-5bf2f07e9664" containerName="main"
Sep 08 15:13:18.761901 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.761765    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="42b7b7b5-9625-4a77-86fe-17c5525882db" containerName="payload-processing"
Sep 08 15:13:18.764973 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.764952    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6"
Sep 08 15:13:18.767355 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.767331    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:13:18.767466 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.767402    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:13:18.774258 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.774232    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6"]
Sep 08 15:13:18.841660 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.841623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d856eed2-acbb-4281-80de-602c3c9a61a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6\" (UID: \"d856eed2-acbb-4281-80de-602c3c9a61a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6"
Sep 08 15:13:18.942333 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.942299    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d856eed2-acbb-4281-80de-602c3c9a61a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6\" (UID: \"d856eed2-acbb-4281-80de-602c3c9a61a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6"
Sep 08 15:13:18.942967 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:18.942946    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d856eed2-acbb-4281-80de-602c3c9a61a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6\" (UID: \"d856eed2-acbb-4281-80de-602c3c9a61a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6"
Sep 08 15:13:19.076919 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:19.076819    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6"
Sep 08 15:13:19.351459 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:19.351433    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6"]
Sep 08 15:13:19.353773 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:13:19.353742    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd856eed2_acbb_4281_80de_602c3c9a61a7.slice/crio-cbc4dedb9fda43e32c7cc75ba8aae1128a40fd36da1323eef47d5848d321e944 WatchSource:0}: Error finding container cbc4dedb9fda43e32c7cc75ba8aae1128a40fd36da1323eef47d5848d321e944: Status 404 returned error can't find the container with id cbc4dedb9fda43e32c7cc75ba8aae1128a40fd36da1323eef47d5848d321e944
Sep 08 15:13:19.526404 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:19.526369    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6" event={"ID":"d856eed2-acbb-4281-80de-602c3c9a61a7","Type":"ContainerStarted","Data":"cbc4dedb9fda43e32c7cc75ba8aae1128a40fd36da1323eef47d5848d321e944"}
Sep 08 15:13:20.536194 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:20.536154    2580 generic.go:356] "Generic (PLEG): container finished" podID="d856eed2-acbb-4281-80de-602c3c9a61a7" containerID="10b0a848590a709db2191d3cfc8c35ec997ccb411530e0c83caa863b44cace16" exitCode=0
Sep 08 15:13:20.536694 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:20.536239    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6" event={"ID":"d856eed2-acbb-4281-80de-602c3c9a61a7","Type":"ContainerDied","Data":"10b0a848590a709db2191d3cfc8c35ec997ccb411530e0c83caa863b44cace16"}
Sep 08 15:13:21.004453 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:21.004424    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:13:21.691463 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:21.691427    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6"
Sep 08 15:13:21.762011 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:21.761976    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d856eed2-acbb-4281-80de-602c3c9a61a7-maas-api-service-ca\") pod \"d856eed2-acbb-4281-80de-602c3c9a61a7\" (UID: \"d856eed2-acbb-4281-80de-602c3c9a61a7\") "
Sep 08 15:13:21.762332 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:21.762307    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d856eed2-acbb-4281-80de-602c3c9a61a7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d856eed2-acbb-4281-80de-602c3c9a61a7" (UID: "d856eed2-acbb-4281-80de-602c3c9a61a7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:21.863019 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:21.862932    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d856eed2-acbb-4281-80de-602c3c9a61a7-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:22.548044 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:22.548016    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6"
Sep 08 15:13:22.548225 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:22.548052    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6" event={"ID":"d856eed2-acbb-4281-80de-602c3c9a61a7","Type":"ContainerDied","Data":"cbc4dedb9fda43e32c7cc75ba8aae1128a40fd36da1323eef47d5848d321e944"}
Sep 08 15:13:22.548225 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:22.548093    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbc4dedb9fda43e32c7cc75ba8aae1128a40fd36da1323eef47d5848d321e944"
Sep 08 15:13:23.555914 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.555883    2580 generic.go:356] "Generic (PLEG): container finished" podID="f583cf51-15ca-41e3-9c90-1777460151c5" containerID="a67134915dbf3e0389a9772839e802ec22dbea893f8e3b2b07661daa7b19feee" exitCode=0
Sep 08 15:13:23.555914 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.555917    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt" event={"ID":"f583cf51-15ca-41e3-9c90-1777460151c5","Type":"ContainerDied","Data":"a67134915dbf3e0389a9772839e802ec22dbea893f8e3b2b07661daa7b19feee"}
Sep 08 15:13:23.556391 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.555979    2580 scope.go:117] "RemoveContainer" containerID="dd75fe57c63704b673596ee93d3279390fc2e590ffc04b1958278920597a947d"
Sep 08 15:13:23.654052 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.654019    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:13:23.675953 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.675877    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-istio-envoy\") pod \"f583cf51-15ca-41e3-9c90-1777460151c5\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") "
Sep 08 15:13:23.675953 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.675912    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-credential-socket\") pod \"f583cf51-15ca-41e3-9c90-1777460151c5\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") "
Sep 08 15:13:23.675953 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.675941    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-workload-socket\") pod \"f583cf51-15ca-41e3-9c90-1777460151c5\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") "
Sep 08 15:13:23.676596 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.675972    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f583cf51-15ca-41e3-9c90-1777460151c5-istio-podinfo\") pod \"f583cf51-15ca-41e3-9c90-1777460151c5\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") "
Sep 08 15:13:23.676596 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.675997    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-istio-data\") pod \"f583cf51-15ca-41e3-9c90-1777460151c5\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") "
Sep 08 15:13:23.676596 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.676066    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f583cf51-15ca-41e3-9c90-1777460151c5-istio-token\") pod \"f583cf51-15ca-41e3-9c90-1777460151c5\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") "
Sep 08 15:13:23.676596 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.676104    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-workload-certs\") pod \"f583cf51-15ca-41e3-9c90-1777460151c5\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") "
Sep 08 15:13:23.676596 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.676147    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f583cf51-15ca-41e3-9c90-1777460151c5-istiod-ca-cert\") pod \"f583cf51-15ca-41e3-9c90-1777460151c5\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") "
Sep 08 15:13:23.676596 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.676208    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npxcl\" (UniqueName: \"kubernetes.io/projected/f583cf51-15ca-41e3-9c90-1777460151c5-kube-api-access-npxcl\") pod \"f583cf51-15ca-41e3-9c90-1777460151c5\" (UID: \"f583cf51-15ca-41e3-9c90-1777460151c5\") "
Sep 08 15:13:23.676596 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.676300    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f583cf51-15ca-41e3-9c90-1777460151c5" (UID: "f583cf51-15ca-41e3-9c90-1777460151c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:23.677813 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.676613    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:23.677813 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.676252    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f583cf51-15ca-41e3-9c90-1777460151c5" (UID: "f583cf51-15ca-41e3-9c90-1777460151c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:23.677813 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.677644    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f583cf51-15ca-41e3-9c90-1777460151c5" (UID: "f583cf51-15ca-41e3-9c90-1777460151c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:23.677959 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.677794    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-istio-data" (OuterVolumeSpecName: "istio-data") pod "f583cf51-15ca-41e3-9c90-1777460151c5" (UID: "f583cf51-15ca-41e3-9c90-1777460151c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:23.678011 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.677952    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f583cf51-15ca-41e3-9c90-1777460151c5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f583cf51-15ca-41e3-9c90-1777460151c5" (UID: "f583cf51-15ca-41e3-9c90-1777460151c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:23.678919 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.678879    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f583cf51-15ca-41e3-9c90-1777460151c5-istio-token" (OuterVolumeSpecName: "istio-token") pod "f583cf51-15ca-41e3-9c90-1777460151c5" (UID: "f583cf51-15ca-41e3-9c90-1777460151c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:23.679201 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.679174    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f583cf51-15ca-41e3-9c90-1777460151c5" (UID: "f583cf51-15ca-41e3-9c90-1777460151c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:23.679201 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.679182    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f583cf51-15ca-41e3-9c90-1777460151c5-kube-api-access-npxcl" (OuterVolumeSpecName: "kube-api-access-npxcl") pod "f583cf51-15ca-41e3-9c90-1777460151c5" (UID: "f583cf51-15ca-41e3-9c90-1777460151c5"). InnerVolumeSpecName "kube-api-access-npxcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:23.679915 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.679892    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f583cf51-15ca-41e3-9c90-1777460151c5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f583cf51-15ca-41e3-9c90-1777460151c5" (UID: "f583cf51-15ca-41e3-9c90-1777460151c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:13:23.777058 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.777027    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:23.777058 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.777053    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f583cf51-15ca-41e3-9c90-1777460151c5-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:23.777058 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.777062    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npxcl\" (UniqueName: \"kubernetes.io/projected/f583cf51-15ca-41e3-9c90-1777460151c5-kube-api-access-npxcl\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:23.777298 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.777073    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:23.777298 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.777082    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:23.777298 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.777091    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f583cf51-15ca-41e3-9c90-1777460151c5-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:23.777298 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.777099    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f583cf51-15ca-41e3-9c90-1777460151c5-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:23.777298 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:23.777106    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f583cf51-15ca-41e3-9c90-1777460151c5-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:24.563476 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:24.563448    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"
Sep 08 15:13:24.563910 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:24.563441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt" event={"ID":"f583cf51-15ca-41e3-9c90-1777460151c5","Type":"ContainerDied","Data":"3120b36fdbef9339d7201ad1220c12effd5ef65d83d39faf62adf9312708d6f5"}
Sep 08 15:13:24.563910 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:24.563605    2580 scope.go:117] "RemoveContainer" containerID="a67134915dbf3e0389a9772839e802ec22dbea893f8e3b2b07661daa7b19feee"
Sep 08 15:13:24.584062 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:24.584034    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"]
Sep 08 15:13:24.587646 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:24.587623    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a1592f-openshift-default-f76cb8f58-mdqnt"]
Sep 08 15:13:25.062291 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.062258    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb"]
Sep 08 15:13:25.062690 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.062675    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d856eed2-acbb-4281-80de-602c3c9a61a7" containerName="revoke-keys"
Sep 08 15:13:25.062740 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.062692    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d856eed2-acbb-4281-80de-602c3c9a61a7" containerName="revoke-keys"
Sep 08 15:13:25.062740 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.062702    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f583cf51-15ca-41e3-9c90-1777460151c5" containerName="istio-proxy"
Sep 08 15:13:25.062740 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.062707    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f583cf51-15ca-41e3-9c90-1777460151c5" containerName="istio-proxy"
Sep 08 15:13:25.062740 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.062722    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f583cf51-15ca-41e3-9c90-1777460151c5" containerName="istio-proxy"
Sep 08 15:13:25.062740 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.062728    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f583cf51-15ca-41e3-9c90-1777460151c5" containerName="istio-proxy"
Sep 08 15:13:25.062893 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.062795    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f583cf51-15ca-41e3-9c90-1777460151c5" containerName="istio-proxy"
Sep 08 15:13:25.062893 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.062806    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d856eed2-acbb-4281-80de-602c3c9a61a7" containerName="revoke-keys"
Sep 08 15:13:25.067205 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.067183    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb"
Sep 08 15:13:25.069688 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.069664    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:13:25.069820 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.069716    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:13:25.073196 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.073163    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb"]
Sep 08 15:13:25.090297 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.090257    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec2fb2f6-5233-4688-9bb7-93909133e31f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb\" (UID: \"ec2fb2f6-5233-4688-9bb7-93909133e31f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb"
Sep 08 15:13:25.157024 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.156990    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f583cf51-15ca-41e3-9c90-1777460151c5" path="/var/lib/kubelet/pods/f583cf51-15ca-41e3-9c90-1777460151c5/volumes"
Sep 08 15:13:25.191408 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.191370    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec2fb2f6-5233-4688-9bb7-93909133e31f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb\" (UID: \"ec2fb2f6-5233-4688-9bb7-93909133e31f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb"
Sep 08 15:13:25.192031 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.192009    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec2fb2f6-5233-4688-9bb7-93909133e31f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb\" (UID: \"ec2fb2f6-5233-4688-9bb7-93909133e31f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb"
Sep 08 15:13:25.379859 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.379771    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb"
Sep 08 15:13:25.651773 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:25.651434    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb"]
Sep 08 15:13:25.654328 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:13:25.654302    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec2fb2f6_5233_4688_9bb7_93909133e31f.slice/crio-6ebba43822d93c7bd6afae772a6fb47853faa7360af74948cab583d5ed6c2835 WatchSource:0}: Error finding container 6ebba43822d93c7bd6afae772a6fb47853faa7360af74948cab583d5ed6c2835: Status 404 returned error can't find the container with id 6ebba43822d93c7bd6afae772a6fb47853faa7360af74948cab583d5ed6c2835
Sep 08 15:13:26.577008 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:26.576972    2580 generic.go:356] "Generic (PLEG): container finished" podID="ec2fb2f6-5233-4688-9bb7-93909133e31f" containerID="3767eaf3a79af0a7d5620cc0ee63535aee3aad52b8882f5ca58f88b12d38347a" exitCode=0
Sep 08 15:13:26.577173 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:26.577033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb" event={"ID":"ec2fb2f6-5233-4688-9bb7-93909133e31f","Type":"ContainerDied","Data":"3767eaf3a79af0a7d5620cc0ee63535aee3aad52b8882f5ca58f88b12d38347a"}
Sep 08 15:13:26.577173 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:26.577074    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb" event={"ID":"ec2fb2f6-5233-4688-9bb7-93909133e31f","Type":"ContainerStarted","Data":"6ebba43822d93c7bd6afae772a6fb47853faa7360af74948cab583d5ed6c2835"}
Sep 08 15:13:27.721383 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:27.721356    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb"
Sep 08 15:13:27.814847 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:27.814812    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec2fb2f6-5233-4688-9bb7-93909133e31f-maas-api-service-ca\") pod \"ec2fb2f6-5233-4688-9bb7-93909133e31f\" (UID: \"ec2fb2f6-5233-4688-9bb7-93909133e31f\") "
Sep 08 15:13:27.815185 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:27.815158    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec2fb2f6-5233-4688-9bb7-93909133e31f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ec2fb2f6-5233-4688-9bb7-93909133e31f" (UID: "ec2fb2f6-5233-4688-9bb7-93909133e31f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:27.916415 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:27.916330    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec2fb2f6-5233-4688-9bb7-93909133e31f-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:28.595631 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:28.595603    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb"
Sep 08 15:13:28.595785 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:28.595641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb" event={"ID":"ec2fb2f6-5233-4688-9bb7-93909133e31f","Type":"ContainerDied","Data":"6ebba43822d93c7bd6afae772a6fb47853faa7360af74948cab583d5ed6c2835"}
Sep 08 15:13:28.595785 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:28.595717    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ebba43822d93c7bd6afae772a6fb47853faa7360af74948cab583d5ed6c2835"
Sep 08 15:13:29.866948 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:29.866913    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"]
Sep 08 15:13:29.867423 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:29.867163    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl" podUID="5fff8132-b098-4e33-8f52-e98924802997" containerName="payload-processing" containerID="cri-o://1a025923ab51d32325534eba026d8b7bd845064586dfd304be1234613c01ef34" gracePeriod=30
Sep 08 15:13:30.092450 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.092410    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6"]
Sep 08 15:13:30.094751 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.094724    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-eba68d-ggjj6"]
Sep 08 15:13:30.142978 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.142952    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"
Sep 08 15:13:30.238884 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.238835    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz4hm\" (UniqueName: \"kubernetes.io/projected/5fff8132-b098-4e33-8f52-e98924802997-kube-api-access-zz4hm\") pod \"5fff8132-b098-4e33-8f52-e98924802997\" (UID: \"5fff8132-b098-4e33-8f52-e98924802997\") "
Sep 08 15:13:30.239086 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.238982    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fff8132-b098-4e33-8f52-e98924802997-plugins-config-volume\") pod \"5fff8132-b098-4e33-8f52-e98924802997\" (UID: \"5fff8132-b098-4e33-8f52-e98924802997\") "
Sep 08 15:13:30.239465 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.239381    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fff8132-b098-4e33-8f52-e98924802997-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5fff8132-b098-4e33-8f52-e98924802997" (UID: "5fff8132-b098-4e33-8f52-e98924802997"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:30.241048 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.241024    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fff8132-b098-4e33-8f52-e98924802997-kube-api-access-zz4hm" (OuterVolumeSpecName: "kube-api-access-zz4hm") pod "5fff8132-b098-4e33-8f52-e98924802997" (UID: "5fff8132-b098-4e33-8f52-e98924802997"). InnerVolumeSpecName "kube-api-access-zz4hm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:30.340420 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.340385    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fff8132-b098-4e33-8f52-e98924802997-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:30.340420 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.340416    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz4hm\" (UniqueName: \"kubernetes.io/projected/5fff8132-b098-4e33-8f52-e98924802997-kube-api-access-zz4hm\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:30.607469 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.607437    2580 generic.go:356] "Generic (PLEG): container finished" podID="5fff8132-b098-4e33-8f52-e98924802997" containerID="1a025923ab51d32325534eba026d8b7bd845064586dfd304be1234613c01ef34" exitCode=0
Sep 08 15:13:30.607638 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.607487    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"
Sep 08 15:13:30.607638 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.607548    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl" event={"ID":"5fff8132-b098-4e33-8f52-e98924802997","Type":"ContainerDied","Data":"1a025923ab51d32325534eba026d8b7bd845064586dfd304be1234613c01ef34"}
Sep 08 15:13:30.607638 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.607606    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl" event={"ID":"5fff8132-b098-4e33-8f52-e98924802997","Type":"ContainerDied","Data":"30561273360db55b7f29003e7874c272c2582ebf41f63c9041e386a7079d9b2c"}
Sep 08 15:13:30.607638 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.607634    2580 scope.go:117] "RemoveContainer" containerID="1a025923ab51d32325534eba026d8b7bd845064586dfd304be1234613c01ef34"
Sep 08 15:13:30.616422 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.616405    2580 scope.go:117] "RemoveContainer" containerID="1a025923ab51d32325534eba026d8b7bd845064586dfd304be1234613c01ef34"
Sep 08 15:13:30.616711 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:13:30.616689    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a025923ab51d32325534eba026d8b7bd845064586dfd304be1234613c01ef34\": container with ID starting with 1a025923ab51d32325534eba026d8b7bd845064586dfd304be1234613c01ef34 not found: ID does not exist" containerID="1a025923ab51d32325534eba026d8b7bd845064586dfd304be1234613c01ef34"
Sep 08 15:13:30.616752 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.616723    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a025923ab51d32325534eba026d8b7bd845064586dfd304be1234613c01ef34"} err="failed to get container status \"1a025923ab51d32325534eba026d8b7bd845064586dfd304be1234613c01ef34\": rpc error: code = NotFound desc = could not find container \"1a025923ab51d32325534eba026d8b7bd845064586dfd304be1234613c01ef34\": container with ID starting with 1a025923ab51d32325534eba026d8b7bd845064586dfd304be1234613c01ef34 not found: ID does not exist"
Sep 08 15:13:30.629842 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.629818    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"]
Sep 08 15:13:30.635115 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:30.635091    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eba68d-fb9c57459-q8kwl"]
Sep 08 15:13:31.156175 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:31.156141    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fff8132-b098-4e33-8f52-e98924802997" path="/var/lib/kubelet/pods/5fff8132-b098-4e33-8f52-e98924802997/volumes"
Sep 08 15:13:31.156572 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:31.156494    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d856eed2-acbb-4281-80de-602c3c9a61a7" path="/var/lib/kubelet/pods/d856eed2-acbb-4281-80de-602c3c9a61a7/volumes"
Sep 08 15:13:32.612825 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:32.612789    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:13:35.976552 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:35.976482    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb"]
Sep 08 15:13:35.981072 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:35.981043    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b04cf783-ffwrb"]
Sep 08 15:13:37.156850 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:37.156815    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec2fb2f6-5233-4688-9bb7-93909133e31f" path="/var/lib/kubelet/pods/ec2fb2f6-5233-4688-9bb7-93909133e31f/volumes"
Sep 08 15:13:37.659960 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:37.659927    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"]
Sep 08 15:13:37.660222 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:37.660190    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr" podUID="0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" containerName="istio-proxy" containerID="cri-o://ff5ae8f84dfe973fc2c04ace7583a4e7554d3ab69a63f59be83ceca864e3ae3a" gracePeriod=30
Sep 08 15:13:38.742916 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.742878    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"]
Sep 08 15:13:38.743372 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.743297    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fff8132-b098-4e33-8f52-e98924802997" containerName="payload-processing"
Sep 08 15:13:38.743372 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.743308    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fff8132-b098-4e33-8f52-e98924802997" containerName="payload-processing"
Sep 08 15:13:38.743372 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.743320    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec2fb2f6-5233-4688-9bb7-93909133e31f" containerName="revoke-keys"
Sep 08 15:13:38.743372 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.743326    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec2fb2f6-5233-4688-9bb7-93909133e31f" containerName="revoke-keys"
Sep 08 15:13:38.743610 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.743379    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fff8132-b098-4e33-8f52-e98924802997" containerName="payload-processing"
Sep 08 15:13:38.743610 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.743387    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec2fb2f6-5233-4688-9bb7-93909133e31f" containerName="revoke-keys"
Sep 08 15:13:38.743610 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.743396    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f583cf51-15ca-41e3-9c90-1777460151c5" containerName="istio-proxy"
Sep 08 15:13:38.747801 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.747782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.752497 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.752474    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-ffa941-openshift-default-dockercfg-pmdz9\""
Sep 08 15:13:38.766596 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.766569    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"]
Sep 08 15:13:38.814856 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.814826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-workload-socket\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.815078 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.814869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-istio-data\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.815078 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.814891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48063ef5-8d74-4b72-a67c-5329839dc225-istiod-ca-cert\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.815078 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.814969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf95l\" (UniqueName: \"kubernetes.io/projected/48063ef5-8d74-4b72-a67c-5329839dc225-kube-api-access-kf95l\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.815078 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.815039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48063ef5-8d74-4b72-a67c-5329839dc225-istio-token\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.815078 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.815073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48063ef5-8d74-4b72-a67c-5329839dc225-istio-podinfo\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.815352 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.815107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-istio-envoy\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.815352 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.815135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-workload-certs\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.815352 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.815192    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-credential-socket\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.916115 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.916074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-credential-socket\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.916312 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.916141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-workload-socket\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.916312 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.916178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-istio-data\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.916312 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.916201    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48063ef5-8d74-4b72-a67c-5329839dc225-istiod-ca-cert\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.916312 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.916223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf95l\" (UniqueName: \"kubernetes.io/projected/48063ef5-8d74-4b72-a67c-5329839dc225-kube-api-access-kf95l\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.916312 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.916249    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48063ef5-8d74-4b72-a67c-5329839dc225-istio-token\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.916312 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.916285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48063ef5-8d74-4b72-a67c-5329839dc225-istio-podinfo\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.916691 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.916329    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-istio-envoy\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.916691 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.916609    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-credential-socket\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.916691 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.916632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-workload-socket\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.916842 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.916704    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-istio-data\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.916842 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.916731    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-workload-certs\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.916987 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.916966    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48063ef5-8d74-4b72-a67c-5329839dc225-istiod-ca-cert\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.917048 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.917026    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-workload-certs\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.918854 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.918831    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-istio-envoy\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.918998 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.918976    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48063ef5-8d74-4b72-a67c-5329839dc225-istio-podinfo\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.924921 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.924887    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48063ef5-8d74-4b72-a67c-5329839dc225-istio-token\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:38.925144 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:38.925127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf95l\" (UniqueName: \"kubernetes.io/projected/48063ef5-8d74-4b72-a67c-5329839dc225-kube-api-access-kf95l\") pod \"e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") " pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:39.058113 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:39.058019    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:39.339832 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:39.339784    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"]
Sep 08 15:13:39.341108 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:13:39.341082    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48063ef5_8d74_4b72_a67c_5329839dc225.slice/crio-22c7a1fc82ef9d233d99c4db6f80b6e08b4f718bf2a9da911fa7b5dad5930dd0 WatchSource:0}: Error finding container 22c7a1fc82ef9d233d99c4db6f80b6e08b4f718bf2a9da911fa7b5dad5930dd0: Status 404 returned error can't find the container with id 22c7a1fc82ef9d233d99c4db6f80b6e08b4f718bf2a9da911fa7b5dad5930dd0
Sep 08 15:13:39.343307 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:39.343268    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:13:39.343400 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:39.343338    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:13:39.343400 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:39.343369    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:13:39.658360 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:39.658268    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l" event={"ID":"48063ef5-8d74-4b72-a67c-5329839dc225","Type":"ContainerStarted","Data":"b8871f053c1b379f7f836401c625ed21cd2811692e9c1abf2811017f96bc4d60"}
Sep 08 15:13:39.658360 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:39.658339    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l" event={"ID":"48063ef5-8d74-4b72-a67c-5329839dc225","Type":"ContainerStarted","Data":"22c7a1fc82ef9d233d99c4db6f80b6e08b4f718bf2a9da911fa7b5dad5930dd0"}
Sep 08 15:13:39.680299 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:39.680245    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l" podStartSLOduration=1.68022624 podStartE2EDuration="1.68022624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:39.678063822 +0000 UTC m=+1099.010303368" watchObservedRunningTime="2026-09-08 15:13:39.68022624 +0000 UTC m=+1099.012465787"
Sep 08 15:13:40.058891 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:40.058849    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:40.063818 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:40.063788    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:40.403704 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:40.403618    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:13:40.664055 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:40.663977    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:40.664956 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:40.664936    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:42.930866 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:42.930797    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:13:43.057744 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.057705    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-token\") pod \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") "
Sep 08 15:13:43.057993 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.057760    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-podinfo\") pod \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") "
Sep 08 15:13:43.057993 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.057791    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-credential-socket\") pod \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") "
Sep 08 15:13:43.057993 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.057860    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-workload-socket\") pod \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") "
Sep 08 15:13:43.057993 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.057907    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-data\") pod \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") "
Sep 08 15:13:43.057993 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.057939    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-workload-certs\") pod \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") "
Sep 08 15:13:43.057993 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.057985    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-envoy\") pod \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") "
Sep 08 15:13:43.058324 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.058037    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istiod-ca-cert\") pod \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") "
Sep 08 15:13:43.058324 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.058076    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbg7g\" (UniqueName: \"kubernetes.io/projected/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-kube-api-access-xbg7g\") pod \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\" (UID: \"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd\") "
Sep 08 15:13:43.058324 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.058233    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-data" (OuterVolumeSpecName: "istio-data") pod "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" (UID: "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:43.058541 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.058491    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:43.059076 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.058832    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" (UID: "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:43.059076 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.058850    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" (UID: "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:43.059076 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.058950    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" (UID: "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:43.059319 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.059128    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" (UID: "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:43.060201 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.060174    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-token" (OuterVolumeSpecName: "istio-token") pod "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" (UID: "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:43.060368 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.060351    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" (UID: "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:13:43.060463 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.060446    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" (UID: "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:43.060573 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.060552    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-kube-api-access-xbg7g" (OuterVolumeSpecName: "kube-api-access-xbg7g") pod "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" (UID: "0e5463bc-4403-40b9-9a95-8c0a1fefb3cd"). InnerVolumeSpecName "kube-api-access-xbg7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:43.160269 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.160239    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:43.160269 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.160266    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:43.160269 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.160276    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbg7g\" (UniqueName: \"kubernetes.io/projected/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-kube-api-access-xbg7g\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:43.160505 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.160284    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:43.160505 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.160294    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:43.160505 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.160301    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:43.160505 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.160309    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:43.160505 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.160318    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:13:43.681098 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.681060    2580 generic.go:356] "Generic (PLEG): container finished" podID="0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" containerID="ff5ae8f84dfe973fc2c04ace7583a4e7554d3ab69a63f59be83ceca864e3ae3a" exitCode=0
Sep 08 15:13:43.681274 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.681132    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"
Sep 08 15:13:43.681274 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.681145    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr" event={"ID":"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd","Type":"ContainerDied","Data":"ff5ae8f84dfe973fc2c04ace7583a4e7554d3ab69a63f59be83ceca864e3ae3a"}
Sep 08 15:13:43.681274 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.681224    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr" event={"ID":"0e5463bc-4403-40b9-9a95-8c0a1fefb3cd","Type":"ContainerDied","Data":"f5afc9d705499b0bfc3a1bd6661354feb30dba978feb2430c1baaa4555485495"}
Sep 08 15:13:43.681274 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.681247    2580 scope.go:117] "RemoveContainer" containerID="ff5ae8f84dfe973fc2c04ace7583a4e7554d3ab69a63f59be83ceca864e3ae3a"
Sep 08 15:13:43.690382 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.690355    2580 scope.go:117] "RemoveContainer" containerID="f8c7cfba26728ea6def0bd25ba325e96cd558e53b656364b2248df9d9d37c63c"
Sep 08 15:13:43.698290 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.698270    2580 scope.go:117] "RemoveContainer" containerID="ff5ae8f84dfe973fc2c04ace7583a4e7554d3ab69a63f59be83ceca864e3ae3a"
Sep 08 15:13:43.698581 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:13:43.698554    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff5ae8f84dfe973fc2c04ace7583a4e7554d3ab69a63f59be83ceca864e3ae3a\": container with ID starting with ff5ae8f84dfe973fc2c04ace7583a4e7554d3ab69a63f59be83ceca864e3ae3a not found: ID does not exist" containerID="ff5ae8f84dfe973fc2c04ace7583a4e7554d3ab69a63f59be83ceca864e3ae3a"
Sep 08 15:13:43.698700 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.698592    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff5ae8f84dfe973fc2c04ace7583a4e7554d3ab69a63f59be83ceca864e3ae3a"} err="failed to get container status \"ff5ae8f84dfe973fc2c04ace7583a4e7554d3ab69a63f59be83ceca864e3ae3a\": rpc error: code = NotFound desc = could not find container \"ff5ae8f84dfe973fc2c04ace7583a4e7554d3ab69a63f59be83ceca864e3ae3a\": container with ID starting with ff5ae8f84dfe973fc2c04ace7583a4e7554d3ab69a63f59be83ceca864e3ae3a not found: ID does not exist"
Sep 08 15:13:43.698700 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.698615    2580 scope.go:117] "RemoveContainer" containerID="f8c7cfba26728ea6def0bd25ba325e96cd558e53b656364b2248df9d9d37c63c"
Sep 08 15:13:43.699062 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:13:43.699003    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8c7cfba26728ea6def0bd25ba325e96cd558e53b656364b2248df9d9d37c63c\": container with ID starting with f8c7cfba26728ea6def0bd25ba325e96cd558e53b656364b2248df9d9d37c63c not found: ID does not exist" containerID="f8c7cfba26728ea6def0bd25ba325e96cd558e53b656364b2248df9d9d37c63c"
Sep 08 15:13:43.699168 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.699053    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c7cfba26728ea6def0bd25ba325e96cd558e53b656364b2248df9d9d37c63c"} err="failed to get container status \"f8c7cfba26728ea6def0bd25ba325e96cd558e53b656364b2248df9d9d37c63c\": rpc error: code = NotFound desc = could not find container \"f8c7cfba26728ea6def0bd25ba325e96cd558e53b656364b2248df9d9d37c63c\": container with ID starting with f8c7cfba26728ea6def0bd25ba325e96cd558e53b656364b2248df9d9d37c63c not found: ID does not exist"
Sep 08 15:13:43.701370 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.701349    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"]
Sep 08 15:13:43.709675 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.709650    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-eba68d-openshift-default-6b678d948d-ltvxr"]
Sep 08 15:13:43.924190 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.924152    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"]
Sep 08 15:13:43.924586 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.924573    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" containerName="istio-proxy"
Sep 08 15:13:43.924656 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.924588    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" containerName="istio-proxy"
Sep 08 15:13:43.924656 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.924601    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" containerName="istio-proxy"
Sep 08 15:13:43.924656 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.924608    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" containerName="istio-proxy"
Sep 08 15:13:43.924751 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.924666    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" containerName="istio-proxy"
Sep 08 15:13:43.924751 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.924678    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" containerName="istio-proxy"
Sep 08 15:13:43.929365 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.929340    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"
Sep 08 15:13:43.932026 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.931962    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-ffa941-dockercfg-6gv54\""
Sep 08 15:13:43.932026 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.932012    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-ffa941\""
Sep 08 15:13:43.938720 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:43.938692    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"]
Sep 08 15:13:44.070468 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:44.070429    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2qks\" (UniqueName: \"kubernetes.io/projected/6a0904cf-e2e2-4d76-bb4f-915f04031923-kube-api-access-d2qks\") pod \"payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92\" (UID: \"6a0904cf-e2e2-4d76-bb4f-915f04031923\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"
Sep 08 15:13:44.070643 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:44.070546    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a0904cf-e2e2-4d76-bb4f-915f04031923-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92\" (UID: \"6a0904cf-e2e2-4d76-bb4f-915f04031923\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"
Sep 08 15:13:44.171781 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:44.171737    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2qks\" (UniqueName: \"kubernetes.io/projected/6a0904cf-e2e2-4d76-bb4f-915f04031923-kube-api-access-d2qks\") pod \"payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92\" (UID: \"6a0904cf-e2e2-4d76-bb4f-915f04031923\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"
Sep 08 15:13:44.171946 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:44.171836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a0904cf-e2e2-4d76-bb4f-915f04031923-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92\" (UID: \"6a0904cf-e2e2-4d76-bb4f-915f04031923\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"
Sep 08 15:13:44.172481 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:44.172461    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a0904cf-e2e2-4d76-bb4f-915f04031923-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92\" (UID: \"6a0904cf-e2e2-4d76-bb4f-915f04031923\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"
Sep 08 15:13:44.179944 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:44.179917    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2qks\" (UniqueName: \"kubernetes.io/projected/6a0904cf-e2e2-4d76-bb4f-915f04031923-kube-api-access-d2qks\") pod \"payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92\" (UID: \"6a0904cf-e2e2-4d76-bb4f-915f04031923\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"
Sep 08 15:13:44.240869 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:44.240835    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"
Sep 08 15:13:44.524450 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:44.524391    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"]
Sep 08 15:13:44.526686 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:13:44.526654    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a0904cf_e2e2_4d76_bb4f_915f04031923.slice/crio-9a4d269766ce34ecdd605c6b4c0d40e315b231a9a234b97b6152cd291b76b6ea WatchSource:0}: Error finding container 9a4d269766ce34ecdd605c6b4c0d40e315b231a9a234b97b6152cd291b76b6ea: Status 404 returned error can't find the container with id 9a4d269766ce34ecdd605c6b4c0d40e315b231a9a234b97b6152cd291b76b6ea
Sep 08 15:13:44.689448 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:44.689411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92" event={"ID":"6a0904cf-e2e2-4d76-bb4f-915f04031923","Type":"ContainerStarted","Data":"293ee8097a12b27c1f869906af4a55bd45aefa5899b3eb34072d091169540ad5"}
Sep 08 15:13:44.689632 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:44.689466    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92" event={"ID":"6a0904cf-e2e2-4d76-bb4f-915f04031923","Type":"ContainerStarted","Data":"9a4d269766ce34ecdd605c6b4c0d40e315b231a9a234b97b6152cd291b76b6ea"}
Sep 08 15:13:44.689632 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:44.689540    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"
Sep 08 15:13:44.711992 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:44.711935    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92" podStartSLOduration=1.711917481 podStartE2EDuration="1.711917481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:44.709947622 +0000 UTC m=+1104.042187168" watchObservedRunningTime="2026-09-08 15:13:44.711917481 +0000 UTC m=+1104.044157028"
Sep 08 15:13:45.156248 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:45.156215    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e5463bc-4403-40b9-9a95-8c0a1fefb3cd" path="/var/lib/kubelet/pods/0e5463bc-4403-40b9-9a95-8c0a1fefb3cd/volumes"
Sep 08 15:13:50.916223 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:50.916183    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:13:55.666017 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:55.665977    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 15:13:55.666399 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:55.666064    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l" podUID="48063ef5-8d74-4b72-a67c-5329839dc225" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 15:13:55.696388 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:55.696359    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"
Sep 08 15:13:55.751560 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:55.751468    2580 generic.go:356] "Generic (PLEG): container finished" podID="48063ef5-8d74-4b72-a67c-5329839dc225" containerID="b8871f053c1b379f7f836401c625ed21cd2811692e9c1abf2811017f96bc4d60" exitCode=0
Sep 08 15:13:55.751707 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:55.751556    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l" event={"ID":"48063ef5-8d74-4b72-a67c-5329839dc225","Type":"ContainerDied","Data":"b8871f053c1b379f7f836401c625ed21cd2811692e9c1abf2811017f96bc4d60"}
Sep 08 15:13:55.751974 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:55.751961    2580 scope.go:117] "RemoveContainer" containerID="b8871f053c1b379f7f836401c625ed21cd2811692e9c1abf2811017f96bc4d60"
Sep 08 15:13:55.752991 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:55.752967    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:13:55.753054 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:55.753031    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:13:55.753089 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:55.753059    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:13:56.759594 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:56.759558    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l" event={"ID":"48063ef5-8d74-4b72-a67c-5329839dc225","Type":"ContainerStarted","Data":"89f30f38bbe9da6c5f5c8dc9e3618d9c854c3a918c14f8861dc50002df2ae15a"}
Sep 08 15:13:57.058903 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:57.058796    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:13:57.059144 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:57.059116    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 15:13:57.059280 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:57.059168    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l" podUID="48063ef5-8d74-4b72-a67c-5329839dc225" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 15:13:58.058639 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:58.058596    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 15:13:58.059029 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:58.058656    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l" podUID="48063ef5-8d74-4b72-a67c-5329839dc225" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 15:13:59.058948 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:59.058910    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 15:13:59.059338 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:13:59.058966    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l" podUID="48063ef5-8d74-4b72-a67c-5329839dc225" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 15:14:00.059330 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:00.059291    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 15:14:00.059827 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:00.059358    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l" podUID="48063ef5-8d74-4b72-a67c-5329839dc225" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 15:14:01.058701 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:01.058664    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 15:14:01.058883 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:01.058721    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l" podUID="48063ef5-8d74-4b72-a67c-5329839dc225" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 15:14:01.845127 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:01.845073    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"]
Sep 08 15:14:01.859536 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:01.858716    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"]
Sep 08 15:14:01.859536 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:01.859065    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"
Sep 08 15:14:01.860202 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:01.860174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps6x7\" (UniqueName: \"kubernetes.io/projected/7ef6e950-95dd-47e1-b886-0d2d0305cd59-kube-api-access-ps6x7\") pod \"payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl\" (UID: \"7ef6e950-95dd-47e1-b886-0d2d0305cd59\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"
Sep 08 15:14:01.860419 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:01.860390    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ef6e950-95dd-47e1-b886-0d2d0305cd59-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl\" (UID: \"7ef6e950-95dd-47e1-b886-0d2d0305cd59\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"
Sep 08 15:14:01.862254 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:01.862226    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"]
Sep 08 15:14:01.862363 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:01.862274    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"]
Sep 08 15:14:01.862432 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:01.862364    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"
Sep 08 15:14:01.862626 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:01.862604    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-f6e5ca-dockercfg-65gsl\""
Sep 08 15:14:01.862797 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:01.862642    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-f6e5ca\""
Sep 08 15:14:01.961652 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:01.961606    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps6x7\" (UniqueName: \"kubernetes.io/projected/7ef6e950-95dd-47e1-b886-0d2d0305cd59-kube-api-access-ps6x7\") pod \"payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl\" (UID: \"7ef6e950-95dd-47e1-b886-0d2d0305cd59\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"
Sep 08 15:14:01.961844 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:01.961725    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ef6e950-95dd-47e1-b886-0d2d0305cd59-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl\" (UID: \"7ef6e950-95dd-47e1-b886-0d2d0305cd59\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"
Sep 08 15:14:01.962711 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:01.962608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ef6e950-95dd-47e1-b886-0d2d0305cd59-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl\" (UID: \"7ef6e950-95dd-47e1-b886-0d2d0305cd59\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"
Sep 08 15:14:01.971789 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:01.971759    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps6x7\" (UniqueName: \"kubernetes.io/projected/7ef6e950-95dd-47e1-b886-0d2d0305cd59-kube-api-access-ps6x7\") pod \"payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl\" (UID: \"7ef6e950-95dd-47e1-b886-0d2d0305cd59\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"
Sep 08 15:14:02.058912 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.058864    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 15:14:02.059088 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.058940    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l" podUID="48063ef5-8d74-4b72-a67c-5329839dc225" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 15:14:02.062323 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.062293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjlbr\" (UniqueName: \"kubernetes.io/projected/457913fb-0810-46e9-810b-48ac3767f7be-kube-api-access-qjlbr\") pod \"payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh\" (UID: \"457913fb-0810-46e9-810b-48ac3767f7be\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"
Sep 08 15:14:02.062396 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.062341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/457913fb-0810-46e9-810b-48ac3767f7be-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh\" (UID: \"457913fb-0810-46e9-810b-48ac3767f7be\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"
Sep 08 15:14:02.163548 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.163417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjlbr\" (UniqueName: \"kubernetes.io/projected/457913fb-0810-46e9-810b-48ac3767f7be-kube-api-access-qjlbr\") pod \"payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh\" (UID: \"457913fb-0810-46e9-810b-48ac3767f7be\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"
Sep 08 15:14:02.163733 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.163600    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/457913fb-0810-46e9-810b-48ac3767f7be-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh\" (UID: \"457913fb-0810-46e9-810b-48ac3767f7be\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"
Sep 08 15:14:02.164325 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.164300    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/457913fb-0810-46e9-810b-48ac3767f7be-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh\" (UID: \"457913fb-0810-46e9-810b-48ac3767f7be\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"
Sep 08 15:14:02.172095 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.172067    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjlbr\" (UniqueName: \"kubernetes.io/projected/457913fb-0810-46e9-810b-48ac3767f7be-kube-api-access-qjlbr\") pod \"payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh\" (UID: \"457913fb-0810-46e9-810b-48ac3767f7be\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"
Sep 08 15:14:02.172222 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.172210    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"
Sep 08 15:14:02.179832 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.179806    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"
Sep 08 15:14:02.485365 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.485333    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"]
Sep 08 15:14:02.487102 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:14:02.487073    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef6e950_95dd_47e1_b886_0d2d0305cd59.slice/crio-a65125061602e98ab981e6c570a213d85f916a79a55e3626fb4819d0053f3d03 WatchSource:0}: Error finding container a65125061602e98ab981e6c570a213d85f916a79a55e3626fb4819d0053f3d03: Status 404 returned error can't find the container with id a65125061602e98ab981e6c570a213d85f916a79a55e3626fb4819d0053f3d03
Sep 08 15:14:02.492034 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.491999    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"]
Sep 08 15:14:02.494562 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:14:02.494531    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457913fb_0810_46e9_810b_48ac3767f7be.slice/crio-ae81110e9b0cbd337309bb5a62033d807056ce5cfb5b1c7645a7d7088eea9adb WatchSource:0}: Error finding container ae81110e9b0cbd337309bb5a62033d807056ce5cfb5b1c7645a7d7088eea9adb: Status 404 returned error can't find the container with id ae81110e9b0cbd337309bb5a62033d807056ce5cfb5b1c7645a7d7088eea9adb
Sep 08 15:14:02.797376 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.797274    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh" event={"ID":"457913fb-0810-46e9-810b-48ac3767f7be","Type":"ContainerStarted","Data":"2e9b1f89cb06e7500d28b6cf9f253753b7bbe5dd485680c054b71154281c8c44"}
Sep 08 15:14:02.797376 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.797338    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh" event={"ID":"457913fb-0810-46e9-810b-48ac3767f7be","Type":"ContainerStarted","Data":"ae81110e9b0cbd337309bb5a62033d807056ce5cfb5b1c7645a7d7088eea9adb"}
Sep 08 15:14:02.797376 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.797369    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"
Sep 08 15:14:02.798956 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.798921    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl" event={"ID":"7ef6e950-95dd-47e1-b886-0d2d0305cd59","Type":"ContainerStarted","Data":"4a48941096d895d439602b840db2d44f952c1fca1762394075093a6971a5a087"}
Sep 08 15:14:02.799063 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.798977    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl" event={"ID":"7ef6e950-95dd-47e1-b886-0d2d0305cd59","Type":"ContainerStarted","Data":"a65125061602e98ab981e6c570a213d85f916a79a55e3626fb4819d0053f3d03"}
Sep 08 15:14:02.799063 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.799001    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"
Sep 08 15:14:02.815924 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.815850    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh" podStartSLOduration=1.815832071 podStartE2EDuration="1.815832071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:02.813182278 +0000 UTC m=+1122.145421826" watchObservedRunningTime="2026-09-08 15:14:02.815832071 +0000 UTC m=+1122.148071636"
Sep 08 15:14:02.834440 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:02.834366    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl" podStartSLOduration=1.8343443609999999 podStartE2EDuration="1.834344361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:02.83136666 +0000 UTC m=+1122.163606219" watchObservedRunningTime="2026-09-08 15:14:02.834344361 +0000 UTC m=+1122.166583915"
Sep 08 15:14:03.063213 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:03.063127    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:14:03.063622 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:03.063491    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:14:03.064303 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:03.064281    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:14:03.313643 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:03.313551    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:14:07.337058 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.337016    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"]
Sep 08 15:14:07.340166 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.340143    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.342647 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.342622    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-7be222-openshift-default-dockercfg-6sttp\""
Sep 08 15:14:07.354220 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.354193    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"]
Sep 08 15:14:07.413350 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.413314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-podinfo\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.413350 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.413349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-data\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.413633 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.413381    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-token\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.413633 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.413448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-envoy\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.413633 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.413487    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54s8d\" (UniqueName: \"kubernetes.io/projected/d2800f88-b692-414e-8928-35d7f7ab1d33-kube-api-access-54s8d\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.413633 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.413555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2800f88-b692-414e-8928-35d7f7ab1d33-istiod-ca-cert\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.413845 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.413642    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-credential-socket\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.413845 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.413668    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-workload-socket\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.413845 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.413711    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-workload-certs\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.514395 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.514356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-workload-certs\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.514395 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.514398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-podinfo\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.514672 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.514413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-data\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.514672 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.514549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-token\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.514672 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.514597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-envoy\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.514672 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.514630    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54s8d\" (UniqueName: \"kubernetes.io/projected/d2800f88-b692-414e-8928-35d7f7ab1d33-kube-api-access-54s8d\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.514893 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.514696    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2800f88-b692-414e-8928-35d7f7ab1d33-istiod-ca-cert\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.514893 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.514781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-credential-socket\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.514893 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.514790    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-workload-certs\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.514893 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.514824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-workload-socket\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.515250 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.515230    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-data\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.515333 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.515271    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-credential-socket\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.515420 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.515401    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-workload-socket\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.515490 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.515438    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2800f88-b692-414e-8928-35d7f7ab1d33-istiod-ca-cert\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.516870 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.516851    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-envoy\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.517017 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.516999    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-podinfo\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.522606 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.522586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-token\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.522892 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.522874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54s8d\" (UniqueName: \"kubernetes.io/projected/d2800f88-b692-414e-8928-35d7f7ab1d33-kube-api-access-54s8d\") pod \"e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") " pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.653662 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.653572    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:07.930158 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.930131    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"]
Sep 08 15:14:07.932142 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:14:07.932115    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2800f88_b692_414e_8928_35d7f7ab1d33.slice/crio-0f200a2b9f3c5365a5a120ce53b61f2876c4519e6ec9f5b758c95e03c4263bc9 WatchSource:0}: Error finding container 0f200a2b9f3c5365a5a120ce53b61f2876c4519e6ec9f5b758c95e03c4263bc9: Status 404 returned error can't find the container with id 0f200a2b9f3c5365a5a120ce53b61f2876c4519e6ec9f5b758c95e03c4263bc9
Sep 08 15:14:07.934720 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.934683    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:14:07.934831 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.934773    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:14:07.934831 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:07.934819    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:14:08.835797 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:08.835757    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh" event={"ID":"d2800f88-b692-414e-8928-35d7f7ab1d33","Type":"ContainerStarted","Data":"f984fe1f0aec8ca4a5df1af2bfc9a5b8de00141b87498a5e0eb8918d5ed2cba2"}
Sep 08 15:14:08.836211 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:08.835824    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh" event={"ID":"d2800f88-b692-414e-8928-35d7f7ab1d33","Type":"ContainerStarted","Data":"0f200a2b9f3c5365a5a120ce53b61f2876c4519e6ec9f5b758c95e03c4263bc9"}
Sep 08 15:14:08.863665 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:08.863611    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh" podStartSLOduration=1.8635944420000001 podStartE2EDuration="1.863594442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:08.861930256 +0000 UTC m=+1128.194169802" watchObservedRunningTime="2026-09-08 15:14:08.863594442 +0000 UTC m=+1128.195833988"
Sep 08 15:14:09.654323 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:09.654284    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:09.659626 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:09.659599    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:09.846866 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:09.843969    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:09.847881 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:09.847856    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:13.806721 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:13.806689    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"
Sep 08 15:14:13.807291 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:13.806866    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"
Sep 08 15:14:17.416656 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:17.416617    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:14:25.389459 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.389417    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"]
Sep 08 15:14:25.396661 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.396635    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.399467 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.399434    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"]
Sep 08 15:14:25.400526 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.400489    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-65dd51-openshift-default-dockercfg-r5ctt\""
Sep 08 15:14:25.507691 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.507567    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-token\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.507894 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.507694    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-podinfo\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.507894 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.507764    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4l4d\" (UniqueName: \"kubernetes.io/projected/28dc2469-4158-48a8-9c6a-6facec33c40c-kube-api-access-n4l4d\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.507894 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.507795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-workload-socket\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.508082 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.507885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28dc2469-4158-48a8-9c6a-6facec33c40c-istiod-ca-cert\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.508082 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.507934    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-workload-certs\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.508082 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.508017    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-envoy\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.508082 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.508073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-data\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.508298 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.508104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-credential-socket\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.609120 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.609073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-credential-socket\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.609325 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.609176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-token\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.609325 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.609220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-podinfo\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.609325 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.609258    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4l4d\" (UniqueName: \"kubernetes.io/projected/28dc2469-4158-48a8-9c6a-6facec33c40c-kube-api-access-n4l4d\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.609501 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.609444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-workload-socket\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.609501 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.609484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28dc2469-4158-48a8-9c6a-6facec33c40c-istiod-ca-cert\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.609637 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.609539    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-credential-socket\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.609637 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.609543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-workload-certs\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.609747 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.609633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-envoy\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.609747 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.609699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-data\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.609859 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.609836    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-workload-certs\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.609911 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.609864    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-workload-socket\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.610112 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.610068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-data\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.610236 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.610223    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28dc2469-4158-48a8-9c6a-6facec33c40c-istiod-ca-cert\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.611854 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.611832    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-podinfo\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.612025 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.612004    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-envoy\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.617087 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.617057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-token\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.617277 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.617259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4l4d\" (UniqueName: \"kubernetes.io/projected/28dc2469-4158-48a8-9c6a-6facec33c40c-kube-api-access-n4l4d\") pod \"e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") " pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.715052 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.715019    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:25.884729 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.884684    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 15:14:25.884929 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:25.884759    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh" podUID="d2800f88-b692-414e-8928-35d7f7ab1d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 15:14:26.003553 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:26.003521    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"]
Sep 08 15:14:26.005246 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:14:26.005219    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28dc2469_4158_48a8_9c6a_6facec33c40c.slice/crio-1b3e3e5523fe9c60351e61a3063d844073745c079a5b324b9a8749db4a286ea0 WatchSource:0}: Error finding container 1b3e3e5523fe9c60351e61a3063d844073745c079a5b324b9a8749db4a286ea0: Status 404 returned error can't find the container with id 1b3e3e5523fe9c60351e61a3063d844073745c079a5b324b9a8749db4a286ea0
Sep 08 15:14:26.007812 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:26.007772    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:14:26.007909 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:26.007889    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:14:26.007983 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:26.007966    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:14:26.941895 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:26.941849    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw" event={"ID":"28dc2469-4158-48a8-9c6a-6facec33c40c","Type":"ContainerStarted","Data":"377d63c3bd80d1508d5b971fd4a37fdd1f3d59080dec53ee3a90f74de1a3decc"}
Sep 08 15:14:26.942272 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:26.941915    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw" event={"ID":"28dc2469-4158-48a8-9c6a-6facec33c40c","Type":"ContainerStarted","Data":"1b3e3e5523fe9c60351e61a3063d844073745c079a5b324b9a8749db4a286ea0"}
Sep 08 15:14:26.964502 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:26.964438    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw" podStartSLOduration=1.964417455 podStartE2EDuration="1.964417455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:26.962837515 +0000 UTC m=+1146.295077088" watchObservedRunningTime="2026-09-08 15:14:26.964417455 +0000 UTC m=+1146.296657004"
Sep 08 15:14:27.715202 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:27.715161    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:27.720174 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:27.720144    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:27.948956 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:27.948845    2580 generic.go:356] "Generic (PLEG): container finished" podID="d2800f88-b692-414e-8928-35d7f7ab1d33" containerID="f984fe1f0aec8ca4a5df1af2bfc9a5b8de00141b87498a5e0eb8918d5ed2cba2" exitCode=0
Sep 08 15:14:27.948956 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:27.948927    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh" event={"ID":"d2800f88-b692-414e-8928-35d7f7ab1d33","Type":"ContainerDied","Data":"f984fe1f0aec8ca4a5df1af2bfc9a5b8de00141b87498a5e0eb8918d5ed2cba2"}
Sep 08 15:14:27.949367 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:27.949225    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:27.949463 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:27.949444    2580 scope.go:117] "RemoveContainer" containerID="f984fe1f0aec8ca4a5df1af2bfc9a5b8de00141b87498a5e0eb8918d5ed2cba2"
Sep 08 15:14:27.950423 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:27.950404    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:27.950598 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:27.950570    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:14:27.950653 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:27.950637    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:14:27.950689 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:27.950669    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:14:28.959688 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:28.959649    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh" event={"ID":"d2800f88-b692-414e-8928-35d7f7ab1d33","Type":"ContainerStarted","Data":"147d624279b836ba6440716218e01976ea01dfe31b91b9caae6ff87a7bb18325"}
Sep 08 15:14:29.654380 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:29.654346    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:29.654609 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:29.654583    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 08 15:14:29.654667 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:29.654641    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh" podUID="d2800f88-b692-414e-8928-35d7f7ab1d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 08 15:14:30.654442 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:30.654398    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 08 15:14:30.654907 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:30.654471    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh" podUID="d2800f88-b692-414e-8928-35d7f7ab1d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 08 15:14:31.654896 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:31.654851    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 08 15:14:31.655300 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:31.654940    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh" podUID="d2800f88-b692-414e-8928-35d7f7ab1d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 08 15:14:32.654243 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:32.654192    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 08 15:14:32.654440 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:32.654272    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh" podUID="d2800f88-b692-414e-8928-35d7f7ab1d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 08 15:14:33.654600 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:33.654554    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 08 15:14:33.655092 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:33.654620    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh" podUID="d2800f88-b692-414e-8928-35d7f7ab1d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 08 15:14:34.658233 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:34.658199    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:34.658704 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:34.658608    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:34.659380 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:34.659362    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:14:34.709300 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:34.709266    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:14:43.990766 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:43.990669    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 15:14:43.990766 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:43.990739    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw" podUID="28dc2469-4158-48a8-9c6a-6facec33c40c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 15:14:44.300374 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:44.300286    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:14:45.061813 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:45.061771    2580 generic.go:356] "Generic (PLEG): container finished" podID="28dc2469-4158-48a8-9c6a-6facec33c40c" containerID="377d63c3bd80d1508d5b971fd4a37fdd1f3d59080dec53ee3a90f74de1a3decc" exitCode=0
Sep 08 15:14:45.062242 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:45.061845    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw" event={"ID":"28dc2469-4158-48a8-9c6a-6facec33c40c","Type":"ContainerDied","Data":"377d63c3bd80d1508d5b971fd4a37fdd1f3d59080dec53ee3a90f74de1a3decc"}
Sep 08 15:14:45.062289 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:45.062252    2580 scope.go:117] "RemoveContainer" containerID="377d63c3bd80d1508d5b971fd4a37fdd1f3d59080dec53ee3a90f74de1a3decc"
Sep 08 15:14:45.063295 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:45.063264    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:14:45.063402 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:45.063345    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:14:45.063485 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:45.063390    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:14:46.069448 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:46.069411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw" event={"ID":"28dc2469-4158-48a8-9c6a-6facec33c40c","Type":"ContainerStarted","Data":"a6b1dc97733ec68f58206051bdaaa242e8f920fdc34080a2e6701f557983e5a9"}
Sep 08 15:14:46.715554 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:46.715486    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:46.715742 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:46.715705    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 08 15:14:46.715791 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:46.715767    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw" podUID="28dc2469-4158-48a8-9c6a-6facec33c40c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 08 15:14:47.716105 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:47.716063    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 08 15:14:47.716482 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:47.716120    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw" podUID="28dc2469-4158-48a8-9c6a-6facec33c40c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 08 15:14:48.715918 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:48.715884    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 08 15:14:48.716087 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:48.715941    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw" podUID="28dc2469-4158-48a8-9c6a-6facec33c40c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 08 15:14:49.716257 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:49.716218    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 08 15:14:49.716718 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:49.716281    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw" podUID="28dc2469-4158-48a8-9c6a-6facec33c40c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 08 15:14:50.715670 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:50.715631    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 08 15:14:50.715847 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:50.715691    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw" podUID="28dc2469-4158-48a8-9c6a-6facec33c40c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 08 15:14:51.719914 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:51.719872    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:51.720388 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:51.720257    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:51.720936 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:51.720915    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:14:54.663778 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:54.663741    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7740-140293559600592"]
Sep 08 15:14:54.667379 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:54.667353    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-140293559600592"
Sep 08 15:14:54.669468 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:54.669448    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sd75n\""
Sep 08 15:14:54.676185 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:54.676161    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7740-140293559600592"]
Sep 08 15:14:54.726047 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:54.726012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng695\" (UniqueName: \"kubernetes.io/projected/0c774ab2-459c-4be7-8b9b-10748f413748-kube-api-access-ng695\") pod \"test-curl-7740-140293559600592\" (UID: \"0c774ab2-459c-4be7-8b9b-10748f413748\") " pod="opendatahub/test-curl-7740-140293559600592"
Sep 08 15:14:54.827160 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:54.827116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng695\" (UniqueName: \"kubernetes.io/projected/0c774ab2-459c-4be7-8b9b-10748f413748-kube-api-access-ng695\") pod \"test-curl-7740-140293559600592\" (UID: \"0c774ab2-459c-4be7-8b9b-10748f413748\") " pod="opendatahub/test-curl-7740-140293559600592"
Sep 08 15:14:54.837504 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:54.837474    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng695\" (UniqueName: \"kubernetes.io/projected/0c774ab2-459c-4be7-8b9b-10748f413748-kube-api-access-ng695\") pod \"test-curl-7740-140293559600592\" (UID: \"0c774ab2-459c-4be7-8b9b-10748f413748\") " pod="opendatahub/test-curl-7740-140293559600592"
Sep 08 15:14:54.978445 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:54.978409    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-140293559600592"
Sep 08 15:14:55.254471 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:55.254389    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7740-140293559600592"]
Sep 08 15:14:55.256941 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:14:55.256915    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c774ab2_459c_4be7_8b9b_10748f413748.slice/crio-237112580d75b93a0b386ea2065f1bf5e1b4d70d62a9ae7ef8fc8b9652790f5d WatchSource:0}: Error finding container 237112580d75b93a0b386ea2065f1bf5e1b4d70d62a9ae7ef8fc8b9652790f5d: Status 404 returned error can't find the container with id 237112580d75b93a0b386ea2065f1bf5e1b4d70d62a9ae7ef8fc8b9652790f5d
Sep 08 15:14:55.258262 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:55.258238    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:14:56.134705 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:56.134668    2580 generic.go:356] "Generic (PLEG): container finished" podID="0c774ab2-459c-4be7-8b9b-10748f413748" containerID="8b6f214e129ff588db26ec930f69516f349499c33220e312993c6e0fab10ed5e" exitCode=0
Sep 08 15:14:56.135069 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:56.134739    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7740-140293559600592" event={"ID":"0c774ab2-459c-4be7-8b9b-10748f413748","Type":"ContainerDied","Data":"8b6f214e129ff588db26ec930f69516f349499c33220e312993c6e0fab10ed5e"}
Sep 08 15:14:56.135069 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:56.134785    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7740-140293559600592" event={"ID":"0c774ab2-459c-4be7-8b9b-10748f413748","Type":"ContainerStarted","Data":"237112580d75b93a0b386ea2065f1bf5e1b4d70d62a9ae7ef8fc8b9652790f5d"}
Sep 08 15:14:57.276486 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.276465    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-140293559600592"
Sep 08 15:14:57.311006 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.310980    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7740-140293559600592_0c774ab2-459c-4be7-8b9b-10748f413748/test-curl-7740-140293559600592/0.log"
Sep 08 15:14:57.336236 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.336207    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7740-140293559600592"]
Sep 08 15:14:57.340560 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.340539    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7740-140293559600592"]
Sep 08 15:14:57.354586 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.354560    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng695\" (UniqueName: \"kubernetes.io/projected/0c774ab2-459c-4be7-8b9b-10748f413748-kube-api-access-ng695\") pod \"0c774ab2-459c-4be7-8b9b-10748f413748\" (UID: \"0c774ab2-459c-4be7-8b9b-10748f413748\") "
Sep 08 15:14:57.356558 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.356536    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c774ab2-459c-4be7-8b9b-10748f413748-kube-api-access-ng695" (OuterVolumeSpecName: "kube-api-access-ng695") pod "0c774ab2-459c-4be7-8b9b-10748f413748" (UID: "0c774ab2-459c-4be7-8b9b-10748f413748"). InnerVolumeSpecName "kube-api-access-ng695". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:14:57.456255 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.456171    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng695\" (UniqueName: \"kubernetes.io/projected/0c774ab2-459c-4be7-8b9b-10748f413748-kube-api-access-ng695\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:14:57.460459 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.460434    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7740-140293559600592"]
Sep 08 15:14:57.460863 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.460849    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c774ab2-459c-4be7-8b9b-10748f413748" containerName="test-curl-7740-140293559600592"
Sep 08 15:14:57.460914 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.460864    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c774ab2-459c-4be7-8b9b-10748f413748" containerName="test-curl-7740-140293559600592"
Sep 08 15:14:57.460952 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.460944    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c774ab2-459c-4be7-8b9b-10748f413748" containerName="test-curl-7740-140293559600592"
Sep 08 15:14:57.463907 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.463891    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-140293559600592"
Sep 08 15:14:57.470099 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.470075    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7740-140293559600592"]
Sep 08 15:14:57.557403 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.557370    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fdzh\" (UniqueName: \"kubernetes.io/projected/4804f8d2-c5aa-4873-82ff-39b9c61c8ca4-kube-api-access-7fdzh\") pod \"test-curl-7740-140293559600592\" (UID: \"4804f8d2-c5aa-4873-82ff-39b9c61c8ca4\") " pod="opendatahub/test-curl-7740-140293559600592"
Sep 08 15:14:57.658531 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.658464    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fdzh\" (UniqueName: \"kubernetes.io/projected/4804f8d2-c5aa-4873-82ff-39b9c61c8ca4-kube-api-access-7fdzh\") pod \"test-curl-7740-140293559600592\" (UID: \"4804f8d2-c5aa-4873-82ff-39b9c61c8ca4\") " pod="opendatahub/test-curl-7740-140293559600592"
Sep 08 15:14:57.666620 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.666590    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fdzh\" (UniqueName: \"kubernetes.io/projected/4804f8d2-c5aa-4873-82ff-39b9c61c8ca4-kube-api-access-7fdzh\") pod \"test-curl-7740-140293559600592\" (UID: \"4804f8d2-c5aa-4873-82ff-39b9c61c8ca4\") " pod="opendatahub/test-curl-7740-140293559600592"
Sep 08 15:14:57.774675 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:57.774646    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-140293559600592"
Sep 08 15:14:58.047476 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:58.047449    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7740-140293559600592"]
Sep 08 15:14:58.049640 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:14:58.049616    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4804f8d2_c5aa_4873_82ff_39b9c61c8ca4.slice/crio-b4f1a216e16ac2f099ac85f4dd1b66fd1e6af03ddbac26acc386b9d75a140766 WatchSource:0}: Error finding container b4f1a216e16ac2f099ac85f4dd1b66fd1e6af03ddbac26acc386b9d75a140766: Status 404 returned error can't find the container with id b4f1a216e16ac2f099ac85f4dd1b66fd1e6af03ddbac26acc386b9d75a140766
Sep 08 15:14:58.147070 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:58.147039    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="237112580d75b93a0b386ea2065f1bf5e1b4d70d62a9ae7ef8fc8b9652790f5d"
Sep 08 15:14:58.147070 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:58.147039    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-140293559600592"
Sep 08 15:14:58.148266 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:58.148237    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7740-140293559600592" event={"ID":"4804f8d2-c5aa-4873-82ff-39b9c61c8ca4","Type":"ContainerStarted","Data":"b4f1a216e16ac2f099ac85f4dd1b66fd1e6af03ddbac26acc386b9d75a140766"}
Sep 08 15:14:58.159721 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:58.159691    2580 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7740-140293559600592" oldPodUID="0c774ab2-459c-4be7-8b9b-10748f413748" podUID="4804f8d2-c5aa-4873-82ff-39b9c61c8ca4"
Sep 08 15:14:59.157372 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:14:59.157340    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c774ab2-459c-4be7-8b9b-10748f413748" path="/var/lib/kubelet/pods/0c774ab2-459c-4be7-8b9b-10748f413748/volumes"
Sep 08 15:15:00.139711 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.139676    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-65dd51-29814675-vshtw"]
Sep 08 15:15:00.143444 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.143392    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-65dd51-29814675-vshtw"
Sep 08 15:15:00.144318 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.144289    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6e5ca-29814675-4gkft"]
Sep 08 15:15:00.146050 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.146031    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:15:00.147764 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.147746    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7be222-29814675-pktxd"]
Sep 08 15:15:00.147862 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.147846    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6e5ca-29814675-4gkft"
Sep 08 15:15:00.151328 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.151306    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7be222-29814675-pktxd"
Sep 08 15:15:00.152344 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.152323    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-65dd51-29814675-vshtw"]
Sep 08 15:15:00.156610 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.156588    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7be222-29814675-pktxd"]
Sep 08 15:15:00.159814 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.159790    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6e5ca-29814675-4gkft"]
Sep 08 15:15:00.166146 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.166118    2580 generic.go:356] "Generic (PLEG): container finished" podID="4804f8d2-c5aa-4873-82ff-39b9c61c8ca4" containerID="11dbf8a32de20c6ad4f82d44ef0ffcc270135b838cd095398a3fb5c852bbb22e" exitCode=0
Sep 08 15:15:00.166282 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.166204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7740-140293559600592" event={"ID":"4804f8d2-c5aa-4873-82ff-39b9c61c8ca4","Type":"ContainerDied","Data":"11dbf8a32de20c6ad4f82d44ef0ffcc270135b838cd095398a3fb5c852bbb22e"}
Sep 08 15:15:00.171932 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.171914    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-65dd51-29814675-vshtw"
Sep 08 15:15:00.180931 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.180911    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6e5ca-29814675-4gkft"
Sep 08 15:15:00.219264 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.219079    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7be222-29814675-pktxd"
Sep 08 15:15:00.312214 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.312173    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:15:00.458535 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.458417    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-65dd51-29814675-vshtw"]
Sep 08 15:15:00.461168 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:15:00.461139    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010f54c4_683d_4121_a7e5_f4d2db5c02f4.slice/crio-c698631316b9a2586d4f0e31a006982602b021f60a53b15c23ebc0d3f9ec5776 WatchSource:0}: Error finding container c698631316b9a2586d4f0e31a006982602b021f60a53b15c23ebc0d3f9ec5776: Status 404 returned error can't find the container with id c698631316b9a2586d4f0e31a006982602b021f60a53b15c23ebc0d3f9ec5776
Sep 08 15:15:00.473595 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.473572    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6e5ca-29814675-4gkft"]
Sep 08 15:15:00.475571 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:15:00.475547    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b57e0eb_18b3_495e_9404_a4e76901c751.slice/crio-1c533e7b601926a17e56198d3130940650f88ae110d5f87a803698509ef7a408 WatchSource:0}: Error finding container 1c533e7b601926a17e56198d3130940650f88ae110d5f87a803698509ef7a408: Status 404 returned error can't find the container with id 1c533e7b601926a17e56198d3130940650f88ae110d5f87a803698509ef7a408
Sep 08 15:15:00.503672 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:00.503648    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7be222-29814675-pktxd"]
Sep 08 15:15:00.506580 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:15:00.506552    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a01b065_153f_4ce6_8665_2f5c8f12021d.slice/crio-61b1ca642a105f1bc38fa7dab951bc6832175d74322c6f0d6e2dde58736d124e WatchSource:0}: Error finding container 61b1ca642a105f1bc38fa7dab951bc6832175d74322c6f0d6e2dde58736d124e: Status 404 returned error can't find the container with id 61b1ca642a105f1bc38fa7dab951bc6832175d74322c6f0d6e2dde58736d124e
Sep 08 15:15:01.173894 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.173808    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-65dd51-29814675-vshtw" event={"ID":"010f54c4-683d-4121-a7e5-f4d2db5c02f4","Type":"ContainerStarted","Data":"a86d841e0260cc4673d93cef868e92a5c37644840f95b3c23e5510181446aacf"}
Sep 08 15:15:01.173894 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.173861    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-65dd51-29814675-vshtw" event={"ID":"010f54c4-683d-4121-a7e5-f4d2db5c02f4","Type":"ContainerStarted","Data":"c698631316b9a2586d4f0e31a006982602b021f60a53b15c23ebc0d3f9ec5776"}
Sep 08 15:15:01.175485 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.175455    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6e5ca-29814675-4gkft" event={"ID":"5b57e0eb-18b3-495e-9404-a4e76901c751","Type":"ContainerStarted","Data":"1229927cc9de89b2cc2860528d8063ffd420c7d9d651e7ecddc840007a6d7ef3"}
Sep 08 15:15:01.175616 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.175497    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6e5ca-29814675-4gkft" event={"ID":"5b57e0eb-18b3-495e-9404-a4e76901c751","Type":"ContainerStarted","Data":"1c533e7b601926a17e56198d3130940650f88ae110d5f87a803698509ef7a408"}
Sep 08 15:15:01.176899 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.176865    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7be222-29814675-pktxd" event={"ID":"0a01b065-153f-4ce6-8665-2f5c8f12021d","Type":"ContainerStarted","Data":"cc90c9946f89225da76e7f48c5972940cf2971bb6a5f0f56d379150d9d246237"}
Sep 08 15:15:01.176998 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.176916    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7be222-29814675-pktxd" event={"ID":"0a01b065-153f-4ce6-8665-2f5c8f12021d","Type":"ContainerStarted","Data":"61b1ca642a105f1bc38fa7dab951bc6832175d74322c6f0d6e2dde58736d124e"}
Sep 08 15:15:01.191398 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.191347    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-65dd51-29814675-vshtw" podStartSLOduration=1.191331564 podStartE2EDuration="1.191331564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:15:01.188570566 +0000 UTC m=+1180.520810117" watchObservedRunningTime="2026-09-08 15:15:01.191331564 +0000 UTC m=+1180.523571109"
Sep 08 15:15:01.207630 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.207578    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6e5ca-29814675-4gkft" podStartSLOduration=1.207562828 podStartE2EDuration="1.207562828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:15:01.205274037 +0000 UTC m=+1180.537513584" watchObservedRunningTime="2026-09-08 15:15:01.207562828 +0000 UTC m=+1180.539802379"
Sep 08 15:15:01.219915 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.219596    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7be222-29814675-pktxd" podStartSLOduration=1.219574227 podStartE2EDuration="1.219574227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:15:01.219504512 +0000 UTC m=+1180.551744059" watchObservedRunningTime="2026-09-08 15:15:01.219574227 +0000 UTC m=+1180.551813777"
Sep 08 15:15:01.347090 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.347064    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-140293559600592"
Sep 08 15:15:01.368287 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.368217    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7740-140293559600592_4804f8d2-c5aa-4873-82ff-39b9c61c8ca4/test-curl-7740-140293559600592/0.log"
Sep 08 15:15:01.391326 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.391296    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7740-140293559600592"]
Sep 08 15:15:01.394960 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.394926    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7740-140293559600592"]
Sep 08 15:15:01.494647 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.494606    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fdzh\" (UniqueName: \"kubernetes.io/projected/4804f8d2-c5aa-4873-82ff-39b9c61c8ca4-kube-api-access-7fdzh\") pod \"4804f8d2-c5aa-4873-82ff-39b9c61c8ca4\" (UID: \"4804f8d2-c5aa-4873-82ff-39b9c61c8ca4\") "
Sep 08 15:15:01.496744 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.496713    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4804f8d2-c5aa-4873-82ff-39b9c61c8ca4-kube-api-access-7fdzh" (OuterVolumeSpecName: "kube-api-access-7fdzh") pod "4804f8d2-c5aa-4873-82ff-39b9c61c8ca4" (UID: "4804f8d2-c5aa-4873-82ff-39b9c61c8ca4"). InnerVolumeSpecName "kube-api-access-7fdzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:15:01.515894 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.515860    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7740-140293559601168"]
Sep 08 15:15:01.516318 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.516302    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4804f8d2-c5aa-4873-82ff-39b9c61c8ca4" containerName="test-curl-7740-140293559600592"
Sep 08 15:15:01.516365 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.516320    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4804f8d2-c5aa-4873-82ff-39b9c61c8ca4" containerName="test-curl-7740-140293559600592"
Sep 08 15:15:01.516400 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.516388    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4804f8d2-c5aa-4873-82ff-39b9c61c8ca4" containerName="test-curl-7740-140293559600592"
Sep 08 15:15:01.519416 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.519398    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:01.525886 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.525854    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7740-140293559601168"]
Sep 08 15:15:01.596378 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.596334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcfn4\" (UniqueName: \"kubernetes.io/projected/137620d1-2041-4dc7-82ff-1a10f913ec56-kube-api-access-vcfn4\") pod \"test-curl-7740-140293559601168\" (UID: \"137620d1-2041-4dc7-82ff-1a10f913ec56\") " pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:01.596616 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.596501    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fdzh\" (UniqueName: \"kubernetes.io/projected/4804f8d2-c5aa-4873-82ff-39b9c61c8ca4-kube-api-access-7fdzh\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:15:01.698001 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.697897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcfn4\" (UniqueName: \"kubernetes.io/projected/137620d1-2041-4dc7-82ff-1a10f913ec56-kube-api-access-vcfn4\") pod \"test-curl-7740-140293559601168\" (UID: \"137620d1-2041-4dc7-82ff-1a10f913ec56\") " pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:01.705809 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.705776    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcfn4\" (UniqueName: \"kubernetes.io/projected/137620d1-2041-4dc7-82ff-1a10f913ec56-kube-api-access-vcfn4\") pod \"test-curl-7740-140293559601168\" (UID: \"137620d1-2041-4dc7-82ff-1a10f913ec56\") " pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:01.873851 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:01.873798    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:02.150535 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:02.150495    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7740-140293559601168"]
Sep 08 15:15:02.153164 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:15:02.153129    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod137620d1_2041_4dc7_82ff_1a10f913ec56.slice/crio-9fb6d557f6aa03500e4f4ef734535703488ddbe8678611c8356a879f9a7cd784 WatchSource:0}: Error finding container 9fb6d557f6aa03500e4f4ef734535703488ddbe8678611c8356a879f9a7cd784: Status 404 returned error can't find the container with id 9fb6d557f6aa03500e4f4ef734535703488ddbe8678611c8356a879f9a7cd784
Sep 08 15:15:02.185970 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:02.185937    2580 generic.go:356] "Generic (PLEG): container finished" podID="0a01b065-153f-4ce6-8665-2f5c8f12021d" containerID="cc90c9946f89225da76e7f48c5972940cf2971bb6a5f0f56d379150d9d246237" exitCode=0
Sep 08 15:15:02.186394 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:02.186019    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7be222-29814675-pktxd" event={"ID":"0a01b065-153f-4ce6-8665-2f5c8f12021d","Type":"ContainerDied","Data":"cc90c9946f89225da76e7f48c5972940cf2971bb6a5f0f56d379150d9d246237"}
Sep 08 15:15:02.187406 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:02.187379    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7740-140293559601168" event={"ID":"137620d1-2041-4dc7-82ff-1a10f913ec56","Type":"ContainerStarted","Data":"9fb6d557f6aa03500e4f4ef734535703488ddbe8678611c8356a879f9a7cd784"}
Sep 08 15:15:02.188847 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:02.188826    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4f1a216e16ac2f099ac85f4dd1b66fd1e6af03ddbac26acc386b9d75a140766"
Sep 08 15:15:02.188847 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:02.188841    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-140293559600592"
Sep 08 15:15:02.190581 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:02.190559    2580 generic.go:356] "Generic (PLEG): container finished" podID="010f54c4-683d-4121-a7e5-f4d2db5c02f4" containerID="a86d841e0260cc4673d93cef868e92a5c37644840f95b3c23e5510181446aacf" exitCode=0
Sep 08 15:15:02.190685 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:02.190642    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-65dd51-29814675-vshtw" event={"ID":"010f54c4-683d-4121-a7e5-f4d2db5c02f4","Type":"ContainerDied","Data":"a86d841e0260cc4673d93cef868e92a5c37644840f95b3c23e5510181446aacf"}
Sep 08 15:15:02.192175 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:02.192155    2580 generic.go:356] "Generic (PLEG): container finished" podID="5b57e0eb-18b3-495e-9404-a4e76901c751" containerID="1229927cc9de89b2cc2860528d8063ffd420c7d9d651e7ecddc840007a6d7ef3" exitCode=0
Sep 08 15:15:02.192283 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:02.192182    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6e5ca-29814675-4gkft" event={"ID":"5b57e0eb-18b3-495e-9404-a4e76901c751","Type":"ContainerDied","Data":"1229927cc9de89b2cc2860528d8063ffd420c7d9d651e7ecddc840007a6d7ef3"}
Sep 08 15:15:02.203026 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:15:02.202982    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7740-140293559600592\" is forbidden: User \"system:node:ip-10-0-134-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-147.ec2.internal' and this object" podUID="4804f8d2-c5aa-4873-82ff-39b9c61c8ca4" pod="opendatahub/test-curl-7740-140293559600592"
Sep 08 15:15:03.159753 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:03.159668    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4804f8d2-c5aa-4873-82ff-39b9c61c8ca4" path="/var/lib/kubelet/pods/4804f8d2-c5aa-4873-82ff-39b9c61c8ca4/volumes"
Sep 08 15:15:03.200020 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:03.199991    2580 generic.go:356] "Generic (PLEG): container finished" podID="137620d1-2041-4dc7-82ff-1a10f913ec56" containerID="c263d84ffcc2b1e9d3b2dce155a55b7eb22da00849fad128bc0a7bf3d44cf935" exitCode=0
Sep 08 15:15:03.200457 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:03.200065    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7740-140293559601168" event={"ID":"137620d1-2041-4dc7-82ff-1a10f913ec56","Type":"ContainerDied","Data":"c263d84ffcc2b1e9d3b2dce155a55b7eb22da00849fad128bc0a7bf3d44cf935"}
Sep 08 15:15:03.339551 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:03.339501    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7be222-29814675-pktxd"
Sep 08 15:15:03.387316 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:03.387286    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-65dd51-29814675-vshtw"
Sep 08 15:15:03.407201 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:03.407148    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6e5ca-29814675-4gkft"
Sep 08 15:15:04.207208 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.207176    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6e5ca-29814675-4gkft"
Sep 08 15:15:04.207208 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.207183    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6e5ca-29814675-4gkft" event={"ID":"5b57e0eb-18b3-495e-9404-a4e76901c751","Type":"ContainerDied","Data":"1c533e7b601926a17e56198d3130940650f88ae110d5f87a803698509ef7a408"}
Sep 08 15:15:04.207691 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.207233    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c533e7b601926a17e56198d3130940650f88ae110d5f87a803698509ef7a408"
Sep 08 15:15:04.208585 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.208565    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7be222-29814675-pktxd"
Sep 08 15:15:04.208706 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.208577    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7be222-29814675-pktxd" event={"ID":"0a01b065-153f-4ce6-8665-2f5c8f12021d","Type":"ContainerDied","Data":"61b1ca642a105f1bc38fa7dab951bc6832175d74322c6f0d6e2dde58736d124e"}
Sep 08 15:15:04.208706 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.208622    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61b1ca642a105f1bc38fa7dab951bc6832175d74322c6f0d6e2dde58736d124e"
Sep 08 15:15:04.210201 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.210179    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-65dd51-29814675-vshtw" event={"ID":"010f54c4-683d-4121-a7e5-f4d2db5c02f4","Type":"ContainerDied","Data":"c698631316b9a2586d4f0e31a006982602b021f60a53b15c23ebc0d3f9ec5776"}
Sep 08 15:15:04.210290 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.210202    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-65dd51-29814675-vshtw"
Sep 08 15:15:04.210290 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.210221    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c698631316b9a2586d4f0e31a006982602b021f60a53b15c23ebc0d3f9ec5776"
Sep 08 15:15:04.351190 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.351163    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:04.373552 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.373523    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7740-140293559601168_137620d1-2041-4dc7-82ff-1a10f913ec56/test-curl-7740-140293559601168/0.log"
Sep 08 15:15:04.399931 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.399905    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7740-140293559601168"]
Sep 08 15:15:04.403232 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.403207    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7740-140293559601168"]
Sep 08 15:15:04.428166 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.428139    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcfn4\" (UniqueName: \"kubernetes.io/projected/137620d1-2041-4dc7-82ff-1a10f913ec56-kube-api-access-vcfn4\") pod \"137620d1-2041-4dc7-82ff-1a10f913ec56\" (UID: \"137620d1-2041-4dc7-82ff-1a10f913ec56\") "
Sep 08 15:15:04.430323 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.430292    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/137620d1-2041-4dc7-82ff-1a10f913ec56-kube-api-access-vcfn4" (OuterVolumeSpecName: "kube-api-access-vcfn4") pod "137620d1-2041-4dc7-82ff-1a10f913ec56" (UID: "137620d1-2041-4dc7-82ff-1a10f913ec56"). InnerVolumeSpecName "kube-api-access-vcfn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:15:04.520833 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.520795    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7740-140293559601168"]
Sep 08 15:15:04.521302 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.521281    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010f54c4-683d-4121-a7e5-f4d2db5c02f4" containerName="cleanup"
Sep 08 15:15:04.521386 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.521304    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="010f54c4-683d-4121-a7e5-f4d2db5c02f4" containerName="cleanup"
Sep 08 15:15:04.521386 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.521317    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a01b065-153f-4ce6-8665-2f5c8f12021d" containerName="cleanup"
Sep 08 15:15:04.521386 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.521325    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a01b065-153f-4ce6-8665-2f5c8f12021d" containerName="cleanup"
Sep 08 15:15:04.521386 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.521342    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b57e0eb-18b3-495e-9404-a4e76901c751" containerName="cleanup"
Sep 08 15:15:04.521386 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.521350    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b57e0eb-18b3-495e-9404-a4e76901c751" containerName="cleanup"
Sep 08 15:15:04.521386 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.521372    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="137620d1-2041-4dc7-82ff-1a10f913ec56" containerName="test-curl-7740-140293559601168"
Sep 08 15:15:04.521386 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.521382    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="137620d1-2041-4dc7-82ff-1a10f913ec56" containerName="test-curl-7740-140293559601168"
Sep 08 15:15:04.521767 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.521492    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="010f54c4-683d-4121-a7e5-f4d2db5c02f4" containerName="cleanup"
Sep 08 15:15:04.521767 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.521521    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="137620d1-2041-4dc7-82ff-1a10f913ec56" containerName="test-curl-7740-140293559601168"
Sep 08 15:15:04.521767 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.521532    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a01b065-153f-4ce6-8665-2f5c8f12021d" containerName="cleanup"
Sep 08 15:15:04.521767 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.521542    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b57e0eb-18b3-495e-9404-a4e76901c751" containerName="cleanup"
Sep 08 15:15:04.524723 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.524705    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:04.529106 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.529072    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcfn4\" (UniqueName: \"kubernetes.io/projected/137620d1-2041-4dc7-82ff-1a10f913ec56-kube-api-access-vcfn4\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:15:04.530505 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.530481    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7740-140293559601168"]
Sep 08 15:15:04.630543 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.630471    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmqc7\" (UniqueName: \"kubernetes.io/projected/7d030ad7-753e-4c4a-ab29-449881c2ade3-kube-api-access-wmqc7\") pod \"test-curl-7740-140293559601168\" (UID: \"7d030ad7-753e-4c4a-ab29-449881c2ade3\") " pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:04.731704 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.731666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmqc7\" (UniqueName: \"kubernetes.io/projected/7d030ad7-753e-4c4a-ab29-449881c2ade3-kube-api-access-wmqc7\") pod \"test-curl-7740-140293559601168\" (UID: \"7d030ad7-753e-4c4a-ab29-449881c2ade3\") " pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:04.740669 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.740643    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmqc7\" (UniqueName: \"kubernetes.io/projected/7d030ad7-753e-4c4a-ab29-449881c2ade3-kube-api-access-wmqc7\") pod \"test-curl-7740-140293559601168\" (UID: \"7d030ad7-753e-4c4a-ab29-449881c2ade3\") " pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:04.835010 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:04.834921    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:05.107436 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:05.107362    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7740-140293559601168"]
Sep 08 15:15:05.109808 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:15:05.109770    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d030ad7_753e_4c4a_ab29_449881c2ade3.slice/crio-b6de6c49d7dab1222f8e0258229e4f3975c80b267957c6795f16bb6ce99f065b WatchSource:0}: Error finding container b6de6c49d7dab1222f8e0258229e4f3975c80b267957c6795f16bb6ce99f065b: Status 404 returned error can't find the container with id b6de6c49d7dab1222f8e0258229e4f3975c80b267957c6795f16bb6ce99f065b
Sep 08 15:15:05.157662 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:05.157618    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="137620d1-2041-4dc7-82ff-1a10f913ec56" path="/var/lib/kubelet/pods/137620d1-2041-4dc7-82ff-1a10f913ec56/volumes"
Sep 08 15:15:05.219715 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:05.219678    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:05.219715 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:05.219701    2580 scope.go:117] "RemoveContainer" containerID="c263d84ffcc2b1e9d3b2dce155a55b7eb22da00849fad128bc0a7bf3d44cf935"
Sep 08 15:15:05.221176 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:05.221148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7740-140293559601168" event={"ID":"7d030ad7-753e-4c4a-ab29-449881c2ade3","Type":"ContainerStarted","Data":"b6de6c49d7dab1222f8e0258229e4f3975c80b267957c6795f16bb6ce99f065b"}
Sep 08 15:15:08.243092 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:08.243053    2580 generic.go:356] "Generic (PLEG): container finished" podID="7d030ad7-753e-4c4a-ab29-449881c2ade3" containerID="a2c2fbb3e23421446db2f3e399aa696f306cb0c7fcb79adf0fb458dbd15ccfb6" exitCode=0
Sep 08 15:15:08.243477 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:08.243136    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7740-140293559601168" event={"ID":"7d030ad7-753e-4c4a-ab29-449881c2ade3","Type":"ContainerDied","Data":"a2c2fbb3e23421446db2f3e399aa696f306cb0c7fcb79adf0fb458dbd15ccfb6"}
Sep 08 15:15:09.385261 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:09.385235    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:09.408900 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:09.408864    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7740-140293559601168_7d030ad7-753e-4c4a-ab29-449881c2ade3/test-curl-7740-140293559601168/0.log"
Sep 08 15:15:09.433833 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:09.433541    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7740-140293559601168"]
Sep 08 15:15:09.437677 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:09.437650    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7740-140293559601168"]
Sep 08 15:15:09.480304 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:09.480265    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmqc7\" (UniqueName: \"kubernetes.io/projected/7d030ad7-753e-4c4a-ab29-449881c2ade3-kube-api-access-wmqc7\") pod \"7d030ad7-753e-4c4a-ab29-449881c2ade3\" (UID: \"7d030ad7-753e-4c4a-ab29-449881c2ade3\") "
Sep 08 15:15:09.482364 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:09.482330    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d030ad7-753e-4c4a-ab29-449881c2ade3-kube-api-access-wmqc7" (OuterVolumeSpecName: "kube-api-access-wmqc7") pod "7d030ad7-753e-4c4a-ab29-449881c2ade3" (UID: "7d030ad7-753e-4c4a-ab29-449881c2ade3"). InnerVolumeSpecName "kube-api-access-wmqc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:15:09.581156 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:09.581069    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmqc7\" (UniqueName: \"kubernetes.io/projected/7d030ad7-753e-4c4a-ab29-449881c2ade3-kube-api-access-wmqc7\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:15:10.255781 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.255753    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6de6c49d7dab1222f8e0258229e4f3975c80b267957c6795f16bb6ce99f065b"
Sep 08 15:15:10.255781 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.255755    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:10.265807 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:15:10.265774    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7740-140293559601168\" is forbidden: User \"system:node:ip-10-0-134-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-147.ec2.internal' and this object" podUID="7d030ad7-753e-4c4a-ab29-449881c2ade3" pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:10.308862 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.308830    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"]
Sep 08 15:15:10.309406 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.309384    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d030ad7-753e-4c4a-ab29-449881c2ade3" containerName="test-curl-7740-140293559601168"
Sep 08 15:15:10.309406 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.309407    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d030ad7-753e-4c4a-ab29-449881c2ade3" containerName="test-curl-7740-140293559601168"
Sep 08 15:15:10.309596 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.309532    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d030ad7-753e-4c4a-ab29-449881c2ade3" containerName="test-curl-7740-140293559601168"
Sep 08 15:15:10.312815 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.312796    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.315358 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.315340    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-48dbdcd3-openshift-default-dockercfg-69vjr\""
Sep 08 15:15:10.326752 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.326721    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"]
Sep 08 15:15:10.346549 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:15:10.346482    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7740-140293559601168\" is forbidden: User \"system:node:ip-10-0-134-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-147.ec2.internal' and this object" podUID="7d030ad7-753e-4c4a-ab29-449881c2ade3" pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:10.492758 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.492717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-podinfo\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.493166 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.492777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istiod-ca-cert\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.493166 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.492799    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-credential-socket\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.493166 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.492882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-token\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.493166 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.492956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-workload-socket\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.493166 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.493027    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-envoy\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.493166 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.493061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-data\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.493166 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.493084    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-workload-certs\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.493166 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.493127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrfpk\" (UniqueName: \"kubernetes.io/projected/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-kube-api-access-rrfpk\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.593983 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.593889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-podinfo\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.593983 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.593941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istiod-ca-cert\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.594222 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.594199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-credential-socket\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.594280 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.594257    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-token\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.594337 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.594322    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-workload-socket\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.594398 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.594379    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-envoy\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.594453 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.594414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-data\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.594502 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.594450    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-workload-certs\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.594581 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.594522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrfpk\" (UniqueName: \"kubernetes.io/projected/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-kube-api-access-rrfpk\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.594644 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.594601    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-credential-socket\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.594745 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.594717    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-workload-socket\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.594804 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.594761    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istiod-ca-cert\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.594877 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.594858    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-data\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.595017 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.594988    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-workload-certs\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.596660 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.596634    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-podinfo\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.596660 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.596645    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-envoy\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.603076 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.603051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrfpk\" (UniqueName: \"kubernetes.io/projected/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-kube-api-access-rrfpk\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.603348 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.603326    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-token\") pod \"e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") " pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.625300 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.625255    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:10.904191 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.904155    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"]
Sep 08 15:15:10.905242 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:15:10.905220    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b9c370_bf10_4cb8_b2ed_5ab305b8719c.slice/crio-4bb4cccc19762bb9bcd87554fee916cead36e81395cdfe3e3a2b0f11ce1bcc6a WatchSource:0}: Error finding container 4bb4cccc19762bb9bcd87554fee916cead36e81395cdfe3e3a2b0f11ce1bcc6a: Status 404 returned error can't find the container with id 4bb4cccc19762bb9bcd87554fee916cead36e81395cdfe3e3a2b0f11ce1bcc6a
Sep 08 15:15:10.907553 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.907497    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:15:10.907667 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.907604    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:15:10.907667 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:10.907653    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:15:11.156992 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:15:11.156907    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7740-140293559601168\" is forbidden: User \"system:node:ip-10-0-134-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-147.ec2.internal' and this object" podUID="7d030ad7-753e-4c4a-ab29-449881c2ade3" pod="opendatahub/test-curl-7740-140293559601168"
Sep 08 15:15:11.158598 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:11.158571    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d030ad7-753e-4c4a-ab29-449881c2ade3" path="/var/lib/kubelet/pods/7d030ad7-753e-4c4a-ab29-449881c2ade3/volumes"
Sep 08 15:15:11.262919 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:11.262881    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht" event={"ID":"18b9c370-bf10-4cb8-b2ed-5ab305b8719c","Type":"ContainerStarted","Data":"323f89073a2e5f36e853c12b643aa446a3b0a669a58feda31a17128c68dfb657"}
Sep 08 15:15:11.263073 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:11.262940    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht" event={"ID":"18b9c370-bf10-4cb8-b2ed-5ab305b8719c","Type":"ContainerStarted","Data":"4bb4cccc19762bb9bcd87554fee916cead36e81395cdfe3e3a2b0f11ce1bcc6a"}
Sep 08 15:15:11.284033 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:11.283982    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht" podStartSLOduration=1.283967938 podStartE2EDuration="1.283967938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:15:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:15:11.281453967 +0000 UTC m=+1190.613693514" watchObservedRunningTime="2026-09-08 15:15:11.283967938 +0000 UTC m=+1190.616207484"
Sep 08 15:15:11.626142 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:11.626104    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:11.628272 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:11.628237    2580 patch_prober.go:28] interesting pod/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:15:11.628392 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:11.628300    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht" podUID="18b9c370-bf10-4cb8-b2ed-5ab305b8719c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 08 15:15:12.630035 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:12.630003    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:13.277492 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:13.277459    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:13.278558 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:13.278538    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:14.097074 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:14.097035    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:15:15.234276 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:15.234241    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"]
Sep 08 15:15:15.238369 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:15.238345    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"
Sep 08 15:15:15.242014 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:15.241988    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-48dbdcd3\""
Sep 08 15:15:15.242139 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:15.242058    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-48dbdcd3-dockercfg-7cbzt\""
Sep 08 15:15:15.253278 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:15.253250    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"]
Sep 08 15:15:15.338531 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:15.338410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r\" (UID: \"cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"
Sep 08 15:15:15.338778 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:15.338680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xzqj\" (UniqueName: \"kubernetes.io/projected/cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71-kube-api-access-4xzqj\") pod \"payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r\" (UID: \"cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"
Sep 08 15:15:15.439886 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:15.439844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r\" (UID: \"cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"
Sep 08 15:15:15.440101 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:15.439965    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xzqj\" (UniqueName: \"kubernetes.io/projected/cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71-kube-api-access-4xzqj\") pod \"payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r\" (UID: \"cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"
Sep 08 15:15:15.440622 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:15.440604    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r\" (UID: \"cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"
Sep 08 15:15:15.449753 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:15.449718    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xzqj\" (UniqueName: \"kubernetes.io/projected/cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71-kube-api-access-4xzqj\") pod \"payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r\" (UID: \"cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"
Sep 08 15:15:15.549150 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:15.549056    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"
Sep 08 15:15:15.822382 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:15.822355    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"]
Sep 08 15:15:15.824069 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:15:15.824038    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde4c7a2_3ba5_45e0_a46b_3b11b75e0a71.slice/crio-647826cf0729903cfea2903220125c1b0d17f3d8f5a72639d40c0f9e2d1bd873 WatchSource:0}: Error finding container 647826cf0729903cfea2903220125c1b0d17f3d8f5a72639d40c0f9e2d1bd873: Status 404 returned error can't find the container with id 647826cf0729903cfea2903220125c1b0d17f3d8f5a72639d40c0f9e2d1bd873
Sep 08 15:15:16.296327 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:16.296291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r" event={"ID":"cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71","Type":"ContainerStarted","Data":"b6816e20494f95e833dd6ada6cdfe4e02e640804c25d5761ce0dc329b3fd68be"}
Sep 08 15:15:16.296765 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:16.296342    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r" event={"ID":"cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71","Type":"ContainerStarted","Data":"647826cf0729903cfea2903220125c1b0d17f3d8f5a72639d40c0f9e2d1bd873"}
Sep 08 15:15:16.296765 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:16.296362    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"
Sep 08 15:15:16.311865 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:16.311815    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r" podStartSLOduration=1.311798659 podStartE2EDuration="1.311798659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:15:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:15:16.310893891 +0000 UTC m=+1195.643133437" watchObservedRunningTime="2026-09-08 15:15:16.311798659 +0000 UTC m=+1195.644038238"
Sep 08 15:15:21.146480 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:21.146448    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 15:15:21.149121 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:21.149095    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 15:15:21.208303 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:21.208271    2580 scope.go:117] "RemoveContainer" containerID="3141b3ef5832aa0d823f45409216e4499d5c4b592f4567a09608e342904f2e17"
Sep 08 15:15:21.217118 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:21.217095    2580 scope.go:117] "RemoveContainer" containerID="a1a535fae42f1998baaf9a8c68a6153c7c14f5b655793da3a64c92f96c585935"
Sep 08 15:15:27.304356 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:27.304323    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"
Sep 08 15:15:31.000269 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:31.000229    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:15:33.401466 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:33.401385    2580 generic.go:356] "Generic (PLEG): container finished" podID="18b9c370-bf10-4cb8-b2ed-5ab305b8719c" containerID="323f89073a2e5f36e853c12b643aa446a3b0a669a58feda31a17128c68dfb657" exitCode=0
Sep 08 15:15:33.401893 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:33.401457    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht" event={"ID":"18b9c370-bf10-4cb8-b2ed-5ab305b8719c","Type":"ContainerDied","Data":"323f89073a2e5f36e853c12b643aa446a3b0a669a58feda31a17128c68dfb657"}
Sep 08 15:15:33.401941 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:33.401906    2580 scope.go:117] "RemoveContainer" containerID="323f89073a2e5f36e853c12b643aa446a3b0a669a58feda31a17128c68dfb657"
Sep 08 15:15:33.403110 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:33.403079    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:15:33.403169 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:33.403153    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:15:33.403207 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:33.403183    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:15:34.409218 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:34.409186    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht" event={"ID":"18b9c370-bf10-4cb8-b2ed-5ab305b8719c","Type":"ContainerStarted","Data":"1827fd3a5734e71dfa39c9d18234b0d16f2a87ff2cec695008d035d710f2a696"}
Sep 08 15:15:34.625992 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:34.625949    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:34.626235 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:34.626212    2580 patch_prober.go:28] interesting pod/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:15:34.626302 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:34.626281    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht" podUID="18b9c370-bf10-4cb8-b2ed-5ab305b8719c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 08 15:15:35.626665 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:35.626616    2580 patch_prober.go:28] interesting pod/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:15:35.627153 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:35.626694    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht" podUID="18b9c370-bf10-4cb8-b2ed-5ab305b8719c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 08 15:15:36.626214 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:36.626175    2580 patch_prober.go:28] interesting pod/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:15:36.626432 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:36.626242    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht" podUID="18b9c370-bf10-4cb8-b2ed-5ab305b8719c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 08 15:15:37.626614 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:37.626571    2580 patch_prober.go:28] interesting pod/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:15:37.627291 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:37.627252    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht" podUID="18b9c370-bf10-4cb8-b2ed-5ab305b8719c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 08 15:15:38.625941 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:38.625901    2580 patch_prober.go:28] interesting pod/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:15:38.626126 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:38.625965    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht" podUID="18b9c370-bf10-4cb8-b2ed-5ab305b8719c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 08 15:15:39.830489 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:39.830451    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:39.831051 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:39.831022    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:39.832140 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:39.832109    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:15:45.984470 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:45.984429    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"]
Sep 08 15:15:45.989738 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:45.989715    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:45.992059 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:45.992024    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-48dbdcd3\"/\"openshift-service-ca.crt\""
Sep 08 15:15:45.992857 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:45.992831    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-48dbdcd3\"/\"e2e-lifecycle-model-48dbdcd3-kserve-self-signed-certs\""
Sep 08 15:15:45.992857 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:45.992851    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-48dbdcd3\"/\"kube-root-ca.crt\""
Sep 08 15:15:45.993047 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:45.992912    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-48dbdcd3\"/\"default-dockercfg-5vdlr\""
Sep 08 15:15:46.000083 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.000056    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"]
Sep 08 15:15:46.056163 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.056124    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-dshm\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.056338 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.056173    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-model-cache\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.056338 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.056190    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2g5t\" (UniqueName: \"kubernetes.io/projected/a05cef8c-9115-4c60-9cee-1fae4413de57-kube-api-access-h2g5t\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.056338 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.056276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-home\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.056338 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.056314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-tmp-dir\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.056478 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.056340    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a05cef8c-9115-4c60-9cee-1fae4413de57-tls-certs\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.156968 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.156927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-dshm\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.157161 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.157008    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-model-cache\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.157161 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.157036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2g5t\" (UniqueName: \"kubernetes.io/projected/a05cef8c-9115-4c60-9cee-1fae4413de57-kube-api-access-h2g5t\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.157161 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.157083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-home\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.157161 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.157116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-tmp-dir\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.157161 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.157154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a05cef8c-9115-4c60-9cee-1fae4413de57-tls-certs\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.157858 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.157832    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-tmp-dir\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.158042 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.157941    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-model-cache\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.158042 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.157946    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-home\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.159639 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.159612    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-dshm\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.159944 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.159926    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a05cef8c-9115-4c60-9cee-1fae4413de57-tls-certs\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.166247 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.166223    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2g5t\" (UniqueName: \"kubernetes.io/projected/a05cef8c-9115-4c60-9cee-1fae4413de57-kube-api-access-h2g5t\") pod \"e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") " pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.306546 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.306410    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:46.580058 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:46.580028    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"]
Sep 08 15:15:46.582640 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:15:46.582610    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda05cef8c_9115_4c60_9cee_1fae4413de57.slice/crio-68a8f8891034fa6de9de6d865d44236177054571afe469252198430a556ff371 WatchSource:0}: Error finding container 68a8f8891034fa6de9de6d865d44236177054571afe469252198430a556ff371: Status 404 returned error can't find the container with id 68a8f8891034fa6de9de6d865d44236177054571afe469252198430a556ff371
Sep 08 15:15:47.503653 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:47.503613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd" event={"ID":"a05cef8c-9115-4c60-9cee-1fae4413de57","Type":"ContainerStarted","Data":"815c29c4cac838d1f368cefcf3769522911e9edbb548b1b05c24a79842ed5759"}
Sep 08 15:15:47.504051 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:47.503665    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd" event={"ID":"a05cef8c-9115-4c60-9cee-1fae4413de57","Type":"ContainerStarted","Data":"68a8f8891034fa6de9de6d865d44236177054571afe469252198430a556ff371"}
Sep 08 15:15:47.521964 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:47.521910    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd" podStartSLOduration=2.521891639 podStartE2EDuration="2.521891639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:15:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:15:47.521327458 +0000 UTC m=+1226.853567003" watchObservedRunningTime="2026-09-08 15:15:47.521891639 +0000 UTC m=+1226.854131185"
Sep 08 15:15:48.202674 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:48.202634    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:15:56.306658 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:56.306617    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:56.307055 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:56.306792    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:56.319239 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:56.319211    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:15:56.575183 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:15:56.575097    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:16:06.906943 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:06.906902    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:16:21.250028 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:21.249998    2580 scope.go:117] "RemoveContainer" containerID="88e92eac77659c19e2f48d56fe444ee47e97d22ec1affd3852df77e50bbf8402"
Sep 08 15:16:22.532115 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:22.532079    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k"]
Sep 08 15:16:22.537162 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:22.537138    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k"
Sep 08 15:16:22.540569 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:22.540531    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:16:22.540908 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:22.540888    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:16:22.544141 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:22.544116    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k"]
Sep 08 15:16:22.628476 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:22.628437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e2cb358-3fd1-4a04-b646-cf5099595e93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k\" (UID: \"8e2cb358-3fd1-4a04-b646-cf5099595e93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k"
Sep 08 15:16:22.729343 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:22.729297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e2cb358-3fd1-4a04-b646-cf5099595e93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k\" (UID: \"8e2cb358-3fd1-4a04-b646-cf5099595e93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k"
Sep 08 15:16:22.730323 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:22.730283    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e2cb358-3fd1-4a04-b646-cf5099595e93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k\" (UID: \"8e2cb358-3fd1-4a04-b646-cf5099595e93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k"
Sep 08 15:16:22.849544 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:22.849449    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k"
Sep 08 15:16:23.121162 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:23.121135    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k"]
Sep 08 15:16:23.122775 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:16:23.122747    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2cb358_3fd1_4a04_b646_cf5099595e93.slice/crio-a40c45b23e2d562d4e1200edd0e7307a048aedd59c1d4b3c4949e27d5cef667b WatchSource:0}: Error finding container a40c45b23e2d562d4e1200edd0e7307a048aedd59c1d4b3c4949e27d5cef667b: Status 404 returned error can't find the container with id a40c45b23e2d562d4e1200edd0e7307a048aedd59c1d4b3c4949e27d5cef667b
Sep 08 15:16:23.728435 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:23.728399    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k" event={"ID":"8e2cb358-3fd1-4a04-b646-cf5099595e93","Type":"ContainerStarted","Data":"0ea0efaaf3521d9c06484576c554779a4619fcfbe7bae397d455a4504f907ebc"}
Sep 08 15:16:23.728917 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:23.728459    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k" event={"ID":"8e2cb358-3fd1-4a04-b646-cf5099595e93","Type":"ContainerStarted","Data":"a40c45b23e2d562d4e1200edd0e7307a048aedd59c1d4b3c4949e27d5cef667b"}
Sep 08 15:16:23.741590 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:23.741439    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k" podStartSLOduration=1.7414220459999998 podStartE2EDuration="1.741422046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:16:23.741369558 +0000 UTC m=+1263.073609106" watchObservedRunningTime="2026-09-08 15:16:23.741422046 +0000 UTC m=+1263.073661603"
Sep 08 15:16:24.739235 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:24.739202    2580 generic.go:356] "Generic (PLEG): container finished" podID="8e2cb358-3fd1-4a04-b646-cf5099595e93" containerID="0ea0efaaf3521d9c06484576c554779a4619fcfbe7bae397d455a4504f907ebc" exitCode=0
Sep 08 15:16:24.739627 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:24.739286    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k" event={"ID":"8e2cb358-3fd1-4a04-b646-cf5099595e93","Type":"ContainerDied","Data":"0ea0efaaf3521d9c06484576c554779a4619fcfbe7bae397d455a4504f907ebc"}
Sep 08 15:16:25.201498 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:25.201406    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:16:25.913101 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:25.913072    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k"
Sep 08 15:16:25.960711 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:25.960669    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e2cb358-3fd1-4a04-b646-cf5099595e93-maas-api-service-ca\") pod \"8e2cb358-3fd1-4a04-b646-cf5099595e93\" (UID: \"8e2cb358-3fd1-4a04-b646-cf5099595e93\") "
Sep 08 15:16:25.961114 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:25.961082    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e2cb358-3fd1-4a04-b646-cf5099595e93-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8e2cb358-3fd1-4a04-b646-cf5099595e93" (UID: "8e2cb358-3fd1-4a04-b646-cf5099595e93"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:16:26.062434 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:26.062336    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e2cb358-3fd1-4a04-b646-cf5099595e93-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:16:26.755403 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:26.755375    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k"
Sep 08 15:16:26.755602 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:26.755411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k" event={"ID":"8e2cb358-3fd1-4a04-b646-cf5099595e93","Type":"ContainerDied","Data":"a40c45b23e2d562d4e1200edd0e7307a048aedd59c1d4b3c4949e27d5cef667b"}
Sep 08 15:16:26.755602 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:26.755457    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a40c45b23e2d562d4e1200edd0e7307a048aedd59c1d4b3c4949e27d5cef667b"
Sep 08 15:16:38.085343 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.085305    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"]
Sep 08 15:16:38.086245 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.086215    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r" podUID="cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71" containerName="payload-pre-processing" containerID="cri-o://b6816e20494f95e833dd6ada6cdfe4e02e640804c25d5761ce0dc329b3fd68be" gracePeriod=30
Sep 08 15:16:38.272854 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.272778    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k"]
Sep 08 15:16:38.274342 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.274310    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48dbdcd3-f5l8k"]
Sep 08 15:16:38.359915 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.359883    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"
Sep 08 15:16:38.484853 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.484820    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71-plugins-config-volume\") pod \"cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71\" (UID: \"cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71\") "
Sep 08 15:16:38.485041 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.484947    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xzqj\" (UniqueName: \"kubernetes.io/projected/cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71-kube-api-access-4xzqj\") pod \"cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71\" (UID: \"cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71\") "
Sep 08 15:16:38.485215 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.485191    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71" (UID: "cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:16:38.485301 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.485288    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:16:38.487076 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.487057    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71-kube-api-access-4xzqj" (OuterVolumeSpecName: "kube-api-access-4xzqj") pod "cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71" (UID: "cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71"). InnerVolumeSpecName "kube-api-access-4xzqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:16:38.586273 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.586235    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xzqj\" (UniqueName: \"kubernetes.io/projected/cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71-kube-api-access-4xzqj\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:16:38.833998 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.833965    2580 generic.go:356] "Generic (PLEG): container finished" podID="cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71" containerID="b6816e20494f95e833dd6ada6cdfe4e02e640804c25d5761ce0dc329b3fd68be" exitCode=0
Sep 08 15:16:38.834185 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.834009    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"
Sep 08 15:16:38.834185 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.834021    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r" event={"ID":"cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71","Type":"ContainerDied","Data":"b6816e20494f95e833dd6ada6cdfe4e02e640804c25d5761ce0dc329b3fd68be"}
Sep 08 15:16:38.834185 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.834071    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r" event={"ID":"cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71","Type":"ContainerDied","Data":"647826cf0729903cfea2903220125c1b0d17f3d8f5a72639d40c0f9e2d1bd873"}
Sep 08 15:16:38.834185 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.834094    2580 scope.go:117] "RemoveContainer" containerID="b6816e20494f95e833dd6ada6cdfe4e02e640804c25d5761ce0dc329b3fd68be"
Sep 08 15:16:38.843569 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.843549    2580 scope.go:117] "RemoveContainer" containerID="b6816e20494f95e833dd6ada6cdfe4e02e640804c25d5761ce0dc329b3fd68be"
Sep 08 15:16:38.843830 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:16:38.843812    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6816e20494f95e833dd6ada6cdfe4e02e640804c25d5761ce0dc329b3fd68be\": container with ID starting with b6816e20494f95e833dd6ada6cdfe4e02e640804c25d5761ce0dc329b3fd68be not found: ID does not exist" containerID="b6816e20494f95e833dd6ada6cdfe4e02e640804c25d5761ce0dc329b3fd68be"
Sep 08 15:16:38.843876 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.843840    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6816e20494f95e833dd6ada6cdfe4e02e640804c25d5761ce0dc329b3fd68be"} err="failed to get container status \"b6816e20494f95e833dd6ada6cdfe4e02e640804c25d5761ce0dc329b3fd68be\": rpc error: code = NotFound desc = could not find container \"b6816e20494f95e833dd6ada6cdfe4e02e640804c25d5761ce0dc329b3fd68be\": container with ID starting with b6816e20494f95e833dd6ada6cdfe4e02e640804c25d5761ce0dc329b3fd68be not found: ID does not exist"
Sep 08 15:16:38.858960 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.858930    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"]
Sep 08 15:16:38.861181 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:38.861160    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-48dbdcd3-6b954cb546-znm2r"]
Sep 08 15:16:39.157353 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:39.157281    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e2cb358-3fd1-4a04-b646-cf5099595e93" path="/var/lib/kubelet/pods/8e2cb358-3fd1-4a04-b646-cf5099595e93/volumes"
Sep 08 15:16:39.157724 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:39.157709    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71" path="/var/lib/kubelet/pods/cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71/volumes"
Sep 08 15:16:43.703905 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:43.703865    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:16:46.333667 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:46.333627    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"]
Sep 08 15:16:58.841865 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:16:58.841824    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:17:01.353917 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.353881    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd" podUID="a05cef8c-9115-4c60-9cee-1fae4413de57" containerName="main" containerID="cri-o://815c29c4cac838d1f368cefcf3769522911e9edbb548b1b05c24a79842ed5759" gracePeriod=45
Sep 08 15:17:01.614825 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.614760    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:17:01.724333 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.724294    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-tmp-dir\") pod \"a05cef8c-9115-4c60-9cee-1fae4413de57\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") "
Sep 08 15:17:01.724543 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.724404    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2g5t\" (UniqueName: \"kubernetes.io/projected/a05cef8c-9115-4c60-9cee-1fae4413de57-kube-api-access-h2g5t\") pod \"a05cef8c-9115-4c60-9cee-1fae4413de57\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") "
Sep 08 15:17:01.724543 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.724456    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-dshm\") pod \"a05cef8c-9115-4c60-9cee-1fae4413de57\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") "
Sep 08 15:17:01.724543 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.724487    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-home\") pod \"a05cef8c-9115-4c60-9cee-1fae4413de57\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") "
Sep 08 15:17:01.724719 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.724627    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a05cef8c-9115-4c60-9cee-1fae4413de57-tls-certs\") pod \"a05cef8c-9115-4c60-9cee-1fae4413de57\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") "
Sep 08 15:17:01.724719 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.724631    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a05cef8c-9115-4c60-9cee-1fae4413de57" (UID: "a05cef8c-9115-4c60-9cee-1fae4413de57"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:17:01.724719 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.724669    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-model-cache\") pod \"a05cef8c-9115-4c60-9cee-1fae4413de57\" (UID: \"a05cef8c-9115-4c60-9cee-1fae4413de57\") "
Sep 08 15:17:01.724887 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.724814    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-home" (OuterVolumeSpecName: "home") pod "a05cef8c-9115-4c60-9cee-1fae4413de57" (UID: "a05cef8c-9115-4c60-9cee-1fae4413de57"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:17:01.724988 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.724964    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-model-cache" (OuterVolumeSpecName: "model-cache") pod "a05cef8c-9115-4c60-9cee-1fae4413de57" (UID: "a05cef8c-9115-4c60-9cee-1fae4413de57"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:17:01.725108 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.725090    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-tmp-dir\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:17:01.725146 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.725114    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-home\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:17:01.725146 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.725129    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-model-cache\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:17:01.726747 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.726712    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-dshm" (OuterVolumeSpecName: "dshm") pod "a05cef8c-9115-4c60-9cee-1fae4413de57" (UID: "a05cef8c-9115-4c60-9cee-1fae4413de57"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:17:01.726880 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.726768    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a05cef8c-9115-4c60-9cee-1fae4413de57-kube-api-access-h2g5t" (OuterVolumeSpecName: "kube-api-access-h2g5t") pod "a05cef8c-9115-4c60-9cee-1fae4413de57" (UID: "a05cef8c-9115-4c60-9cee-1fae4413de57"). InnerVolumeSpecName "kube-api-access-h2g5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:17:01.727286 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.727266    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a05cef8c-9115-4c60-9cee-1fae4413de57-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a05cef8c-9115-4c60-9cee-1fae4413de57" (UID: "a05cef8c-9115-4c60-9cee-1fae4413de57"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:17:01.826466 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.826421    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2g5t\" (UniqueName: \"kubernetes.io/projected/a05cef8c-9115-4c60-9cee-1fae4413de57-kube-api-access-h2g5t\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:17:01.826466 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.826461    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a05cef8c-9115-4c60-9cee-1fae4413de57-dshm\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:17:01.826466 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.826474    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a05cef8c-9115-4c60-9cee-1fae4413de57-tls-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:17:01.975352 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.975317    2580 generic.go:356] "Generic (PLEG): container finished" podID="a05cef8c-9115-4c60-9cee-1fae4413de57" containerID="815c29c4cac838d1f368cefcf3769522911e9edbb548b1b05c24a79842ed5759" exitCode=0
Sep 08 15:17:01.975602 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.975366    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"
Sep 08 15:17:01.975602 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.975416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd" event={"ID":"a05cef8c-9115-4c60-9cee-1fae4413de57","Type":"ContainerDied","Data":"815c29c4cac838d1f368cefcf3769522911e9edbb548b1b05c24a79842ed5759"}
Sep 08 15:17:01.975602 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.975462    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd" event={"ID":"a05cef8c-9115-4c60-9cee-1fae4413de57","Type":"ContainerDied","Data":"68a8f8891034fa6de9de6d865d44236177054571afe469252198430a556ff371"}
Sep 08 15:17:01.975602 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.975480    2580 scope.go:117] "RemoveContainer" containerID="815c29c4cac838d1f368cefcf3769522911e9edbb548b1b05c24a79842ed5759"
Sep 08 15:17:01.985314 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.985296    2580 scope.go:117] "RemoveContainer" containerID="815c29c4cac838d1f368cefcf3769522911e9edbb548b1b05c24a79842ed5759"
Sep 08 15:17:01.985640 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:17:01.985616    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"815c29c4cac838d1f368cefcf3769522911e9edbb548b1b05c24a79842ed5759\": container with ID starting with 815c29c4cac838d1f368cefcf3769522911e9edbb548b1b05c24a79842ed5759 not found: ID does not exist" containerID="815c29c4cac838d1f368cefcf3769522911e9edbb548b1b05c24a79842ed5759"
Sep 08 15:17:01.985725 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.985648    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"815c29c4cac838d1f368cefcf3769522911e9edbb548b1b05c24a79842ed5759"} err="failed to get container status \"815c29c4cac838d1f368cefcf3769522911e9edbb548b1b05c24a79842ed5759\": rpc error: code = NotFound desc = could not find container \"815c29c4cac838d1f368cefcf3769522911e9edbb548b1b05c24a79842ed5759\": container with ID starting with 815c29c4cac838d1f368cefcf3769522911e9edbb548b1b05c24a79842ed5759 not found: ID does not exist"
Sep 08 15:17:01.997973 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:01.997937    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"]
Sep 08 15:17:02.006945 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:02.006914    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-48dbdcd3/e2e-lifecycle-model-48dbdcd3-kserve-d8b5dcf95-pk5qd"]
Sep 08 15:17:03.156266 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:03.156226    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a05cef8c-9115-4c60-9cee-1fae4413de57" path="/var/lib/kubelet/pods/a05cef8c-9115-4c60-9cee-1fae4413de57/volumes"
Sep 08 15:17:13.101752 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:13.101718    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:17:21.271314 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:21.271284    2580 scope.go:117] "RemoveContainer" containerID="1c2818ed5882ace394c6be10837b2656487d3a34f272c295cda2710f4c783dfe"
Sep 08 15:17:21.279995 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:21.279974    2580 scope.go:117] "RemoveContainer" containerID="15ff4feb4d34a0724b12a0b03b1a5b50c70ca249df7c143b534c938b2b58bfb8"
Sep 08 15:17:21.290312 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:21.290286    2580 scope.go:117] "RemoveContainer" containerID="dacddc9040dd81f3e65268632011472526738b534e48ec1e69159650c77640df"
Sep 08 15:17:27.610787 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:27.610744    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:17:29.657186 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:29.657150    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"]
Sep 08 15:17:29.657666 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:29.657419    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht" podUID="18b9c370-bf10-4cb8-b2ed-5ab305b8719c" containerName="istio-proxy" containerID="cri-o://1827fd3a5734e71dfa39c9d18234b0d16f2a87ff2cec695008d035d710f2a696" gracePeriod=30
Sep 08 15:17:34.952700 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.952666    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:17:34.953132 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.953049    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-envoy\") pod \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") "
Sep 08 15:17:34.953205 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.953130    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-data\") pod \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") "
Sep 08 15:17:34.953205 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.953179    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istiod-ca-cert\") pod \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") "
Sep 08 15:17:34.953501 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.953346    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-credential-socket\") pod \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") "
Sep 08 15:17:34.953501 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.953403    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-data" (OuterVolumeSpecName: "istio-data") pod "18b9c370-bf10-4cb8-b2ed-5ab305b8719c" (UID: "18b9c370-bf10-4cb8-b2ed-5ab305b8719c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:17:34.953501 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.953462    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrfpk\" (UniqueName: \"kubernetes.io/projected/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-kube-api-access-rrfpk\") pod \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") "
Sep 08 15:17:34.953777 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.953535    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-podinfo\") pod \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") "
Sep 08 15:17:34.953777 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.953562    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-token\") pod \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") "
Sep 08 15:17:34.953777 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.953593    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-workload-socket\") pod \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") "
Sep 08 15:17:34.953777 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.953632    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-workload-certs\") pod \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\" (UID: \"18b9c370-bf10-4cb8-b2ed-5ab305b8719c\") "
Sep 08 15:17:34.953777 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.953634    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18b9c370-bf10-4cb8-b2ed-5ab305b8719c" (UID: "18b9c370-bf10-4cb8-b2ed-5ab305b8719c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:17:34.953777 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.953656    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18b9c370-bf10-4cb8-b2ed-5ab305b8719c" (UID: "18b9c370-bf10-4cb8-b2ed-5ab305b8719c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:17:34.954125 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.953973    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:17:34.954125 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.953996    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:17:34.954125 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.954010    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:17:34.954291 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.954248    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18b9c370-bf10-4cb8-b2ed-5ab305b8719c" (UID: "18b9c370-bf10-4cb8-b2ed-5ab305b8719c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:17:34.954676 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.954490    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18b9c370-bf10-4cb8-b2ed-5ab305b8719c" (UID: "18b9c370-bf10-4cb8-b2ed-5ab305b8719c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:17:34.955880 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.955757    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18b9c370-bf10-4cb8-b2ed-5ab305b8719c" (UID: "18b9c370-bf10-4cb8-b2ed-5ab305b8719c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:17:34.956086 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.956061    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18b9c370-bf10-4cb8-b2ed-5ab305b8719c" (UID: "18b9c370-bf10-4cb8-b2ed-5ab305b8719c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:17:34.958993 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.958937    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-token" (OuterVolumeSpecName: "istio-token") pod "18b9c370-bf10-4cb8-b2ed-5ab305b8719c" (UID: "18b9c370-bf10-4cb8-b2ed-5ab305b8719c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:17:34.959107 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:34.959084    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-kube-api-access-rrfpk" (OuterVolumeSpecName: "kube-api-access-rrfpk") pod "18b9c370-bf10-4cb8-b2ed-5ab305b8719c" (UID: "18b9c370-bf10-4cb8-b2ed-5ab305b8719c"). InnerVolumeSpecName "kube-api-access-rrfpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:17:35.054791 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.054744    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:17:35.054791 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.054777    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:17:35.054791 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.054786    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:17:35.054791 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.054794    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:17:35.054791 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.054803    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:17:35.055250 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.054812    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrfpk\" (UniqueName: \"kubernetes.io/projected/18b9c370-bf10-4cb8-b2ed-5ab305b8719c-kube-api-access-rrfpk\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:17:35.169660 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.169620    2580 generic.go:356] "Generic (PLEG): container finished" podID="18b9c370-bf10-4cb8-b2ed-5ab305b8719c" containerID="1827fd3a5734e71dfa39c9d18234b0d16f2a87ff2cec695008d035d710f2a696" exitCode=0
Sep 08 15:17:35.169928 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.169686    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"
Sep 08 15:17:35.169928 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.169730    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht" event={"ID":"18b9c370-bf10-4cb8-b2ed-5ab305b8719c","Type":"ContainerDied","Data":"1827fd3a5734e71dfa39c9d18234b0d16f2a87ff2cec695008d035d710f2a696"}
Sep 08 15:17:35.169928 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.169798    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht" event={"ID":"18b9c370-bf10-4cb8-b2ed-5ab305b8719c","Type":"ContainerDied","Data":"4bb4cccc19762bb9bcd87554fee916cead36e81395cdfe3e3a2b0f11ce1bcc6a"}
Sep 08 15:17:35.169928 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.169829    2580 scope.go:117] "RemoveContainer" containerID="1827fd3a5734e71dfa39c9d18234b0d16f2a87ff2cec695008d035d710f2a696"
Sep 08 15:17:35.186012 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.184021    2580 scope.go:117] "RemoveContainer" containerID="323f89073a2e5f36e853c12b643aa446a3b0a669a58feda31a17128c68dfb657"
Sep 08 15:17:35.194012 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.193981    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"]
Sep 08 15:17:35.197796 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.197628    2580 scope.go:117] "RemoveContainer" containerID="1827fd3a5734e71dfa39c9d18234b0d16f2a87ff2cec695008d035d710f2a696"
Sep 08 15:17:35.198175 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:17:35.198155    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1827fd3a5734e71dfa39c9d18234b0d16f2a87ff2cec695008d035d710f2a696\": container with ID starting with 1827fd3a5734e71dfa39c9d18234b0d16f2a87ff2cec695008d035d710f2a696 not found: ID does not exist" containerID="1827fd3a5734e71dfa39c9d18234b0d16f2a87ff2cec695008d035d710f2a696"
Sep 08 15:17:35.198255 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.198185    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1827fd3a5734e71dfa39c9d18234b0d16f2a87ff2cec695008d035d710f2a696"} err="failed to get container status \"1827fd3a5734e71dfa39c9d18234b0d16f2a87ff2cec695008d035d710f2a696\": rpc error: code = NotFound desc = could not find container \"1827fd3a5734e71dfa39c9d18234b0d16f2a87ff2cec695008d035d710f2a696\": container with ID starting with 1827fd3a5734e71dfa39c9d18234b0d16f2a87ff2cec695008d035d710f2a696 not found: ID does not exist"
Sep 08 15:17:35.198255 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.198205    2580 scope.go:117] "RemoveContainer" containerID="323f89073a2e5f36e853c12b643aa446a3b0a669a58feda31a17128c68dfb657"
Sep 08 15:17:35.198615 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:17:35.198590    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"323f89073a2e5f36e853c12b643aa446a3b0a669a58feda31a17128c68dfb657\": container with ID starting with 323f89073a2e5f36e853c12b643aa446a3b0a669a58feda31a17128c68dfb657 not found: ID does not exist" containerID="323f89073a2e5f36e853c12b643aa446a3b0a669a58feda31a17128c68dfb657"
Sep 08 15:17:35.198689 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.198622    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"323f89073a2e5f36e853c12b643aa446a3b0a669a58feda31a17128c68dfb657"} err="failed to get container status \"323f89073a2e5f36e853c12b643aa446a3b0a669a58feda31a17128c68dfb657\": rpc error: code = NotFound desc = could not find container \"323f89073a2e5f36e853c12b643aa446a3b0a669a58feda31a17128c68dfb657\": container with ID starting with 323f89073a2e5f36e853c12b643aa446a3b0a669a58feda31a17128c68dfb657 not found: ID does not exist"
Sep 08 15:17:35.200000 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:35.199973    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-48dbdcd3-openshift-default-6bdc9bcbd8-krnht"]
Sep 08 15:17:37.157869 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:37.157836    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18b9c370-bf10-4cb8-b2ed-5ab305b8719c" path="/var/lib/kubelet/pods/18b9c370-bf10-4cb8-b2ed-5ab305b8719c/volumes"
Sep 08 15:17:41.615668 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:41.615632    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:17:54.903540 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:17:54.903448    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:18:12.507901 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:12.507866    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:18:15.514350 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.514311    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7743-b88ebd"]
Sep 08 15:18:15.514775 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.514725    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b9c370-bf10-4cb8-b2ed-5ab305b8719c" containerName="istio-proxy"
Sep 08 15:18:15.514775 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.514738    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b9c370-bf10-4cb8-b2ed-5ab305b8719c" containerName="istio-proxy"
Sep 08 15:18:15.514775 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.514750    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2cb358-3fd1-4a04-b646-cf5099595e93" containerName="revoke-keys"
Sep 08 15:18:15.514775 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.514756    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2cb358-3fd1-4a04-b646-cf5099595e93" containerName="revoke-keys"
Sep 08 15:18:15.514775 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.514764    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71" containerName="payload-pre-processing"
Sep 08 15:18:15.514775 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.514770    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71" containerName="payload-pre-processing"
Sep 08 15:18:15.514996 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.514781    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a05cef8c-9115-4c60-9cee-1fae4413de57" containerName="main"
Sep 08 15:18:15.514996 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.514786    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a05cef8c-9115-4c60-9cee-1fae4413de57" containerName="main"
Sep 08 15:18:15.514996 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.514848    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="18b9c370-bf10-4cb8-b2ed-5ab305b8719c" containerName="istio-proxy"
Sep 08 15:18:15.514996 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.514857    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cde4c7a2-3ba5-45e0-a46b-3b11b75e0a71" containerName="payload-pre-processing"
Sep 08 15:18:15.514996 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.514864    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a05cef8c-9115-4c60-9cee-1fae4413de57" containerName="main"
Sep 08 15:18:15.514996 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.514869    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e2cb358-3fd1-4a04-b646-cf5099595e93" containerName="revoke-keys"
Sep 08 15:18:15.518096 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.518081    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7743-b88ebd"
Sep 08 15:18:15.520740 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.520717    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sd75n\""
Sep 08 15:18:15.523247 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.523220    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7743-b88ebd"]
Sep 08 15:18:15.569794 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.569757    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckvtr\" (UniqueName: \"kubernetes.io/projected/e5b45d12-c3bb-4561-84b0-d54c7265a8bd-kube-api-access-ckvtr\") pod \"mt-curl-7743-b88ebd\" (UID: \"e5b45d12-c3bb-4561-84b0-d54c7265a8bd\") " pod="opendatahub/mt-curl-7743-b88ebd"
Sep 08 15:18:15.670495 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.670459    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckvtr\" (UniqueName: \"kubernetes.io/projected/e5b45d12-c3bb-4561-84b0-d54c7265a8bd-kube-api-access-ckvtr\") pod \"mt-curl-7743-b88ebd\" (UID: \"e5b45d12-c3bb-4561-84b0-d54c7265a8bd\") " pod="opendatahub/mt-curl-7743-b88ebd"
Sep 08 15:18:15.678502 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.678468    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckvtr\" (UniqueName: \"kubernetes.io/projected/e5b45d12-c3bb-4561-84b0-d54c7265a8bd-kube-api-access-ckvtr\") pod \"mt-curl-7743-b88ebd\" (UID: \"e5b45d12-c3bb-4561-84b0-d54c7265a8bd\") " pod="opendatahub/mt-curl-7743-b88ebd"
Sep 08 15:18:15.829159 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:15.829073    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7743-b88ebd"
Sep 08 15:18:16.097671 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:16.097644    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7743-b88ebd"]
Sep 08 15:18:16.099647 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:18:16.099611    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5b45d12_c3bb_4561_84b0_d54c7265a8bd.slice/crio-1ca35411461abc6d5c2a32bbc8e493fe8c904c02690f26d85bc9c2b08aa01e04 WatchSource:0}: Error finding container 1ca35411461abc6d5c2a32bbc8e493fe8c904c02690f26d85bc9c2b08aa01e04: Status 404 returned error can't find the container with id 1ca35411461abc6d5c2a32bbc8e493fe8c904c02690f26d85bc9c2b08aa01e04
Sep 08 15:18:16.412842 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:16.412747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7743-b88ebd" event={"ID":"e5b45d12-c3bb-4561-84b0-d54c7265a8bd","Type":"ContainerStarted","Data":"1ca35411461abc6d5c2a32bbc8e493fe8c904c02690f26d85bc9c2b08aa01e04"}
Sep 08 15:18:17.419950 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:17.419910    2580 generic.go:356] "Generic (PLEG): container finished" podID="e5b45d12-c3bb-4561-84b0-d54c7265a8bd" containerID="9dd309227f9235f28179f25d97456cc289a25a03bc1953a231e37a93b28cade3" exitCode=0
Sep 08 15:18:17.420331 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:17.419997    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7743-b88ebd" event={"ID":"e5b45d12-c3bb-4561-84b0-d54c7265a8bd","Type":"ContainerDied","Data":"9dd309227f9235f28179f25d97456cc289a25a03bc1953a231e37a93b28cade3"}
Sep 08 15:18:18.565333 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.565302    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7743-b88ebd"
Sep 08 15:18:18.603836 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.603807    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7743-b88ebd_e5b45d12-c3bb-4561-84b0-d54c7265a8bd/mt-curl-7743-b88ebd/0.log"
Sep 08 15:18:18.629238 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.629205    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7743-b88ebd"]
Sep 08 15:18:18.632926 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.632900    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7743-b88ebd"]
Sep 08 15:18:18.705075 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.704991    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckvtr\" (UniqueName: \"kubernetes.io/projected/e5b45d12-c3bb-4561-84b0-d54c7265a8bd-kube-api-access-ckvtr\") pod \"e5b45d12-c3bb-4561-84b0-d54c7265a8bd\" (UID: \"e5b45d12-c3bb-4561-84b0-d54c7265a8bd\") "
Sep 08 15:18:18.706999 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.706970    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5b45d12-c3bb-4561-84b0-d54c7265a8bd-kube-api-access-ckvtr" (OuterVolumeSpecName: "kube-api-access-ckvtr") pod "e5b45d12-c3bb-4561-84b0-d54c7265a8bd" (UID: "e5b45d12-c3bb-4561-84b0-d54c7265a8bd"). InnerVolumeSpecName "kube-api-access-ckvtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:18:18.797268 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.797230    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7743-101e96"]
Sep 08 15:18:18.797675 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.797661    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5b45d12-c3bb-4561-84b0-d54c7265a8bd" containerName="mt-curl-7743-b88ebd"
Sep 08 15:18:18.797725 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.797677    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5b45d12-c3bb-4561-84b0-d54c7265a8bd" containerName="mt-curl-7743-b88ebd"
Sep 08 15:18:18.797725 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.797693    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b9c370-bf10-4cb8-b2ed-5ab305b8719c" containerName="istio-proxy"
Sep 08 15:18:18.797725 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.797699    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b9c370-bf10-4cb8-b2ed-5ab305b8719c" containerName="istio-proxy"
Sep 08 15:18:18.797837 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.797759    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5b45d12-c3bb-4561-84b0-d54c7265a8bd" containerName="mt-curl-7743-b88ebd"
Sep 08 15:18:18.797837 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.797767    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="18b9c370-bf10-4cb8-b2ed-5ab305b8719c" containerName="istio-proxy"
Sep 08 15:18:18.800903 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.800886    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7743-101e96"
Sep 08 15:18:18.806621 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.806595    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckvtr\" (UniqueName: \"kubernetes.io/projected/e5b45d12-c3bb-4561-84b0-d54c7265a8bd-kube-api-access-ckvtr\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:18:18.819012 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.818979    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7743-101e96"]
Sep 08 15:18:18.907901 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:18.907860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8kc9\" (UniqueName: \"kubernetes.io/projected/52456c91-31f6-4297-bd55-94eb8ffef958-kube-api-access-n8kc9\") pod \"mt-curl-7743-101e96\" (UID: \"52456c91-31f6-4297-bd55-94eb8ffef958\") " pod="opendatahub/mt-curl-7743-101e96"
Sep 08 15:18:19.008866 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:19.008816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8kc9\" (UniqueName: \"kubernetes.io/projected/52456c91-31f6-4297-bd55-94eb8ffef958-kube-api-access-n8kc9\") pod \"mt-curl-7743-101e96\" (UID: \"52456c91-31f6-4297-bd55-94eb8ffef958\") " pod="opendatahub/mt-curl-7743-101e96"
Sep 08 15:18:19.018871 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:19.018842    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8kc9\" (UniqueName: \"kubernetes.io/projected/52456c91-31f6-4297-bd55-94eb8ffef958-kube-api-access-n8kc9\") pod \"mt-curl-7743-101e96\" (UID: \"52456c91-31f6-4297-bd55-94eb8ffef958\") " pod="opendatahub/mt-curl-7743-101e96"
Sep 08 15:18:19.109676 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:19.109639    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7743-101e96"
Sep 08 15:18:19.161526 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:19.161477    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5b45d12-c3bb-4561-84b0-d54c7265a8bd" path="/var/lib/kubelet/pods/e5b45d12-c3bb-4561-84b0-d54c7265a8bd/volumes"
Sep 08 15:18:19.414265 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:19.414240    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7743-101e96"]
Sep 08 15:18:19.415699 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:18:19.415671    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52456c91_31f6_4297_bd55_94eb8ffef958.slice/crio-a2546cf76baf9da34374ee3c91b0c43845d891b4718042707d045c0b4cffd346 WatchSource:0}: Error finding container a2546cf76baf9da34374ee3c91b0c43845d891b4718042707d045c0b4cffd346: Status 404 returned error can't find the container with id a2546cf76baf9da34374ee3c91b0c43845d891b4718042707d045c0b4cffd346
Sep 08 15:18:19.433248 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:19.433215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7743-101e96" event={"ID":"52456c91-31f6-4297-bd55-94eb8ffef958","Type":"ContainerStarted","Data":"a2546cf76baf9da34374ee3c91b0c43845d891b4718042707d045c0b4cffd346"}
Sep 08 15:18:19.434694 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:19.434675    2580 scope.go:117] "RemoveContainer" containerID="9dd309227f9235f28179f25d97456cc289a25a03bc1953a231e37a93b28cade3"
Sep 08 15:18:19.434793 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:19.434702    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7743-b88ebd"
Sep 08 15:18:20.441248 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:20.441210    2580 generic.go:356] "Generic (PLEG): container finished" podID="52456c91-31f6-4297-bd55-94eb8ffef958" containerID="e2f8a382d20f3c94103582e3e26725b9df8bce711d9d75733f9de659d8992241" exitCode=0
Sep 08 15:18:20.441687 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:20.441292    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7743-101e96" event={"ID":"52456c91-31f6-4297-bd55-94eb8ffef958","Type":"ContainerDied","Data":"e2f8a382d20f3c94103582e3e26725b9df8bce711d9d75733f9de659d8992241"}
Sep 08 15:18:21.592559 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:21.592473    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7743-101e96"
Sep 08 15:18:21.633858 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:21.633826    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7743-101e96_52456c91-31f6-4297-bd55-94eb8ffef958/mt-curl-7743-101e96/0.log"
Sep 08 15:18:21.666406 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:21.666376    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7743-101e96"]
Sep 08 15:18:21.668290 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:21.668267    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7743-101e96"]
Sep 08 15:18:21.735245 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:21.735211    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8kc9\" (UniqueName: \"kubernetes.io/projected/52456c91-31f6-4297-bd55-94eb8ffef958-kube-api-access-n8kc9\") pod \"52456c91-31f6-4297-bd55-94eb8ffef958\" (UID: \"52456c91-31f6-4297-bd55-94eb8ffef958\") "
Sep 08 15:18:21.737294 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:21.737267    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52456c91-31f6-4297-bd55-94eb8ffef958-kube-api-access-n8kc9" (OuterVolumeSpecName: "kube-api-access-n8kc9") pod "52456c91-31f6-4297-bd55-94eb8ffef958" (UID: "52456c91-31f6-4297-bd55-94eb8ffef958"). InnerVolumeSpecName "kube-api-access-n8kc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:18:21.836723 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:21.836683    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8kc9\" (UniqueName: \"kubernetes.io/projected/52456c91-31f6-4297-bd55-94eb8ffef958-kube-api-access-n8kc9\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:18:22.455212 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:22.455184    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2546cf76baf9da34374ee3c91b0c43845d891b4718042707d045c0b4cffd346"
Sep 08 15:18:22.455212 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:22.455196    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7743-101e96"
Sep 08 15:18:22.467930 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:18:22.467901    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7743-101e96\" is forbidden: User \"system:node:ip-10-0-134-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-147.ec2.internal' and this object" podUID="52456c91-31f6-4297-bd55-94eb8ffef958" pod="opendatahub/mt-curl-7743-101e96"
Sep 08 15:18:23.156608 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:23.156575    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52456c91-31f6-4297-bd55-94eb8ffef958" path="/var/lib/kubelet/pods/52456c91-31f6-4297-bd55-94eb8ffef958/volumes"
Sep 08 15:18:25.211267 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:25.211230    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:18:26.629290 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.629258    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"]
Sep 08 15:18:26.629921 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.629898    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52456c91-31f6-4297-bd55-94eb8ffef958" containerName="mt-curl-7743-101e96"
Sep 08 15:18:26.629921 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.629922    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="52456c91-31f6-4297-bd55-94eb8ffef958" containerName="mt-curl-7743-101e96"
Sep 08 15:18:26.630076 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.630050    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="52456c91-31f6-4297-bd55-94eb8ffef958" containerName="mt-curl-7743-101e96"
Sep 08 15:18:26.642379 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.642350    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.648103 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.648077    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-3ccde3-openshift-default-dockercfg-72btz\""
Sep 08 15:18:26.651553 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.650985    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"]
Sep 08 15:18:26.788380 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.788337    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-envoy\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.788606 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.788391    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-credential-socket\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.788606 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.788452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istiod-ca-cert\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.788606 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.788480    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-token\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.788606 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.788538    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-data\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.788606 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.788560    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-podinfo\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.788910 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.788646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-workload-socket\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.788910 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.788713    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-workload-certs\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.788910 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.788737    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcltf\" (UniqueName: \"kubernetes.io/projected/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-kube-api-access-bcltf\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.889790 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.889698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-workload-certs\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.889790 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.889737    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcltf\" (UniqueName: \"kubernetes.io/projected/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-kube-api-access-bcltf\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.890039 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.889947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-envoy\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.890039 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.890007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-credential-socket\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.890039 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.890036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istiod-ca-cert\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.890207 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.890059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-token\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.890207 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.890100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-data\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.890307 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.890234    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-workload-certs\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.890307 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.890286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-podinfo\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.890419 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.890395    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-data\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.890419 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.890402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-workload-socket\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.890736 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.890715    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-workload-socket\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.890878 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.890806    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istiod-ca-cert\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.890878 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.890789    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-credential-socket\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.892912 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.892881    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-envoy\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.893006 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.892990    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-podinfo\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.906368 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.906341    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-token\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.906481 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.906428    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcltf\" (UniqueName: \"kubernetes.io/projected/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-kube-api-access-bcltf\") pod \"e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") " pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:26.956396 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:26.956364    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:27.237474 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:27.237403    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"]
Sep 08 15:18:27.240250 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:18:27.240223    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a9de90_de0a_4d20_a6a5_a80cd02f13ff.slice/crio-6198d565072b522b97fac3bedb20b627bee2ebc450d5ccf6a3d1c44db97971fa WatchSource:0}: Error finding container 6198d565072b522b97fac3bedb20b627bee2ebc450d5ccf6a3d1c44db97971fa: Status 404 returned error can't find the container with id 6198d565072b522b97fac3bedb20b627bee2ebc450d5ccf6a3d1c44db97971fa
Sep 08 15:18:27.242450 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:27.242418    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:18:27.242530 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:27.242489    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:18:27.242572 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:27.242536    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:18:27.485553 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:27.485493    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl" event={"ID":"19a9de90-de0a-4d20-a6a5-a80cd02f13ff","Type":"ContainerStarted","Data":"f8c2508cecacde658a00464497d997a6d913a9b064b7f001b2b3d7023b692ab9"}
Sep 08 15:18:27.485740 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:27.485575    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl" event={"ID":"19a9de90-de0a-4d20-a6a5-a80cd02f13ff","Type":"ContainerStarted","Data":"6198d565072b522b97fac3bedb20b627bee2ebc450d5ccf6a3d1c44db97971fa"}
Sep 08 15:18:27.537385 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:27.537282    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl" podStartSLOduration=1.5372644960000001 podStartE2EDuration="1.537264496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:27.532085666 +0000 UTC m=+1386.864325213" watchObservedRunningTime="2026-09-08 15:18:27.537264496 +0000 UTC m=+1386.869504039"
Sep 08 15:18:27.957171 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:27.957080    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:28.962659 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:28.962628    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:29.497307 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:29.497272    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:29.498263 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:29.498243    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:31.805103 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:31.805063    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"]
Sep 08 15:18:31.810703 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:31.810664    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"]
Sep 08 15:18:31.810850 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:31.810796    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"
Sep 08 15:18:31.813431 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:31.813410    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-3ccde3-dockercfg-9cm6z\""
Sep 08 15:18:31.813688 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:31.813666    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-3ccde3\""
Sep 08 15:18:31.943619 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:31.943566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acfd0c5f-825e-4c4f-84aa-23254b9ce235-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7\" (UID: \"acfd0c5f-825e-4c4f-84aa-23254b9ce235\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"
Sep 08 15:18:31.943822 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:31.943796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl6kb\" (UniqueName: \"kubernetes.io/projected/acfd0c5f-825e-4c4f-84aa-23254b9ce235-kube-api-access-pl6kb\") pod \"payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7\" (UID: \"acfd0c5f-825e-4c4f-84aa-23254b9ce235\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"
Sep 08 15:18:32.044727 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:32.044673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl6kb\" (UniqueName: \"kubernetes.io/projected/acfd0c5f-825e-4c4f-84aa-23254b9ce235-kube-api-access-pl6kb\") pod \"payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7\" (UID: \"acfd0c5f-825e-4c4f-84aa-23254b9ce235\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"
Sep 08 15:18:32.044905 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:32.044750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acfd0c5f-825e-4c4f-84aa-23254b9ce235-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7\" (UID: \"acfd0c5f-825e-4c4f-84aa-23254b9ce235\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"
Sep 08 15:18:32.045423 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:32.045404    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acfd0c5f-825e-4c4f-84aa-23254b9ce235-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7\" (UID: \"acfd0c5f-825e-4c4f-84aa-23254b9ce235\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"
Sep 08 15:18:32.052487 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:32.052464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl6kb\" (UniqueName: \"kubernetes.io/projected/acfd0c5f-825e-4c4f-84aa-23254b9ce235-kube-api-access-pl6kb\") pod \"payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7\" (UID: \"acfd0c5f-825e-4c4f-84aa-23254b9ce235\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"
Sep 08 15:18:32.124878 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:32.124796    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"
Sep 08 15:18:32.397559 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:32.397495    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"]
Sep 08 15:18:32.399025 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:18:32.398997    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacfd0c5f_825e_4c4f_84aa_23254b9ce235.slice/crio-59ccb4ecf157987a50c130cb8b1e550d856cad55579986e6c222ccb4e463f9f0 WatchSource:0}: Error finding container 59ccb4ecf157987a50c130cb8b1e550d856cad55579986e6c222ccb4e463f9f0: Status 404 returned error can't find the container with id 59ccb4ecf157987a50c130cb8b1e550d856cad55579986e6c222ccb4e463f9f0
Sep 08 15:18:32.514713 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:32.514680    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7" event={"ID":"acfd0c5f-825e-4c4f-84aa-23254b9ce235","Type":"ContainerStarted","Data":"16c57d723640ec327f8aa3b28783b06a7cff6637806362647f846f0fd50f1034"}
Sep 08 15:18:32.514885 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:32.514730    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7" event={"ID":"acfd0c5f-825e-4c4f-84aa-23254b9ce235","Type":"ContainerStarted","Data":"59ccb4ecf157987a50c130cb8b1e550d856cad55579986e6c222ccb4e463f9f0"}
Sep 08 15:18:32.514885 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:32.514795    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"
Sep 08 15:18:32.532661 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:32.532604    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7" podStartSLOduration=1.532589936 podStartE2EDuration="1.532589936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:32.529721373 +0000 UTC m=+1391.861960923" watchObservedRunningTime="2026-09-08 15:18:32.532589936 +0000 UTC m=+1391.864829483"
Sep 08 15:18:36.408360 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.408324    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"]
Sep 08 15:18:36.412384 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.412362    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.416219 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.416194    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-ffa941\"/\"default-dockercfg-sxj4z\""
Sep 08 15:18:36.416346 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.416196    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-ffa941\"/\"rate-test-model-ffa941-kserve-self-signed-certs\""
Sep 08 15:18:36.416346 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.416196    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-ffa941\"/\"openshift-service-ca.crt\""
Sep 08 15:18:36.416769 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.416739    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-ffa941\"/\"kube-root-ca.crt\""
Sep 08 15:18:36.426714 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.426681    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"]
Sep 08 15:18:36.591958 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.591924    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-dshm\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.592134 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.592057    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-model-cache\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.592134 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.592098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-tls-certs\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.592134 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.592120    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-home\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.592246 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.592158    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-tmp-dir\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.592246 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.592234    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltvvf\" (UniqueName: \"kubernetes.io/projected/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-kube-api-access-ltvvf\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.692874 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.692780    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-model-cache\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.692874 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.692831    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-tls-certs\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.692874 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.692852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-home\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.692874 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.692876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-tmp-dir\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.693199 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.692925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltvvf\" (UniqueName: \"kubernetes.io/projected/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-kube-api-access-ltvvf\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.693199 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.692976    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-dshm\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.693319 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.693241    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-model-cache\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.693319 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.693255    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-home\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.693319 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.693296    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-tmp-dir\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.695356 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.695328    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-dshm\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.695494 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.695428    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-tls-certs\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.701004 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.700976    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltvvf\" (UniqueName: \"kubernetes.io/projected/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-kube-api-access-ltvvf\") pod \"rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") " pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:36.726819 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:36.726729    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:37.026196 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:37.026162    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"]
Sep 08 15:18:37.558882 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:37.558842    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7" event={"ID":"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a","Type":"ContainerStarted","Data":"83ac4ca91a9de915b6a55cbc365b27afddaf81d05b032e6c9e000a8d69a4396d"}
Sep 08 15:18:37.559273 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:37.558894    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7" event={"ID":"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a","Type":"ContainerStarted","Data":"2774a71ccf2d472f9c23d793218a9b2f6e1ff5900c9c186c23753cb3294b6a8c"}
Sep 08 15:18:37.576425 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:37.576378    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7" podStartSLOduration=1.5763631 podStartE2EDuration="1.5763631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:37.574776457 +0000 UTC m=+1396.907016005" watchObservedRunningTime="2026-09-08 15:18:37.5763631 +0000 UTC m=+1396.908602645"
Sep 08 15:18:42.308418 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:42.308376    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:18:43.522561 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:43.522524    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"
Sep 08 15:18:44.499078 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:44.499036    2580 patch_prober.go:28] interesting pod/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 08 15:18:44.499301 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:44.499107    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl" podUID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 08 15:18:44.602303 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:44.602220    2580 generic.go:356] "Generic (PLEG): container finished" podID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" containerID="f8c2508cecacde658a00464497d997a6d913a9b064b7f001b2b3d7023b692ab9" exitCode=0
Sep 08 15:18:44.602789 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:44.602297    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl" event={"ID":"19a9de90-de0a-4d20-a6a5-a80cd02f13ff","Type":"ContainerDied","Data":"f8c2508cecacde658a00464497d997a6d913a9b064b7f001b2b3d7023b692ab9"}
Sep 08 15:18:44.602864 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:44.602843    2580 scope.go:117] "RemoveContainer" containerID="f8c2508cecacde658a00464497d997a6d913a9b064b7f001b2b3d7023b692ab9"
Sep 08 15:18:44.604006 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:44.603974    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:18:44.604112 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:44.604043    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:18:44.604112 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:44.604074    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:18:45.609897 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:45.609865    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl" event={"ID":"19a9de90-de0a-4d20-a6a5-a80cd02f13ff","Type":"ContainerStarted","Data":"6ef1f481159a70df377824c440e1263e4bd42bf248b3a65708c06913ca33625c"}
Sep 08 15:18:45.956802 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:45.956705    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:45.957016 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:45.956993    2580 patch_prober.go:28] interesting pod/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 08 15:18:45.957096 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:45.957048    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl" podUID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 08 15:18:46.727257 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:46.727212    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:46.727770 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:46.727273    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:46.762972 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:46.762941    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:46.957490 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:46.957452    2580 patch_prober.go:28] interesting pod/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 08 15:18:46.957675 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:46.957537    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl" podUID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 08 15:18:47.658247 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:47.658215    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:18:47.957640 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:47.957533    2580 patch_prober.go:28] interesting pod/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 08 15:18:47.957640 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:47.957604    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl" podUID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 08 15:18:48.957536 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:48.957480    2580 patch_prober.go:28] interesting pod/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 08 15:18:48.957743 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:48.957595    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl" podUID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 08 15:18:49.956813 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:49.956774    2580 patch_prober.go:28] interesting pod/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 08 15:18:49.956996 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:49.956835    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl" podUID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 08 15:18:50.960901 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:50.960864    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:50.961278 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:50.961143    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:50.961919 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:50.961901    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:18:55.588647 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.588610    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"]
Sep 08 15:18:55.594667 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.594633    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.597162 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.597139    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-0da0d1-openshift-default-dockercfg-mgp47\""
Sep 08 15:18:55.602583 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.602560    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"]
Sep 08 15:18:55.706112 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.706070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-workload-certs\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.706422 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.706396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-data\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.706642 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.706623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcbxh\" (UniqueName: \"kubernetes.io/projected/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-kube-api-access-jcbxh\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.706798 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.706784    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-envoy\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.706940 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.706922    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-podinfo\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.707119 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.707106    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istiod-ca-cert\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.707251 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.707235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-credential-socket\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.707420 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.707404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-token\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.707672 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.707645    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-workload-socket\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.808940 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.808896    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istiod-ca-cert\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.808940 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.808943    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-credential-socket\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.809178 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.808981    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-token\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.809178 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.809025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-workload-socket\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.809298 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.809172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-workload-certs\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.809298 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.809249    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-data\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.809298 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.809285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcbxh\" (UniqueName: \"kubernetes.io/projected/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-kube-api-access-jcbxh\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.809445 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.809329    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-envoy\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.809445 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.809362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-podinfo\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.809575 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.809452    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-workload-socket\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.809575 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.809558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-workload-certs\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.809817 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.809783    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istiod-ca-cert\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.809817 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.809813    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-data\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.809999 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.809981    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-credential-socket\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.811666 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.811641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-envoy\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.811873 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.811855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-podinfo\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.816314 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.816293    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-token\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.816620 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.816604    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcbxh\" (UniqueName: \"kubernetes.io/projected/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-kube-api-access-jcbxh\") pod \"e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") " pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:55.908096 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:55.907990    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:56.184183 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:56.184158    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"]
Sep 08 15:18:56.186024 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:18:56.185977    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4cbd9e9_3ac0_4e61_b127_4c43d57c8f01.slice/crio-b399c7086b300364ef9f2d01f51abc2bf2b0db4bf4118a5a2fe5ef5da22859c2 WatchSource:0}: Error finding container b399c7086b300364ef9f2d01f51abc2bf2b0db4bf4118a5a2fe5ef5da22859c2: Status 404 returned error can't find the container with id b399c7086b300364ef9f2d01f51abc2bf2b0db4bf4118a5a2fe5ef5da22859c2
Sep 08 15:18:56.188491 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:56.188457    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:18:56.188583 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:56.188558    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:18:56.188629 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:56.188590    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:18:56.684866 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:56.684827    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v" event={"ID":"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01","Type":"ContainerStarted","Data":"dbf7ee6d87423488b34ffc6427798bf878c0b0bd5862d171f1196da26502bd02"}
Sep 08 15:18:56.685308 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:56.684884    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v" event={"ID":"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01","Type":"ContainerStarted","Data":"b399c7086b300364ef9f2d01f51abc2bf2b0db4bf4118a5a2fe5ef5da22859c2"}
Sep 08 15:18:56.705670 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:56.705603    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v" podStartSLOduration=1.7055814009999999 podStartE2EDuration="1.705581401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:56.703462218 +0000 UTC m=+1416.035701765" watchObservedRunningTime="2026-09-08 15:18:56.705581401 +0000 UTC m=+1416.037820950"
Sep 08 15:18:56.909028 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:56.908993    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:57.914200 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:57.914170    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:58.698082 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:58.698054    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:18:58.699152 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:18:58.699088    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:19:09.606207 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:09.606168    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:19:19.835827 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:19.835792    2580 generic.go:356] "Generic (PLEG): container finished" podID="a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" containerID="dbf7ee6d87423488b34ffc6427798bf878c0b0bd5862d171f1196da26502bd02" exitCode=0
Sep 08 15:19:19.836285 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:19.835860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v" event={"ID":"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01","Type":"ContainerDied","Data":"dbf7ee6d87423488b34ffc6427798bf878c0b0bd5862d171f1196da26502bd02"}
Sep 08 15:19:19.836358 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:19.836286    2580 scope.go:117] "RemoveContainer" containerID="dbf7ee6d87423488b34ffc6427798bf878c0b0bd5862d171f1196da26502bd02"
Sep 08 15:19:19.837426 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:19.837393    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:19:19.837528 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:19.837460    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:19:19.837528 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:19.837492    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:19:20.848735 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:20.848691    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v" event={"ID":"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01","Type":"ContainerStarted","Data":"67ac3593729c56635f57506d1afd6ad1b794b4db3140b0067ddc95084453dca9"}
Sep 08 15:19:20.908333 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:20.908295    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:19:20.908546 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:20.908489    2580 patch_prober.go:28] interesting pod/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 08 15:19:20.908636 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:20.908574    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v" podUID="a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 08 15:19:21.348555 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:21.348495    2580 scope.go:117] "RemoveContainer" containerID="10b0a848590a709db2191d3cfc8c35ec997ccb411530e0c83caa863b44cace16"
Sep 08 15:19:21.359597 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:21.359574    2580 scope.go:117] "RemoveContainer" containerID="f7dbd1d93fab8ef045a634d210b9702a1bb842757b36775e57215bfa79a84986"
Sep 08 15:19:21.370091 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:21.370066    2580 scope.go:117] "RemoveContainer" containerID="06a44e6c6ff6df087737d9c3af78efc55aa7c5efb1df91df5120c61fd6e4a3a3"
Sep 08 15:19:21.909358 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:21.909326    2580 patch_prober.go:28] interesting pod/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 08 15:19:21.909870 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:21.909385    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v" podUID="a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 08 15:19:22.908532 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:22.908468    2580 patch_prober.go:28] interesting pod/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 08 15:19:22.908721 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:22.908560    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v" podUID="a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 08 15:19:23.909096 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:23.909057    2580 patch_prober.go:28] interesting pod/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 08 15:19:23.909487 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:23.909114    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v" podUID="a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 08 15:19:24.909162 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:24.909119    2580 patch_prober.go:28] interesting pod/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 08 15:19:24.909698 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:24.909205    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v" podUID="a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 08 15:19:26.070443 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:26.070402    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:19:26.071147 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:26.071126    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:19:26.072185 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:26.072164    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:19:26.541375 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:26.541343    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ccde3-grq64"]
Sep 08 15:19:26.546518 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:26.546485    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ccde3-grq64"
Sep 08 15:19:26.549227 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:26.549195    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:19:26.549958 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:26.549934    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:19:26.552497 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:26.552469    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ccde3-grq64"]
Sep 08 15:19:26.659161 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:26.659122    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/577e69e0-afa6-428d-a423-0c78366d834e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3ccde3-grq64\" (UID: \"577e69e0-afa6-428d-a423-0c78366d834e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ccde3-grq64"
Sep 08 15:19:26.759954 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:26.759917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/577e69e0-afa6-428d-a423-0c78366d834e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3ccde3-grq64\" (UID: \"577e69e0-afa6-428d-a423-0c78366d834e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ccde3-grq64"
Sep 08 15:19:26.760591 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:26.760571    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/577e69e0-afa6-428d-a423-0c78366d834e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3ccde3-grq64\" (UID: \"577e69e0-afa6-428d-a423-0c78366d834e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ccde3-grq64"
Sep 08 15:19:26.859243 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:26.859148    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ccde3-grq64"
Sep 08 15:19:27.130986 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:27.130958    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ccde3-grq64"]
Sep 08 15:19:27.132735 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:19:27.132707    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577e69e0_afa6_428d_a423_0c78366d834e.slice/crio-958e4b2eb3e3ea573a23dd6cda891f5ad1e9b4e7f2241dafbbb8abe90e9d95cd WatchSource:0}: Error finding container 958e4b2eb3e3ea573a23dd6cda891f5ad1e9b4e7f2241dafbbb8abe90e9d95cd: Status 404 returned error can't find the container with id 958e4b2eb3e3ea573a23dd6cda891f5ad1e9b4e7f2241dafbbb8abe90e9d95cd
Sep 08 15:19:27.894692 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:27.894658    2580 generic.go:356] "Generic (PLEG): container finished" podID="577e69e0-afa6-428d-a423-0c78366d834e" containerID="4cca5f1d31c156831b1c9e8cbe2417307e62f13cc31da51147f2c15c4904983e" exitCode=0
Sep 08 15:19:27.894884 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:27.894741    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ccde3-grq64" event={"ID":"577e69e0-afa6-428d-a423-0c78366d834e","Type":"ContainerDied","Data":"4cca5f1d31c156831b1c9e8cbe2417307e62f13cc31da51147f2c15c4904983e"}
Sep 08 15:19:27.894884 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:27.894798    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ccde3-grq64" event={"ID":"577e69e0-afa6-428d-a423-0c78366d834e","Type":"ContainerStarted","Data":"958e4b2eb3e3ea573a23dd6cda891f5ad1e9b4e7f2241dafbbb8abe90e9d95cd"}
Sep 08 15:19:29.046163 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:29.046136    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ccde3-grq64"
Sep 08 15:19:29.186017 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:29.185935    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/577e69e0-afa6-428d-a423-0c78366d834e-maas-api-service-ca\") pod \"577e69e0-afa6-428d-a423-0c78366d834e\" (UID: \"577e69e0-afa6-428d-a423-0c78366d834e\") "
Sep 08 15:19:29.186284 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:29.186259    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/577e69e0-afa6-428d-a423-0c78366d834e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "577e69e0-afa6-428d-a423-0c78366d834e" (UID: "577e69e0-afa6-428d-a423-0c78366d834e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:19:29.287735 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:29.287695    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/577e69e0-afa6-428d-a423-0c78366d834e-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:19:29.325446 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:29.325400    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:19:29.908387 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:29.908356    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ccde3-grq64"
Sep 08 15:19:29.908592 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:29.908401    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ccde3-grq64" event={"ID":"577e69e0-afa6-428d-a423-0c78366d834e","Type":"ContainerDied","Data":"958e4b2eb3e3ea573a23dd6cda891f5ad1e9b4e7f2241dafbbb8abe90e9d95cd"}
Sep 08 15:19:29.908592 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:29.908447    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="958e4b2eb3e3ea573a23dd6cda891f5ad1e9b4e7f2241dafbbb8abe90e9d95cd"
Sep 08 15:19:42.462158 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.462122    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"]
Sep 08 15:19:42.463021 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.462355    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7" podUID="acfd0c5f-825e-4c4f-84aa-23254b9ce235" containerName="payload-pre-processing" containerID="cri-o://16c57d723640ec327f8aa3b28783b06a7cff6637806362647f846f0fd50f1034" gracePeriod=30
Sep 08 15:19:42.634271 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.634235    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ccde3-grq64"]
Sep 08 15:19:42.637472 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.637446    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ccde3-grq64"]
Sep 08 15:19:42.725566 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.725531    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"
Sep 08 15:19:42.831781 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.831732    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl6kb\" (UniqueName: \"kubernetes.io/projected/acfd0c5f-825e-4c4f-84aa-23254b9ce235-kube-api-access-pl6kb\") pod \"acfd0c5f-825e-4c4f-84aa-23254b9ce235\" (UID: \"acfd0c5f-825e-4c4f-84aa-23254b9ce235\") "
Sep 08 15:19:42.831982 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.831952    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acfd0c5f-825e-4c4f-84aa-23254b9ce235-plugins-config-volume\") pod \"acfd0c5f-825e-4c4f-84aa-23254b9ce235\" (UID: \"acfd0c5f-825e-4c4f-84aa-23254b9ce235\") "
Sep 08 15:19:42.832307 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.832274    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acfd0c5f-825e-4c4f-84aa-23254b9ce235-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "acfd0c5f-825e-4c4f-84aa-23254b9ce235" (UID: "acfd0c5f-825e-4c4f-84aa-23254b9ce235"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:19:42.834114 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.834078    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acfd0c5f-825e-4c4f-84aa-23254b9ce235-kube-api-access-pl6kb" (OuterVolumeSpecName: "kube-api-access-pl6kb") pod "acfd0c5f-825e-4c4f-84aa-23254b9ce235" (UID: "acfd0c5f-825e-4c4f-84aa-23254b9ce235"). InnerVolumeSpecName "kube-api-access-pl6kb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:19:42.933256 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.933212    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acfd0c5f-825e-4c4f-84aa-23254b9ce235-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:19:42.933256 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.933257    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl6kb\" (UniqueName: \"kubernetes.io/projected/acfd0c5f-825e-4c4f-84aa-23254b9ce235-kube-api-access-pl6kb\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:19:42.988022 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.987926    2580 generic.go:356] "Generic (PLEG): container finished" podID="acfd0c5f-825e-4c4f-84aa-23254b9ce235" containerID="16c57d723640ec327f8aa3b28783b06a7cff6637806362647f846f0fd50f1034" exitCode=0
Sep 08 15:19:42.988022 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.987967    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"
Sep 08 15:19:42.988268 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.988014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7" event={"ID":"acfd0c5f-825e-4c4f-84aa-23254b9ce235","Type":"ContainerDied","Data":"16c57d723640ec327f8aa3b28783b06a7cff6637806362647f846f0fd50f1034"}
Sep 08 15:19:42.988268 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.988082    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7" event={"ID":"acfd0c5f-825e-4c4f-84aa-23254b9ce235","Type":"ContainerDied","Data":"59ccb4ecf157987a50c130cb8b1e550d856cad55579986e6c222ccb4e463f9f0"}
Sep 08 15:19:42.988268 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.988116    2580 scope.go:117] "RemoveContainer" containerID="16c57d723640ec327f8aa3b28783b06a7cff6637806362647f846f0fd50f1034"
Sep 08 15:19:42.998618 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:42.998534    2580 scope.go:117] "RemoveContainer" containerID="16c57d723640ec327f8aa3b28783b06a7cff6637806362647f846f0fd50f1034"
Sep 08 15:19:43.000787 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:19:43.000765    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16c57d723640ec327f8aa3b28783b06a7cff6637806362647f846f0fd50f1034\": container with ID starting with 16c57d723640ec327f8aa3b28783b06a7cff6637806362647f846f0fd50f1034 not found: ID does not exist" containerID="16c57d723640ec327f8aa3b28783b06a7cff6637806362647f846f0fd50f1034"
Sep 08 15:19:43.000904 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:43.000797    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16c57d723640ec327f8aa3b28783b06a7cff6637806362647f846f0fd50f1034"} err="failed to get container status \"16c57d723640ec327f8aa3b28783b06a7cff6637806362647f846f0fd50f1034\": rpc error: code = NotFound desc = could not find container \"16c57d723640ec327f8aa3b28783b06a7cff6637806362647f846f0fd50f1034\": container with ID starting with 16c57d723640ec327f8aa3b28783b06a7cff6637806362647f846f0fd50f1034 not found: ID does not exist"
Sep 08 15:19:43.011499 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:43.011472    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"]
Sep 08 15:19:43.016286 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:43.016252    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3ccde3-d5cdc47f4-lx8n7"]
Sep 08 15:19:43.157249 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:43.157214    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="577e69e0-afa6-428d-a423-0c78366d834e" path="/var/lib/kubelet/pods/577e69e0-afa6-428d-a423-0c78366d834e/volumes"
Sep 08 15:19:43.157630 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:43.157616    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acfd0c5f-825e-4c4f-84aa-23254b9ce235" path="/var/lib/kubelet/pods/acfd0c5f-825e-4c4f-84aa-23254b9ce235/volumes"
Sep 08 15:19:47.320564 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:47.320524    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:19:49.620110 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:49.620071    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"]
Sep 08 15:19:49.620762 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:49.620320    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl" podUID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" containerName="istio-proxy" containerID="cri-o://6ef1f481159a70df377824c440e1263e4bd42bf248b3a65708c06913ca33625c" gracePeriod=30
Sep 08 15:19:50.001830 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.001792    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd"]
Sep 08 15:19:50.002317 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.002298    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acfd0c5f-825e-4c4f-84aa-23254b9ce235" containerName="payload-pre-processing"
Sep 08 15:19:50.002416 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.002319    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="acfd0c5f-825e-4c4f-84aa-23254b9ce235" containerName="payload-pre-processing"
Sep 08 15:19:50.002416 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.002367    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577e69e0-afa6-428d-a423-0c78366d834e" containerName="revoke-keys"
Sep 08 15:19:50.002416 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.002377    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="577e69e0-afa6-428d-a423-0c78366d834e" containerName="revoke-keys"
Sep 08 15:19:50.002592 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.002493    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="577e69e0-afa6-428d-a423-0c78366d834e" containerName="revoke-keys"
Sep 08 15:19:50.002592 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.002525    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="acfd0c5f-825e-4c4f-84aa-23254b9ce235" containerName="payload-pre-processing"
Sep 08 15:19:50.007154 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.007130    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd"
Sep 08 15:19:50.009743 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.009713    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:19:50.009870 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.009782    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:19:50.014008 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.013980    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd"]
Sep 08 15:19:50.112774 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.112727    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3441a17-908e-4fba-986a-cb3e83846a4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd\" (UID: \"b3441a17-908e-4fba-986a-cb3e83846a4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd"
Sep 08 15:19:50.214412 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.214369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3441a17-908e-4fba-986a-cb3e83846a4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd\" (UID: \"b3441a17-908e-4fba-986a-cb3e83846a4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd"
Sep 08 15:19:50.215129 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.215110    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3441a17-908e-4fba-986a-cb3e83846a4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd\" (UID: \"b3441a17-908e-4fba-986a-cb3e83846a4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd"
Sep 08 15:19:50.318827 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.318726    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd"
Sep 08 15:19:50.598504 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.598475    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd"]
Sep 08 15:19:50.601187 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:19:50.601157    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3441a17_908e_4fba_986a_cb3e83846a4c.slice/crio-3a4fd4adfc3417c0d3dd2356fef37413323e4867ee1046c22fc441b56a077cb0 WatchSource:0}: Error finding container 3a4fd4adfc3417c0d3dd2356fef37413323e4867ee1046c22fc441b56a077cb0: Status 404 returned error can't find the container with id 3a4fd4adfc3417c0d3dd2356fef37413323e4867ee1046c22fc441b56a077cb0
Sep 08 15:19:50.963636 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.963597    2580 patch_prober.go:28] interesting pod/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:19:50.964008 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:50.963657    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl" podUID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:19:51.048698 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:51.048664    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd" event={"ID":"b3441a17-908e-4fba-986a-cb3e83846a4c","Type":"ContainerStarted","Data":"4fada9374965b8396edec5efe45e40afa6770593bf6d228007b4fd426f9e6a24"}
Sep 08 15:19:51.048830 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:51.048727    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd" event={"ID":"b3441a17-908e-4fba-986a-cb3e83846a4c","Type":"ContainerStarted","Data":"3a4fd4adfc3417c0d3dd2356fef37413323e4867ee1046c22fc441b56a077cb0"}
Sep 08 15:19:51.065381 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:51.065330    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd" podStartSLOduration=2.065312642 podStartE2EDuration="2.065312642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:19:51.063085907 +0000 UTC m=+1470.395325455" watchObservedRunningTime="2026-09-08 15:19:51.065312642 +0000 UTC m=+1470.397552223"
Sep 08 15:19:52.055811 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:52.055779    2580 generic.go:356] "Generic (PLEG): container finished" podID="b3441a17-908e-4fba-986a-cb3e83846a4c" containerID="4fada9374965b8396edec5efe45e40afa6770593bf6d228007b4fd426f9e6a24" exitCode=0
Sep 08 15:19:52.056229 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:52.055877    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd" event={"ID":"b3441a17-908e-4fba-986a-cb3e83846a4c","Type":"ContainerDied","Data":"4fada9374965b8396edec5efe45e40afa6770593bf6d228007b4fd426f9e6a24"}
Sep 08 15:19:53.199917 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:53.199891    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd"
Sep 08 15:19:53.248505 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:53.248472    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3441a17-908e-4fba-986a-cb3e83846a4c-maas-api-service-ca\") pod \"b3441a17-908e-4fba-986a-cb3e83846a4c\" (UID: \"b3441a17-908e-4fba-986a-cb3e83846a4c\") "
Sep 08 15:19:53.248951 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:53.248922    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3441a17-908e-4fba-986a-cb3e83846a4c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b3441a17-908e-4fba-986a-cb3e83846a4c" (UID: "b3441a17-908e-4fba-986a-cb3e83846a4c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:19:53.349933 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:53.349835    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3441a17-908e-4fba-986a-cb3e83846a4c-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:19:54.068841 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.068806    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd" event={"ID":"b3441a17-908e-4fba-986a-cb3e83846a4c","Type":"ContainerDied","Data":"3a4fd4adfc3417c0d3dd2356fef37413323e4867ee1046c22fc441b56a077cb0"}
Sep 08 15:19:54.069020 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.068862    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a4fd4adfc3417c0d3dd2356fef37413323e4867ee1046c22fc441b56a077cb0"
Sep 08 15:19:54.069020 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.068820    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd"
Sep 08 15:19:54.879974 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.879914    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:19:54.965426 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.965383    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-envoy\") pod \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") "
Sep 08 15:19:54.965611 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.965447    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcltf\" (UniqueName: \"kubernetes.io/projected/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-kube-api-access-bcltf\") pod \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") "
Sep 08 15:19:54.965611 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.965492    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-workload-socket\") pod \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") "
Sep 08 15:19:54.965611 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.965562    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-token\") pod \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") "
Sep 08 15:19:54.965611 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.965592    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-workload-certs\") pod \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") "
Sep 08 15:19:54.965802 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.965620    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-podinfo\") pod \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") "
Sep 08 15:19:54.965802 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.965700    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-credential-socket\") pod \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") "
Sep 08 15:19:54.965802 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.965740    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-data\") pod \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") "
Sep 08 15:19:54.965802 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.965778    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istiod-ca-cert\") pod \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\" (UID: \"19a9de90-de0a-4d20-a6a5-a80cd02f13ff\") "
Sep 08 15:19:54.965991 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.965860    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19a9de90-de0a-4d20-a6a5-a80cd02f13ff" (UID: "19a9de90-de0a-4d20-a6a5-a80cd02f13ff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:19:54.966090 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.966051    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19a9de90-de0a-4d20-a6a5-a80cd02f13ff" (UID: "19a9de90-de0a-4d20-a6a5-a80cd02f13ff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:19:54.966195 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.966173    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19a9de90-de0a-4d20-a6a5-a80cd02f13ff" (UID: "19a9de90-de0a-4d20-a6a5-a80cd02f13ff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:19:54.966280 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.966239    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:19:54.966333 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.966294    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:19:54.966333 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.966254    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-data" (OuterVolumeSpecName: "istio-data") pod "19a9de90-de0a-4d20-a6a5-a80cd02f13ff" (UID: "19a9de90-de0a-4d20-a6a5-a80cd02f13ff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:19:54.966441 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.966361    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19a9de90-de0a-4d20-a6a5-a80cd02f13ff" (UID: "19a9de90-de0a-4d20-a6a5-a80cd02f13ff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:19:54.967743 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.967717    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19a9de90-de0a-4d20-a6a5-a80cd02f13ff" (UID: "19a9de90-de0a-4d20-a6a5-a80cd02f13ff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:19:54.968102 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.968071    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19a9de90-de0a-4d20-a6a5-a80cd02f13ff" (UID: "19a9de90-de0a-4d20-a6a5-a80cd02f13ff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:19:54.968102 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.968091    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-token" (OuterVolumeSpecName: "istio-token") pod "19a9de90-de0a-4d20-a6a5-a80cd02f13ff" (UID: "19a9de90-de0a-4d20-a6a5-a80cd02f13ff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:19:54.968225 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:54.968072    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-kube-api-access-bcltf" (OuterVolumeSpecName: "kube-api-access-bcltf") pod "19a9de90-de0a-4d20-a6a5-a80cd02f13ff" (UID: "19a9de90-de0a-4d20-a6a5-a80cd02f13ff"). InnerVolumeSpecName "kube-api-access-bcltf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:19:55.066831 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.066799    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:19:55.066831 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.066828    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:19:55.066831 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.066839    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:19:55.067058 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.066847    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:19:55.067058 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.066855    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcltf\" (UniqueName: \"kubernetes.io/projected/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-kube-api-access-bcltf\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:19:55.067058 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.066864    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:19:55.067058 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.066871    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19a9de90-de0a-4d20-a6a5-a80cd02f13ff-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:19:55.076636 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.076600    2580 generic.go:356] "Generic (PLEG): container finished" podID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" containerID="6ef1f481159a70df377824c440e1263e4bd42bf248b3a65708c06913ca33625c" exitCode=0
Sep 08 15:19:55.076787 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.076655    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"
Sep 08 15:19:55.076787 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.076724    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl" event={"ID":"19a9de90-de0a-4d20-a6a5-a80cd02f13ff","Type":"ContainerDied","Data":"6ef1f481159a70df377824c440e1263e4bd42bf248b3a65708c06913ca33625c"}
Sep 08 15:19:55.076890 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.076812    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl" event={"ID":"19a9de90-de0a-4d20-a6a5-a80cd02f13ff","Type":"ContainerDied","Data":"6198d565072b522b97fac3bedb20b627bee2ebc450d5ccf6a3d1c44db97971fa"}
Sep 08 15:19:55.076890 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.076841    2580 scope.go:117] "RemoveContainer" containerID="6ef1f481159a70df377824c440e1263e4bd42bf248b3a65708c06913ca33625c"
Sep 08 15:19:55.090466 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.090282    2580 scope.go:117] "RemoveContainer" containerID="f8c2508cecacde658a00464497d997a6d913a9b064b7f001b2b3d7023b692ab9"
Sep 08 15:19:55.101056 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.101034    2580 scope.go:117] "RemoveContainer" containerID="6ef1f481159a70df377824c440e1263e4bd42bf248b3a65708c06913ca33625c"
Sep 08 15:19:55.101334 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:19:55.101312    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ef1f481159a70df377824c440e1263e4bd42bf248b3a65708c06913ca33625c\": container with ID starting with 6ef1f481159a70df377824c440e1263e4bd42bf248b3a65708c06913ca33625c not found: ID does not exist" containerID="6ef1f481159a70df377824c440e1263e4bd42bf248b3a65708c06913ca33625c"
Sep 08 15:19:55.101409 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.101347    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef1f481159a70df377824c440e1263e4bd42bf248b3a65708c06913ca33625c"} err="failed to get container status \"6ef1f481159a70df377824c440e1263e4bd42bf248b3a65708c06913ca33625c\": rpc error: code = NotFound desc = could not find container \"6ef1f481159a70df377824c440e1263e4bd42bf248b3a65708c06913ca33625c\": container with ID starting with 6ef1f481159a70df377824c440e1263e4bd42bf248b3a65708c06913ca33625c not found: ID does not exist"
Sep 08 15:19:55.101409 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.101370    2580 scope.go:117] "RemoveContainer" containerID="f8c2508cecacde658a00464497d997a6d913a9b064b7f001b2b3d7023b692ab9"
Sep 08 15:19:55.101643 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:19:55.101627    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8c2508cecacde658a00464497d997a6d913a9b064b7f001b2b3d7023b692ab9\": container with ID starting with f8c2508cecacde658a00464497d997a6d913a9b064b7f001b2b3d7023b692ab9 not found: ID does not exist" containerID="f8c2508cecacde658a00464497d997a6d913a9b064b7f001b2b3d7023b692ab9"
Sep 08 15:19:55.101697 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.101651    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c2508cecacde658a00464497d997a6d913a9b064b7f001b2b3d7023b692ab9"} err="failed to get container status \"f8c2508cecacde658a00464497d997a6d913a9b064b7f001b2b3d7023b692ab9\": rpc error: code = NotFound desc = could not find container \"f8c2508cecacde658a00464497d997a6d913a9b064b7f001b2b3d7023b692ab9\": container with ID starting with f8c2508cecacde658a00464497d997a6d913a9b064b7f001b2b3d7023b692ab9 not found: ID does not exist"
Sep 08 15:19:55.107966 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.107941    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"]
Sep 08 15:19:55.109102 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:19:55.109078    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a9de90_de0a_4d20_a6a5_a80cd02f13ff.slice\": RecentStats: unable to find data in memory cache]"
Sep 08 15:19:55.111456 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.111435    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-3ccde3-openshift-default-65b697c74b-lffdl"]
Sep 08 15:19:55.157084 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:19:55.157016    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" path="/var/lib/kubelet/pods/19a9de90-de0a-4d20-a6a5-a80cd02f13ff/volumes"
Sep 08 15:20:02.904607 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:02.904568    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:20:06.177419 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:06.177380    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd"]
Sep 08 15:20:06.181741 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:06.181715    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da0d1-9v4bd"]
Sep 08 15:20:07.156313 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:07.156275    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3441a17-908e-4fba-986a-cb3e83846a4c" path="/var/lib/kubelet/pods/b3441a17-908e-4fba-986a-cb3e83846a4c/volumes"
Sep 08 15:20:12.879357 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:12.879319    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"]
Sep 08 15:20:12.879866 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:12.879666    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v" podUID="a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" containerName="istio-proxy" containerID="cri-o://67ac3593729c56635f57506d1afd6ad1b794b4db3140b0067ddc95084453dca9" gracePeriod=30
Sep 08 15:20:13.237408 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.237370    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4"]
Sep 08 15:20:13.237819 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.237806    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" containerName="istio-proxy"
Sep 08 15:20:13.237871 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.237821    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" containerName="istio-proxy"
Sep 08 15:20:13.237871 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.237829    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3441a17-908e-4fba-986a-cb3e83846a4c" containerName="revoke-keys"
Sep 08 15:20:13.237871 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.237835    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3441a17-908e-4fba-986a-cb3e83846a4c" containerName="revoke-keys"
Sep 08 15:20:13.237871 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.237857    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" containerName="istio-proxy"
Sep 08 15:20:13.237871 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.237863    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" containerName="istio-proxy"
Sep 08 15:20:13.238025 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.237923    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3441a17-908e-4fba-986a-cb3e83846a4c" containerName="revoke-keys"
Sep 08 15:20:13.238025 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.237933    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" containerName="istio-proxy"
Sep 08 15:20:13.242858 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.242838    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4"
Sep 08 15:20:13.245493 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.245466    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:20:13.245628 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.245499    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:20:13.249724 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.249698    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4"]
Sep 08 15:20:13.258933 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.258902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c86075-0f10-40ee-bd38-0be6cd31c4a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4\" (UID: \"f4c86075-0f10-40ee-bd38-0be6cd31c4a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4"
Sep 08 15:20:13.360263 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.360218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c86075-0f10-40ee-bd38-0be6cd31c4a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4\" (UID: \"f4c86075-0f10-40ee-bd38-0be6cd31c4a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4"
Sep 08 15:20:13.360946 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.360922    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c86075-0f10-40ee-bd38-0be6cd31c4a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4\" (UID: \"f4c86075-0f10-40ee-bd38-0be6cd31c4a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4"
Sep 08 15:20:13.555994 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.555891    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4"
Sep 08 15:20:13.829959 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:13.829931    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4"]
Sep 08 15:20:13.831715 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:20:13.831688    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c86075_0f10_40ee_bd38_0be6cd31c4a5.slice/crio-d02852a1eb839bf7f05322576003f835a032e3e4727cb5d0072d2236f1a3362d WatchSource:0}: Error finding container d02852a1eb839bf7f05322576003f835a032e3e4727cb5d0072d2236f1a3362d: Status 404 returned error can't find the container with id d02852a1eb839bf7f05322576003f835a032e3e4727cb5d0072d2236f1a3362d
Sep 08 15:20:14.192088 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:14.192048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4" event={"ID":"f4c86075-0f10-40ee-bd38-0be6cd31c4a5","Type":"ContainerStarted","Data":"bf4436b842385cea6c8da319e2994b013a17c237a55ed54948f6b5f3d820e8ec"}
Sep 08 15:20:14.192447 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:14.192115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4" event={"ID":"f4c86075-0f10-40ee-bd38-0be6cd31c4a5","Type":"ContainerStarted","Data":"d02852a1eb839bf7f05322576003f835a032e3e4727cb5d0072d2236f1a3362d"}
Sep 08 15:20:14.208814 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:14.208769    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4" podStartSLOduration=1.208752335 podStartE2EDuration="1.208752335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:14.207641562 +0000 UTC m=+1493.539881109" watchObservedRunningTime="2026-09-08 15:20:14.208752335 +0000 UTC m=+1493.540992075"
Sep 08 15:20:15.200199 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:15.200165    2580 generic.go:356] "Generic (PLEG): container finished" podID="f4c86075-0f10-40ee-bd38-0be6cd31c4a5" containerID="bf4436b842385cea6c8da319e2994b013a17c237a55ed54948f6b5f3d820e8ec" exitCode=0
Sep 08 15:20:15.200586 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:15.200250    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4" event={"ID":"f4c86075-0f10-40ee-bd38-0be6cd31c4a5","Type":"ContainerDied","Data":"bf4436b842385cea6c8da319e2994b013a17c237a55ed54948f6b5f3d820e8ec"}
Sep 08 15:20:16.344080 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:16.344053    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4"
Sep 08 15:20:16.391032 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:16.391000    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c86075-0f10-40ee-bd38-0be6cd31c4a5-maas-api-service-ca\") pod \"f4c86075-0f10-40ee-bd38-0be6cd31c4a5\" (UID: \"f4c86075-0f10-40ee-bd38-0be6cd31c4a5\") "
Sep 08 15:20:16.391368 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:16.391344    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4c86075-0f10-40ee-bd38-0be6cd31c4a5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f4c86075-0f10-40ee-bd38-0be6cd31c4a5" (UID: "f4c86075-0f10-40ee-bd38-0be6cd31c4a5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:20:16.492014 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:16.491984    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c86075-0f10-40ee-bd38-0be6cd31c4a5-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:17.212382 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:17.212355    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4"
Sep 08 15:20:17.212575 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:17.212397    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4" event={"ID":"f4c86075-0f10-40ee-bd38-0be6cd31c4a5","Type":"ContainerDied","Data":"d02852a1eb839bf7f05322576003f835a032e3e4727cb5d0072d2236f1a3362d"}
Sep 08 15:20:17.212575 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:17.212442    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d02852a1eb839bf7f05322576003f835a032e3e4727cb5d0072d2236f1a3362d"
Sep 08 15:20:18.140585 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.140556    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:20:18.210063 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.209980    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istiod-ca-cert\") pod \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") "
Sep 08 15:20:18.210063 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210036    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-data\") pod \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") "
Sep 08 15:20:18.210063 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210063    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-token\") pod \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") "
Sep 08 15:20:18.210336 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210085    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-envoy\") pod \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") "
Sep 08 15:20:18.210336 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210103    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-podinfo\") pod \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") "
Sep 08 15:20:18.210336 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210128    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcbxh\" (UniqueName: \"kubernetes.io/projected/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-kube-api-access-jcbxh\") pod \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") "
Sep 08 15:20:18.210336 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210166    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-workload-certs\") pod \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") "
Sep 08 15:20:18.210336 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210212    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-credential-socket\") pod \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") "
Sep 08 15:20:18.210336 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210266    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-workload-socket\") pod \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\" (UID: \"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01\") "
Sep 08 15:20:18.210696 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210387    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" (UID: "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:20:18.210696 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210601    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-data" (OuterVolumeSpecName: "istio-data") pod "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" (UID: "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:18.210696 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210609    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" (UID: "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:18.210696 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210617    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" (UID: "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:18.210913 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210788    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" (UID: "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:18.210913 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210847    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:18.210913 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210863    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:18.210913 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210874    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:18.210913 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.210885    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:18.212576 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.212487    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" (UID: "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:18.212576 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.212540    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-kube-api-access-jcbxh" (OuterVolumeSpecName: "kube-api-access-jcbxh") pod "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" (UID: "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01"). InnerVolumeSpecName "kube-api-access-jcbxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:18.212851 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.212824    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" (UID: "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:20:18.212851 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.212836    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-token" (OuterVolumeSpecName: "istio-token") pod "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" (UID: "a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:18.220280 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.220259    2580 generic.go:356] "Generic (PLEG): container finished" podID="a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" containerID="67ac3593729c56635f57506d1afd6ad1b794b4db3140b0067ddc95084453dca9" exitCode=0
Sep 08 15:20:18.220369 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.220324    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"
Sep 08 15:20:18.220369 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.220349    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v" event={"ID":"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01","Type":"ContainerDied","Data":"67ac3593729c56635f57506d1afd6ad1b794b4db3140b0067ddc95084453dca9"}
Sep 08 15:20:18.220462 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.220416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v" event={"ID":"a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01","Type":"ContainerDied","Data":"b399c7086b300364ef9f2d01f51abc2bf2b0db4bf4118a5a2fe5ef5da22859c2"}
Sep 08 15:20:18.221501 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.220449    2580 scope.go:117] "RemoveContainer" containerID="67ac3593729c56635f57506d1afd6ad1b794b4db3140b0067ddc95084453dca9"
Sep 08 15:20:18.237573 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.237554    2580 scope.go:117] "RemoveContainer" containerID="dbf7ee6d87423488b34ffc6427798bf878c0b0bd5862d171f1196da26502bd02"
Sep 08 15:20:18.246075 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.246057    2580 scope.go:117] "RemoveContainer" containerID="67ac3593729c56635f57506d1afd6ad1b794b4db3140b0067ddc95084453dca9"
Sep 08 15:20:18.246340 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:20:18.246325    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67ac3593729c56635f57506d1afd6ad1b794b4db3140b0067ddc95084453dca9\": container with ID starting with 67ac3593729c56635f57506d1afd6ad1b794b4db3140b0067ddc95084453dca9 not found: ID does not exist" containerID="67ac3593729c56635f57506d1afd6ad1b794b4db3140b0067ddc95084453dca9"
Sep 08 15:20:18.246390 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.246346    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67ac3593729c56635f57506d1afd6ad1b794b4db3140b0067ddc95084453dca9"} err="failed to get container status \"67ac3593729c56635f57506d1afd6ad1b794b4db3140b0067ddc95084453dca9\": rpc error: code = NotFound desc = could not find container \"67ac3593729c56635f57506d1afd6ad1b794b4db3140b0067ddc95084453dca9\": container with ID starting with 67ac3593729c56635f57506d1afd6ad1b794b4db3140b0067ddc95084453dca9 not found: ID does not exist"
Sep 08 15:20:18.246390 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.246361    2580 scope.go:117] "RemoveContainer" containerID="dbf7ee6d87423488b34ffc6427798bf878c0b0bd5862d171f1196da26502bd02"
Sep 08 15:20:18.246620 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:20:18.246600    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbf7ee6d87423488b34ffc6427798bf878c0b0bd5862d171f1196da26502bd02\": container with ID starting with dbf7ee6d87423488b34ffc6427798bf878c0b0bd5862d171f1196da26502bd02 not found: ID does not exist" containerID="dbf7ee6d87423488b34ffc6427798bf878c0b0bd5862d171f1196da26502bd02"
Sep 08 15:20:18.246687 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.246631    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbf7ee6d87423488b34ffc6427798bf878c0b0bd5862d171f1196da26502bd02"} err="failed to get container status \"dbf7ee6d87423488b34ffc6427798bf878c0b0bd5862d171f1196da26502bd02\": rpc error: code = NotFound desc = could not find container \"dbf7ee6d87423488b34ffc6427798bf878c0b0bd5862d171f1196da26502bd02\": container with ID starting with dbf7ee6d87423488b34ffc6427798bf878c0b0bd5862d171f1196da26502bd02 not found: ID does not exist"
Sep 08 15:20:18.252651 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.252624    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"]
Sep 08 15:20:18.257009 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.256987    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-0da0d1-openshift-default-75747b45bb-9p59v"]
Sep 08 15:20:18.312206 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.312172    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:18.312206 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.312202    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:18.312206 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.312211    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:18.312425 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.312219    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcbxh\" (UniqueName: \"kubernetes.io/projected/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-kube-api-access-jcbxh\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:18.312425 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.312232    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:18.803534 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:18.803480    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:20:19.156781 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:19.156696    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" path="/var/lib/kubelet/pods/a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01/volumes"
Sep 08 15:20:21.182227 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:21.182193    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 15:20:21.185768 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:21.185748    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 15:20:21.401980 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:21.401952    2580 scope.go:117] "RemoveContainer" containerID="3767eaf3a79af0a7d5620cc0ee63535aee3aad52b8882f5ca58f88b12d38347a"
Sep 08 15:20:23.277283 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:23.277244    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"]
Sep 08 15:20:23.849029 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:23.848989    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6e5ca-29814675-4gkft"]
Sep 08 15:20:23.852146 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:23.852115    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f6e5ca-29814675-4gkft"]
Sep 08 15:20:23.874251 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:23.874217    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"]
Sep 08 15:20:23.874484 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:23.874455    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh" podUID="457913fb-0810-46e9-810b-48ac3767f7be" containerName="payload-processing" containerID="cri-o://2e9b1f89cb06e7500d28b6cf9f253753b7bbe5dd485680c054b71154281c8c44" gracePeriod=30
Sep 08 15:20:23.886014 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:23.885940    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"]
Sep 08 15:20:23.886773 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:23.886373    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl" podUID="7ef6e950-95dd-47e1-b886-0d2d0305cd59" containerName="payload-pre-processing" containerID="cri-o://4a48941096d895d439602b840db2d44f952c1fca1762394075093a6971a5a087" gracePeriod=30
Sep 08 15:20:24.043780 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.043738    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4"]
Sep 08 15:20:24.046805 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.046777    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f6e5ca-99tz4"]
Sep 08 15:20:24.206829 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.206747    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"
Sep 08 15:20:24.211771 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.211638    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"
Sep 08 15:20:24.257823 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.257781    2580 generic.go:356] "Generic (PLEG): container finished" podID="7ef6e950-95dd-47e1-b886-0d2d0305cd59" containerID="4a48941096d895d439602b840db2d44f952c1fca1762394075093a6971a5a087" exitCode=0
Sep 08 15:20:24.257823 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.257826    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"
Sep 08 15:20:24.258075 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.257822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl" event={"ID":"7ef6e950-95dd-47e1-b886-0d2d0305cd59","Type":"ContainerDied","Data":"4a48941096d895d439602b840db2d44f952c1fca1762394075093a6971a5a087"}
Sep 08 15:20:24.258075 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.257891    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl" event={"ID":"7ef6e950-95dd-47e1-b886-0d2d0305cd59","Type":"ContainerDied","Data":"a65125061602e98ab981e6c570a213d85f916a79a55e3626fb4819d0053f3d03"}
Sep 08 15:20:24.258075 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.257922    2580 scope.go:117] "RemoveContainer" containerID="4a48941096d895d439602b840db2d44f952c1fca1762394075093a6971a5a087"
Sep 08 15:20:24.259847 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.259812    2580 generic.go:356] "Generic (PLEG): container finished" podID="457913fb-0810-46e9-810b-48ac3767f7be" containerID="2e9b1f89cb06e7500d28b6cf9f253753b7bbe5dd485680c054b71154281c8c44" exitCode=0
Sep 08 15:20:24.259983 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.259867    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"
Sep 08 15:20:24.259983 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.259866    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh" event={"ID":"457913fb-0810-46e9-810b-48ac3767f7be","Type":"ContainerDied","Data":"2e9b1f89cb06e7500d28b6cf9f253753b7bbe5dd485680c054b71154281c8c44"}
Sep 08 15:20:24.260068 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.260015    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh" event={"ID":"457913fb-0810-46e9-810b-48ac3767f7be","Type":"ContainerDied","Data":"ae81110e9b0cbd337309bb5a62033d807056ce5cfb5b1c7645a7d7088eea9adb"}
Sep 08 15:20:24.267739 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.267714    2580 scope.go:117] "RemoveContainer" containerID="4a48941096d895d439602b840db2d44f952c1fca1762394075093a6971a5a087"
Sep 08 15:20:24.268054 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:20:24.268036    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a48941096d895d439602b840db2d44f952c1fca1762394075093a6971a5a087\": container with ID starting with 4a48941096d895d439602b840db2d44f952c1fca1762394075093a6971a5a087 not found: ID does not exist" containerID="4a48941096d895d439602b840db2d44f952c1fca1762394075093a6971a5a087"
Sep 08 15:20:24.268113 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.268065    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a48941096d895d439602b840db2d44f952c1fca1762394075093a6971a5a087"} err="failed to get container status \"4a48941096d895d439602b840db2d44f952c1fca1762394075093a6971a5a087\": rpc error: code = NotFound desc = could not find container \"4a48941096d895d439602b840db2d44f952c1fca1762394075093a6971a5a087\": container with ID starting with 4a48941096d895d439602b840db2d44f952c1fca1762394075093a6971a5a087 not found: ID does not exist"
Sep 08 15:20:24.268113 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.268083    2580 scope.go:117] "RemoveContainer" containerID="2e9b1f89cb06e7500d28b6cf9f253753b7bbe5dd485680c054b71154281c8c44"
Sep 08 15:20:24.271409 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.271388    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps6x7\" (UniqueName: \"kubernetes.io/projected/7ef6e950-95dd-47e1-b886-0d2d0305cd59-kube-api-access-ps6x7\") pod \"7ef6e950-95dd-47e1-b886-0d2d0305cd59\" (UID: \"7ef6e950-95dd-47e1-b886-0d2d0305cd59\") "
Sep 08 15:20:24.271526 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.271451    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjlbr\" (UniqueName: \"kubernetes.io/projected/457913fb-0810-46e9-810b-48ac3767f7be-kube-api-access-qjlbr\") pod \"457913fb-0810-46e9-810b-48ac3767f7be\" (UID: \"457913fb-0810-46e9-810b-48ac3767f7be\") "
Sep 08 15:20:24.271601 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.271587    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ef6e950-95dd-47e1-b886-0d2d0305cd59-plugins-config-volume\") pod \"7ef6e950-95dd-47e1-b886-0d2d0305cd59\" (UID: \"7ef6e950-95dd-47e1-b886-0d2d0305cd59\") "
Sep 08 15:20:24.271657 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.271626    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/457913fb-0810-46e9-810b-48ac3767f7be-plugins-config-volume\") pod \"457913fb-0810-46e9-810b-48ac3767f7be\" (UID: \"457913fb-0810-46e9-810b-48ac3767f7be\") "
Sep 08 15:20:24.272036 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.272008    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ef6e950-95dd-47e1-b886-0d2d0305cd59-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7ef6e950-95dd-47e1-b886-0d2d0305cd59" (UID: "7ef6e950-95dd-47e1-b886-0d2d0305cd59"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:20:24.272131 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.272071    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/457913fb-0810-46e9-810b-48ac3767f7be-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "457913fb-0810-46e9-810b-48ac3767f7be" (UID: "457913fb-0810-46e9-810b-48ac3767f7be"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:20:24.273915 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.273890    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/457913fb-0810-46e9-810b-48ac3767f7be-kube-api-access-qjlbr" (OuterVolumeSpecName: "kube-api-access-qjlbr") pod "457913fb-0810-46e9-810b-48ac3767f7be" (UID: "457913fb-0810-46e9-810b-48ac3767f7be"). InnerVolumeSpecName "kube-api-access-qjlbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:24.274094 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.274071    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ef6e950-95dd-47e1-b886-0d2d0305cd59-kube-api-access-ps6x7" (OuterVolumeSpecName: "kube-api-access-ps6x7") pod "7ef6e950-95dd-47e1-b886-0d2d0305cd59" (UID: "7ef6e950-95dd-47e1-b886-0d2d0305cd59"). InnerVolumeSpecName "kube-api-access-ps6x7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:24.277320 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.277303    2580 scope.go:117] "RemoveContainer" containerID="2e9b1f89cb06e7500d28b6cf9f253753b7bbe5dd485680c054b71154281c8c44"
Sep 08 15:20:24.277689 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:20:24.277626    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e9b1f89cb06e7500d28b6cf9f253753b7bbe5dd485680c054b71154281c8c44\": container with ID starting with 2e9b1f89cb06e7500d28b6cf9f253753b7bbe5dd485680c054b71154281c8c44 not found: ID does not exist" containerID="2e9b1f89cb06e7500d28b6cf9f253753b7bbe5dd485680c054b71154281c8c44"
Sep 08 15:20:24.277689 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.277661    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e9b1f89cb06e7500d28b6cf9f253753b7bbe5dd485680c054b71154281c8c44"} err="failed to get container status \"2e9b1f89cb06e7500d28b6cf9f253753b7bbe5dd485680c054b71154281c8c44\": rpc error: code = NotFound desc = could not find container \"2e9b1f89cb06e7500d28b6cf9f253753b7bbe5dd485680c054b71154281c8c44\": container with ID starting with 2e9b1f89cb06e7500d28b6cf9f253753b7bbe5dd485680c054b71154281c8c44 not found: ID does not exist"
Sep 08 15:20:24.373446 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.373406    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps6x7\" (UniqueName: \"kubernetes.io/projected/7ef6e950-95dd-47e1-b886-0d2d0305cd59-kube-api-access-ps6x7\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:24.373446 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.373437    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjlbr\" (UniqueName: \"kubernetes.io/projected/457913fb-0810-46e9-810b-48ac3767f7be-kube-api-access-qjlbr\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:24.373446 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.373447    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ef6e950-95dd-47e1-b886-0d2d0305cd59-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:24.373446 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.373455    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/457913fb-0810-46e9-810b-48ac3767f7be-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:24.581181 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.581150    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"]
Sep 08 15:20:24.585151 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.585125    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6e5ca-795dcb5c86-6kgpl"]
Sep 08 15:20:24.596996 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.596967    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"]
Sep 08 15:20:24.602895 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:24.602868    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f6e5ca-6767bcb445-hp8rh"]
Sep 08 15:20:25.157017 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.156984    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="457913fb-0810-46e9-810b-48ac3767f7be" path="/var/lib/kubelet/pods/457913fb-0810-46e9-810b-48ac3767f7be/volumes"
Sep 08 15:20:25.157347 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.157332    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b57e0eb-18b3-495e-9404-a4e76901c751" path="/var/lib/kubelet/pods/5b57e0eb-18b3-495e-9404-a4e76901c751/volumes"
Sep 08 15:20:25.157673 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.157659    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ef6e950-95dd-47e1-b886-0d2d0305cd59" path="/var/lib/kubelet/pods/7ef6e950-95dd-47e1-b886-0d2d0305cd59/volumes"
Sep 08 15:20:25.157956 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.157945    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4c86075-0f10-40ee-bd38-0be6cd31c4a5" path="/var/lib/kubelet/pods/f4c86075-0f10-40ee-bd38-0be6cd31c4a5/volumes"
Sep 08 15:20:25.984294 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.984256    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"]
Sep 08 15:20:25.984871 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.984854    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="457913fb-0810-46e9-810b-48ac3767f7be" containerName="payload-processing"
Sep 08 15:20:25.984938 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.984881    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="457913fb-0810-46e9-810b-48ac3767f7be" containerName="payload-processing"
Sep 08 15:20:25.984938 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.984901    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ef6e950-95dd-47e1-b886-0d2d0305cd59" containerName="payload-pre-processing"
Sep 08 15:20:25.984938 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.984910    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ef6e950-95dd-47e1-b886-0d2d0305cd59" containerName="payload-pre-processing"
Sep 08 15:20:25.984938 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.984920    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" containerName="istio-proxy"
Sep 08 15:20:25.984938 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.984929    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" containerName="istio-proxy"
Sep 08 15:20:25.985110 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.984960    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c86075-0f10-40ee-bd38-0be6cd31c4a5" containerName="revoke-keys"
Sep 08 15:20:25.985110 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.984969    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c86075-0f10-40ee-bd38-0be6cd31c4a5" containerName="revoke-keys"
Sep 08 15:20:25.985110 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.985056    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="457913fb-0810-46e9-810b-48ac3767f7be" containerName="payload-processing"
Sep 08 15:20:25.985110 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.985066    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c86075-0f10-40ee-bd38-0be6cd31c4a5" containerName="revoke-keys"
Sep 08 15:20:25.985110 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.985078    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" containerName="istio-proxy"
Sep 08 15:20:25.985110 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.985088    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" containerName="istio-proxy"
Sep 08 15:20:25.985110 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.985098    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ef6e950-95dd-47e1-b886-0d2d0305cd59" containerName="payload-pre-processing"
Sep 08 15:20:25.985110 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.985107    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a9de90-de0a-4d20-a6a5-a80cd02f13ff" containerName="istio-proxy"
Sep 08 15:20:26.000802 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:25.990078    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.001756 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.001493    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-bdd5c7-openshift-default-dockercfg-d7cdv\""
Sep 08 15:20:26.006842 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.006707    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"]
Sep 08 15:20:26.090435 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.090394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4lxn\" (UniqueName: \"kubernetes.io/projected/51ee169f-f921-44e2-89f3-5bbd93daaa41-kube-api-access-z4lxn\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.090621 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.090458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51ee169f-f921-44e2-89f3-5bbd93daaa41-istiod-ca-cert\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.090621 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.090544    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-podinfo\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.090621 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.090590    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-credential-socket\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.090814 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.090633    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-workload-socket\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.090814 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.090679    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-data\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.090814 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.090750    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-envoy\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.090814 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.090777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-workload-certs\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.090981 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.090831    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-token\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.191781 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.191746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4lxn\" (UniqueName: \"kubernetes.io/projected/51ee169f-f921-44e2-89f3-5bbd93daaa41-kube-api-access-z4lxn\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.191965 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.191806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51ee169f-f921-44e2-89f3-5bbd93daaa41-istiod-ca-cert\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.191965 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.191840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-podinfo\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.192087 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.191997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-credential-socket\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.192087 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.192047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-workload-socket\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.192222 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.192100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-data\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.192222 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.192181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-envoy\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.192222 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.192210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-workload-certs\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.192380 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.192270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-token\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.192493 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.192469    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-credential-socket\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.192896 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.192859    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-workload-socket\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.193162 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.193139    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-workload-certs\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.193255 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.193209    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51ee169f-f921-44e2-89f3-5bbd93daaa41-istiod-ca-cert\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.193404 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.193380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-data\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.195268 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.195180    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-podinfo\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.197262 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.197217    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-envoy\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.202014 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.201477    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-token\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.202304 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.201968    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4lxn\" (UniqueName: \"kubernetes.io/projected/51ee169f-f921-44e2-89f3-5bbd93daaa41-kube-api-access-z4lxn\") pod \"e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") " pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.316332 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.316229    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:26.596091 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.596066    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"]
Sep 08 15:20:26.598218 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:20:26.598190    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ee169f_f921_44e2_89f3_5bbd93daaa41.slice/crio-7939b37a9816acc8e848307f3256afd4ec1a86496fd04f5300213eab97a5c77f WatchSource:0}: Error finding container 7939b37a9816acc8e848307f3256afd4ec1a86496fd04f5300213eab97a5c77f: Status 404 returned error can't find the container with id 7939b37a9816acc8e848307f3256afd4ec1a86496fd04f5300213eab97a5c77f
Sep 08 15:20:26.600688 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.600643    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:20:26.600794 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.600739    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:20:26.600794 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:26.600782    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:20:27.285374 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:27.285330    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2" event={"ID":"51ee169f-f921-44e2-89f3-5bbd93daaa41","Type":"ContainerStarted","Data":"e00677d95f29c68baa86e26c2eb9ee37e305fb2db876f971cb499ae82c9208b3"}
Sep 08 15:20:27.285795 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:27.285393    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2" event={"ID":"51ee169f-f921-44e2-89f3-5bbd93daaa41","Type":"ContainerStarted","Data":"7939b37a9816acc8e848307f3256afd4ec1a86496fd04f5300213eab97a5c77f"}
Sep 08 15:20:27.308137 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:27.308083    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2" podStartSLOduration=2.30806653 podStartE2EDuration="2.30806653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:27.306012733 +0000 UTC m=+1506.638252279" watchObservedRunningTime="2026-09-08 15:20:27.30806653 +0000 UTC m=+1506.640306076"
Sep 08 15:20:27.317207 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:27.317175    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:27.319154 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:27.319128    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 08 15:20:27.319280 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:27.319181    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2" podUID="51ee169f-f921-44e2-89f3-5bbd93daaa41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 08 15:20:28.321223 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:28.321194    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:29.296448 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:29.296413    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:29.297603 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:29.297579    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:31.028427 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.028388    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"]
Sep 08 15:20:31.028963 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.028926    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" containerName="istio-proxy"
Sep 08 15:20:31.028963 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.028943    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4cbd9e9-3ac0-4e61-b127-4c43d57c8f01" containerName="istio-proxy"
Sep 08 15:20:31.032277 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.032260    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"
Sep 08 15:20:31.034733 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.034712    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-bdd5c7-dockercfg-d4rk9\""
Sep 08 15:20:31.034833 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.034729    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-bdd5c7\""
Sep 08 15:20:31.044060 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.044033    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"]
Sep 08 15:20:31.147532 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.147456    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64c506b8-fdef-4140-80d9-1d34e8aafa47-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h\" (UID: \"64c506b8-fdef-4140-80d9-1d34e8aafa47\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"
Sep 08 15:20:31.147723 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.147577    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwc6c\" (UniqueName: \"kubernetes.io/projected/64c506b8-fdef-4140-80d9-1d34e8aafa47-kube-api-access-wwc6c\") pod \"payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h\" (UID: \"64c506b8-fdef-4140-80d9-1d34e8aafa47\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"
Sep 08 15:20:31.248839 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.248798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64c506b8-fdef-4140-80d9-1d34e8aafa47-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h\" (UID: \"64c506b8-fdef-4140-80d9-1d34e8aafa47\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"
Sep 08 15:20:31.249048 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.248873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwc6c\" (UniqueName: \"kubernetes.io/projected/64c506b8-fdef-4140-80d9-1d34e8aafa47-kube-api-access-wwc6c\") pod \"payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h\" (UID: \"64c506b8-fdef-4140-80d9-1d34e8aafa47\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"
Sep 08 15:20:31.249650 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.249630    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64c506b8-fdef-4140-80d9-1d34e8aafa47-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h\" (UID: \"64c506b8-fdef-4140-80d9-1d34e8aafa47\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"
Sep 08 15:20:31.257227 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.257206    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwc6c\" (UniqueName: \"kubernetes.io/projected/64c506b8-fdef-4140-80d9-1d34e8aafa47-kube-api-access-wwc6c\") pod \"payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h\" (UID: \"64c506b8-fdef-4140-80d9-1d34e8aafa47\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"
Sep 08 15:20:31.321392 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.321316    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9"]
Sep 08 15:20:31.325031 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.325014    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9"
Sep 08 15:20:31.327324 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.327301    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:20:31.327451 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.327302    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:20:31.332807 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.332780    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9"]
Sep 08 15:20:31.344037 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.344009    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"
Sep 08 15:20:31.451323 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.451282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d4e28b0-f804-4926-9a32-b52f53925469-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9\" (UID: \"9d4e28b0-f804-4926-9a32-b52f53925469\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9"
Sep 08 15:20:31.551990 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.551949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d4e28b0-f804-4926-9a32-b52f53925469-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9\" (UID: \"9d4e28b0-f804-4926-9a32-b52f53925469\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9"
Sep 08 15:20:31.552632 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.552613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d4e28b0-f804-4926-9a32-b52f53925469-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9\" (UID: \"9d4e28b0-f804-4926-9a32-b52f53925469\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9"
Sep 08 15:20:31.631358 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.631332    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"]
Sep 08 15:20:31.634040 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:20:31.634011    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c506b8_fdef_4140_80d9_1d34e8aafa47.slice/crio-22b8229731f0c48e4a48bdfffff7a32bd7eead2b013abfeaef7cf8f7ec1996f0 WatchSource:0}: Error finding container 22b8229731f0c48e4a48bdfffff7a32bd7eead2b013abfeaef7cf8f7ec1996f0: Status 404 returned error can't find the container with id 22b8229731f0c48e4a48bdfffff7a32bd7eead2b013abfeaef7cf8f7ec1996f0
Sep 08 15:20:31.638122 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.638102    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9"
Sep 08 15:20:31.944473 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:31.944438    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9"]
Sep 08 15:20:31.944638 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:20:31.944599    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d4e28b0_f804_4926_9a32_b52f53925469.slice/crio-4faf5ae7ee8a697987a6f561ce8efad0252522a07afa9e6d1771d55ea1bcda01 WatchSource:0}: Error finding container 4faf5ae7ee8a697987a6f561ce8efad0252522a07afa9e6d1771d55ea1bcda01: Status 404 returned error can't find the container with id 4faf5ae7ee8a697987a6f561ce8efad0252522a07afa9e6d1771d55ea1bcda01
Sep 08 15:20:32.314993 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:32.314961    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h" event={"ID":"64c506b8-fdef-4140-80d9-1d34e8aafa47","Type":"ContainerStarted","Data":"74938e7d1d71ff2c664b99f4e90f761fff561bb6baf36cbfefffab5b4a8c383a"}
Sep 08 15:20:32.315426 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:32.315036    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h" event={"ID":"64c506b8-fdef-4140-80d9-1d34e8aafa47","Type":"ContainerStarted","Data":"22b8229731f0c48e4a48bdfffff7a32bd7eead2b013abfeaef7cf8f7ec1996f0"}
Sep 08 15:20:32.315426 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:32.315076    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"
Sep 08 15:20:32.316571 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:32.316541    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9" event={"ID":"9d4e28b0-f804-4926-9a32-b52f53925469","Type":"ContainerStarted","Data":"107dd1d61ff2197f222ca85091727b74f1590d57bb6a2afd02248b3d7dbba0c6"}
Sep 08 15:20:32.316690 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:32.316595    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9" event={"ID":"9d4e28b0-f804-4926-9a32-b52f53925469","Type":"ContainerStarted","Data":"4faf5ae7ee8a697987a6f561ce8efad0252522a07afa9e6d1771d55ea1bcda01"}
Sep 08 15:20:32.336195 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:32.336150    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h" podStartSLOduration=1.3361335300000001 podStartE2EDuration="1.33613353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:32.334657778 +0000 UTC m=+1511.666897324" watchObservedRunningTime="2026-09-08 15:20:32.33613353 +0000 UTC m=+1511.668373076"
Sep 08 15:20:32.351582 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:32.351528    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9" podStartSLOduration=1.351499953 podStartE2EDuration="1.351499953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:32.349783858 +0000 UTC m=+1511.682023405" watchObservedRunningTime="2026-09-08 15:20:32.351499953 +0000 UTC m=+1511.683739499"
Sep 08 15:20:33.323616 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:33.323583    2580 generic.go:356] "Generic (PLEG): container finished" podID="9d4e28b0-f804-4926-9a32-b52f53925469" containerID="107dd1d61ff2197f222ca85091727b74f1590d57bb6a2afd02248b3d7dbba0c6" exitCode=0
Sep 08 15:20:33.324063 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:33.323667    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9" event={"ID":"9d4e28b0-f804-4926-9a32-b52f53925469","Type":"ContainerDied","Data":"107dd1d61ff2197f222ca85091727b74f1590d57bb6a2afd02248b3d7dbba0c6"}
Sep 08 15:20:34.477144 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:34.477118    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9"
Sep 08 15:20:34.504753 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:34.504720    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:20:34.586388 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:34.585796    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d4e28b0-f804-4926-9a32-b52f53925469-maas-api-service-ca\") pod \"9d4e28b0-f804-4926-9a32-b52f53925469\" (UID: \"9d4e28b0-f804-4926-9a32-b52f53925469\") "
Sep 08 15:20:34.586576 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:34.586495    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d4e28b0-f804-4926-9a32-b52f53925469-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9d4e28b0-f804-4926-9a32-b52f53925469" (UID: "9d4e28b0-f804-4926-9a32-b52f53925469"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:20:34.687731 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:34.687693    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d4e28b0-f804-4926-9a32-b52f53925469-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:35.337222 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:35.337176    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9" event={"ID":"9d4e28b0-f804-4926-9a32-b52f53925469","Type":"ContainerDied","Data":"4faf5ae7ee8a697987a6f561ce8efad0252522a07afa9e6d1771d55ea1bcda01"}
Sep 08 15:20:35.337424 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:35.337244    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4faf5ae7ee8a697987a6f561ce8efad0252522a07afa9e6d1771d55ea1bcda01"
Sep 08 15:20:35.337424 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:35.337311    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9"
Sep 08 15:20:38.298051 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.297986    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7" podUID="02c447b1-dd39-48f9-aa6e-2b50f8c97e0a" containerName="main" containerID="cri-o://83ac4ca91a9de915b6a55cbc365b27afddaf81d05b032e6c9e000a8d69a4396d" gracePeriod=45
Sep 08 15:20:38.609806 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.609780    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:20:38.654560 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.654435    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-dshm\") pod \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") "
Sep 08 15:20:38.657725 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.657680    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-dshm" (OuterVolumeSpecName: "dshm") pod "02c447b1-dd39-48f9-aa6e-2b50f8c97e0a" (UID: "02c447b1-dd39-48f9-aa6e-2b50f8c97e0a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:38.755786 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.755736    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-tmp-dir\") pod \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") "
Sep 08 15:20:38.755986 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.755814    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-home\") pod \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") "
Sep 08 15:20:38.755986 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.755869    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltvvf\" (UniqueName: \"kubernetes.io/projected/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-kube-api-access-ltvvf\") pod \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") "
Sep 08 15:20:38.755986 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.755918    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-tls-certs\") pod \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") "
Sep 08 15:20:38.755986 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.755966    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-model-cache\") pod \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\" (UID: \"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a\") "
Sep 08 15:20:38.756190 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.756016    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "02c447b1-dd39-48f9-aa6e-2b50f8c97e0a" (UID: "02c447b1-dd39-48f9-aa6e-2b50f8c97e0a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:38.756190 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.756043    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-home" (OuterVolumeSpecName: "home") pod "02c447b1-dd39-48f9-aa6e-2b50f8c97e0a" (UID: "02c447b1-dd39-48f9-aa6e-2b50f8c97e0a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:38.756270 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.756225    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-model-cache" (OuterVolumeSpecName: "model-cache") pod "02c447b1-dd39-48f9-aa6e-2b50f8c97e0a" (UID: "02c447b1-dd39-48f9-aa6e-2b50f8c97e0a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:38.756368 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.756345    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-model-cache\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:38.756422 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.756370    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-tmp-dir\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:38.756422 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.756379    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-dshm\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:38.756422 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.756386    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-home\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:38.758133 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.758108    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "02c447b1-dd39-48f9-aa6e-2b50f8c97e0a" (UID: "02c447b1-dd39-48f9-aa6e-2b50f8c97e0a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:20:38.758234 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.758128    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-kube-api-access-ltvvf" (OuterVolumeSpecName: "kube-api-access-ltvvf") pod "02c447b1-dd39-48f9-aa6e-2b50f8c97e0a" (UID: "02c447b1-dd39-48f9-aa6e-2b50f8c97e0a"). InnerVolumeSpecName "kube-api-access-ltvvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:38.857613 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.857480    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltvvf\" (UniqueName: \"kubernetes.io/projected/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-kube-api-access-ltvvf\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:38.857613 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:38.857554    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a-tls-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:39.371268 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:39.371232    2580 generic.go:356] "Generic (PLEG): container finished" podID="02c447b1-dd39-48f9-aa6e-2b50f8c97e0a" containerID="83ac4ca91a9de915b6a55cbc365b27afddaf81d05b032e6c9e000a8d69a4396d" exitCode=0
Sep 08 15:20:39.371695 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:39.371280    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"
Sep 08 15:20:39.371695 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:39.371315    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7" event={"ID":"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a","Type":"ContainerDied","Data":"83ac4ca91a9de915b6a55cbc365b27afddaf81d05b032e6c9e000a8d69a4396d"}
Sep 08 15:20:39.371695 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:39.371363    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7" event={"ID":"02c447b1-dd39-48f9-aa6e-2b50f8c97e0a","Type":"ContainerDied","Data":"2774a71ccf2d472f9c23d793218a9b2f6e1ff5900c9c186c23753cb3294b6a8c"}
Sep 08 15:20:39.371695 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:39.371380    2580 scope.go:117] "RemoveContainer" containerID="83ac4ca91a9de915b6a55cbc365b27afddaf81d05b032e6c9e000a8d69a4396d"
Sep 08 15:20:39.380474 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:39.380454    2580 scope.go:117] "RemoveContainer" containerID="83ac4ca91a9de915b6a55cbc365b27afddaf81d05b032e6c9e000a8d69a4396d"
Sep 08 15:20:39.380775 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:20:39.380749    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83ac4ca91a9de915b6a55cbc365b27afddaf81d05b032e6c9e000a8d69a4396d\": container with ID starting with 83ac4ca91a9de915b6a55cbc365b27afddaf81d05b032e6c9e000a8d69a4396d not found: ID does not exist" containerID="83ac4ca91a9de915b6a55cbc365b27afddaf81d05b032e6c9e000a8d69a4396d"
Sep 08 15:20:39.380839 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:39.380784    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ac4ca91a9de915b6a55cbc365b27afddaf81d05b032e6c9e000a8d69a4396d"} err="failed to get container status \"83ac4ca91a9de915b6a55cbc365b27afddaf81d05b032e6c9e000a8d69a4396d\": rpc error: code = NotFound desc = could not find container \"83ac4ca91a9de915b6a55cbc365b27afddaf81d05b032e6c9e000a8d69a4396d\": container with ID starting with 83ac4ca91a9de915b6a55cbc365b27afddaf81d05b032e6c9e000a8d69a4396d not found: ID does not exist"
Sep 08 15:20:39.387820 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:39.387796    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"]
Sep 08 15:20:39.391779 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:39.391757    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ffa941/rate-test-model-ffa941-kserve-79dfb4f8cf-r7sl7"]
Sep 08 15:20:41.157445 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:41.157401    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02c447b1-dd39-48f9-aa6e-2b50f8c97e0a" path="/var/lib/kubelet/pods/02c447b1-dd39-48f9-aa6e-2b50f8c97e0a/volumes"
Sep 08 15:20:42.186706 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:42.186668    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-65dd51-29814675-vshtw"]
Sep 08 15:20:42.190367 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:42.190335    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-65dd51-29814675-vshtw"]
Sep 08 15:20:42.384415 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:42.384380    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9"]
Sep 08 15:20:42.386525 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:42.386490    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-65dd51-9vbh9"]
Sep 08 15:20:43.160298 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:43.160260    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="010f54c4-683d-4121-a7e5-f4d2db5c02f4" path="/var/lib/kubelet/pods/010f54c4-683d-4121-a7e5-f4d2db5c02f4/volumes"
Sep 08 15:20:43.160781 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:43.160761    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d4e28b0-f804-4926-9a32-b52f53925469" path="/var/lib/kubelet/pods/9d4e28b0-f804-4926-9a32-b52f53925469/volumes"
Sep 08 15:20:43.326289 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:43.326211    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"
Sep 08 15:20:44.297763 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:44.297725    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 08 15:20:44.297974 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:44.297785    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2" podUID="51ee169f-f921-44e2-89f3-5bbd93daaa41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 08 15:20:44.408423 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:44.408336    2580 generic.go:356] "Generic (PLEG): container finished" podID="51ee169f-f921-44e2-89f3-5bbd93daaa41" containerID="e00677d95f29c68baa86e26c2eb9ee37e305fb2db876f971cb499ae82c9208b3" exitCode=0
Sep 08 15:20:44.408423 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:44.408375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2" event={"ID":"51ee169f-f921-44e2-89f3-5bbd93daaa41","Type":"ContainerDied","Data":"e00677d95f29c68baa86e26c2eb9ee37e305fb2db876f971cb499ae82c9208b3"}
Sep 08 15:20:44.408887 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:44.408853    2580 scope.go:117] "RemoveContainer" containerID="e00677d95f29c68baa86e26c2eb9ee37e305fb2db876f971cb499ae82c9208b3"
Sep 08 15:20:44.410052 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:44.410019    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:20:44.410155 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:44.410110    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:20:44.410218 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:44.410164    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:20:45.415934 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:45.415895    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2" event={"ID":"51ee169f-f921-44e2-89f3-5bbd93daaa41","Type":"ContainerStarted","Data":"6215e36298cef7676c895a1e767aaeb30f6a52cce46b0fb3368a449998b0245b"}
Sep 08 15:20:46.316861 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:46.316820    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:46.317123 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:46.317096    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 08 15:20:46.317211 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:46.317155    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2" podUID="51ee169f-f921-44e2-89f3-5bbd93daaa41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 08 15:20:47.306766 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:47.306717    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:20:47.316995 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:47.316953    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 08 15:20:47.317185 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:47.317065    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2" podUID="51ee169f-f921-44e2-89f3-5bbd93daaa41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 08 15:20:48.316943 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:48.316905    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 08 15:20:48.317332 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:48.316967    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2" podUID="51ee169f-f921-44e2-89f3-5bbd93daaa41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 08 15:20:48.944531 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:48.941674    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"]
Sep 08 15:20:48.944531 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:48.941930    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw" podUID="28dc2469-4158-48a8-9c6a-6facec33c40c" containerName="istio-proxy" containerID="cri-o://a6b1dc97733ec68f58206051bdaaa242e8f920fdc34080a2e6701f557983e5a9" gracePeriod=30
Sep 08 15:20:49.316769 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:49.316734    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 08 15:20:49.316957 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:49.316789    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2" podUID="51ee169f-f921-44e2-89f3-5bbd93daaa41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 08 15:20:50.317182 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:50.317138    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 08 15:20:50.317695 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:50.317204    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2" podUID="51ee169f-f921-44e2-89f3-5bbd93daaa41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 08 15:20:51.320648 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:51.320611    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:51.321087 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:51.320895    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:51.321726 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:51.321704    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:20:51.723274 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:51.723238    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:20:51.723444 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:51.723298    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw" podUID="28dc2469-4158-48a8-9c6a-6facec33c40c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:20:54.231690 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.231628    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:20:54.333569 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.333505    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28dc2469-4158-48a8-9c6a-6facec33c40c-istiod-ca-cert\") pod \"28dc2469-4158-48a8-9c6a-6facec33c40c\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") "
Sep 08 15:20:54.333763 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.333599    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-envoy\") pod \"28dc2469-4158-48a8-9c6a-6facec33c40c\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") "
Sep 08 15:20:54.333763 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.333622    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-token\") pod \"28dc2469-4158-48a8-9c6a-6facec33c40c\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") "
Sep 08 15:20:54.333763 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.333657    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-workload-socket\") pod \"28dc2469-4158-48a8-9c6a-6facec33c40c\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") "
Sep 08 15:20:54.333763 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.333677    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-workload-certs\") pod \"28dc2469-4158-48a8-9c6a-6facec33c40c\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") "
Sep 08 15:20:54.333763 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.333724    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-podinfo\") pod \"28dc2469-4158-48a8-9c6a-6facec33c40c\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") "
Sep 08 15:20:54.334036 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.333781    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4l4d\" (UniqueName: \"kubernetes.io/projected/28dc2469-4158-48a8-9c6a-6facec33c40c-kube-api-access-n4l4d\") pod \"28dc2469-4158-48a8-9c6a-6facec33c40c\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") "
Sep 08 15:20:54.334036 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.333807    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-credential-socket\") pod \"28dc2469-4158-48a8-9c6a-6facec33c40c\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") "
Sep 08 15:20:54.334036 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.333848    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-data\") pod \"28dc2469-4158-48a8-9c6a-6facec33c40c\" (UID: \"28dc2469-4158-48a8-9c6a-6facec33c40c\") "
Sep 08 15:20:54.334036 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.333939    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "28dc2469-4158-48a8-9c6a-6facec33c40c" (UID: "28dc2469-4158-48a8-9c6a-6facec33c40c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:54.334036 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.333999    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28dc2469-4158-48a8-9c6a-6facec33c40c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "28dc2469-4158-48a8-9c6a-6facec33c40c" (UID: "28dc2469-4158-48a8-9c6a-6facec33c40c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:20:54.334275 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.334205    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-data" (OuterVolumeSpecName: "istio-data") pod "28dc2469-4158-48a8-9c6a-6facec33c40c" (UID: "28dc2469-4158-48a8-9c6a-6facec33c40c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:54.334275 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.334254    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "28dc2469-4158-48a8-9c6a-6facec33c40c" (UID: "28dc2469-4158-48a8-9c6a-6facec33c40c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:54.334381 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.334291    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "28dc2469-4158-48a8-9c6a-6facec33c40c" (UID: "28dc2469-4158-48a8-9c6a-6facec33c40c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:54.334381 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.334304    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:54.334381 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.334324    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28dc2469-4158-48a8-9c6a-6facec33c40c-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:54.334381 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.334338    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:54.335952 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.335927    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-token" (OuterVolumeSpecName: "istio-token") pod "28dc2469-4158-48a8-9c6a-6facec33c40c" (UID: "28dc2469-4158-48a8-9c6a-6facec33c40c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:54.336061 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.335954    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "28dc2469-4158-48a8-9c6a-6facec33c40c" (UID: "28dc2469-4158-48a8-9c6a-6facec33c40c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:54.336061 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.335992    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "28dc2469-4158-48a8-9c6a-6facec33c40c" (UID: "28dc2469-4158-48a8-9c6a-6facec33c40c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:20:54.336142 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.336056    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28dc2469-4158-48a8-9c6a-6facec33c40c-kube-api-access-n4l4d" (OuterVolumeSpecName: "kube-api-access-n4l4d") pod "28dc2469-4158-48a8-9c6a-6facec33c40c" (UID: "28dc2469-4158-48a8-9c6a-6facec33c40c"). InnerVolumeSpecName "kube-api-access-n4l4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:54.435420 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.435386    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4l4d\" (UniqueName: \"kubernetes.io/projected/28dc2469-4158-48a8-9c6a-6facec33c40c-kube-api-access-n4l4d\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:54.435420 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.435415    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:54.435420 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.435426    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:54.435671 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.435435    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:54.435671 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.435442    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28dc2469-4158-48a8-9c6a-6facec33c40c-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:54.435671 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.435450    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28dc2469-4158-48a8-9c6a-6facec33c40c-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:20:54.479849 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.479810    2580 generic.go:356] "Generic (PLEG): container finished" podID="28dc2469-4158-48a8-9c6a-6facec33c40c" containerID="a6b1dc97733ec68f58206051bdaaa242e8f920fdc34080a2e6701f557983e5a9" exitCode=0
Sep 08 15:20:54.480004 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.479865    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"
Sep 08 15:20:54.480004 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.479872    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw" event={"ID":"28dc2469-4158-48a8-9c6a-6facec33c40c","Type":"ContainerDied","Data":"a6b1dc97733ec68f58206051bdaaa242e8f920fdc34080a2e6701f557983e5a9"}
Sep 08 15:20:54.480004 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.479927    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw" event={"ID":"28dc2469-4158-48a8-9c6a-6facec33c40c","Type":"ContainerDied","Data":"1b3e3e5523fe9c60351e61a3063d844073745c079a5b324b9a8749db4a286ea0"}
Sep 08 15:20:54.480004 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.479959    2580 scope.go:117] "RemoveContainer" containerID="a6b1dc97733ec68f58206051bdaaa242e8f920fdc34080a2e6701f557983e5a9"
Sep 08 15:20:54.490238 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.490220    2580 scope.go:117] "RemoveContainer" containerID="377d63c3bd80d1508d5b971fd4a37fdd1f3d59080dec53ee3a90f74de1a3decc"
Sep 08 15:20:54.498167 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.498149    2580 scope.go:117] "RemoveContainer" containerID="a6b1dc97733ec68f58206051bdaaa242e8f920fdc34080a2e6701f557983e5a9"
Sep 08 15:20:54.498410 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:20:54.498392    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6b1dc97733ec68f58206051bdaaa242e8f920fdc34080a2e6701f557983e5a9\": container with ID starting with a6b1dc97733ec68f58206051bdaaa242e8f920fdc34080a2e6701f557983e5a9 not found: ID does not exist" containerID="a6b1dc97733ec68f58206051bdaaa242e8f920fdc34080a2e6701f557983e5a9"
Sep 08 15:20:54.498469 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.498417    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6b1dc97733ec68f58206051bdaaa242e8f920fdc34080a2e6701f557983e5a9"} err="failed to get container status \"a6b1dc97733ec68f58206051bdaaa242e8f920fdc34080a2e6701f557983e5a9\": rpc error: code = NotFound desc = could not find container \"a6b1dc97733ec68f58206051bdaaa242e8f920fdc34080a2e6701f557983e5a9\": container with ID starting with a6b1dc97733ec68f58206051bdaaa242e8f920fdc34080a2e6701f557983e5a9 not found: ID does not exist"
Sep 08 15:20:54.498469 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.498434    2580 scope.go:117] "RemoveContainer" containerID="377d63c3bd80d1508d5b971fd4a37fdd1f3d59080dec53ee3a90f74de1a3decc"
Sep 08 15:20:54.498701 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:20:54.498680    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"377d63c3bd80d1508d5b971fd4a37fdd1f3d59080dec53ee3a90f74de1a3decc\": container with ID starting with 377d63c3bd80d1508d5b971fd4a37fdd1f3d59080dec53ee3a90f74de1a3decc not found: ID does not exist" containerID="377d63c3bd80d1508d5b971fd4a37fdd1f3d59080dec53ee3a90f74de1a3decc"
Sep 08 15:20:54.498741 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.498708    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"377d63c3bd80d1508d5b971fd4a37fdd1f3d59080dec53ee3a90f74de1a3decc"} err="failed to get container status \"377d63c3bd80d1508d5b971fd4a37fdd1f3d59080dec53ee3a90f74de1a3decc\": rpc error: code = NotFound desc = could not find container \"377d63c3bd80d1508d5b971fd4a37fdd1f3d59080dec53ee3a90f74de1a3decc\": container with ID starting with 377d63c3bd80d1508d5b971fd4a37fdd1f3d59080dec53ee3a90f74de1a3decc not found: ID does not exist"
Sep 08 15:20:54.506827 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.506797    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"]
Sep 08 15:20:54.512436 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:54.512411    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-65dd51-openshift-default-85c88469d6-2czvw"]
Sep 08 15:20:55.157056 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:20:55.157024    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28dc2469-4158-48a8-9c6a-6facec33c40c" path="/var/lib/kubelet/pods/28dc2469-4158-48a8-9c6a-6facec33c40c/volumes"
Sep 08 15:21:00.519979 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.519946    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"]
Sep 08 15:21:00.520365 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.520331    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d4e28b0-f804-4926-9a32-b52f53925469" containerName="revoke-keys"
Sep 08 15:21:00.520365 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.520343    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d4e28b0-f804-4926-9a32-b52f53925469" containerName="revoke-keys"
Sep 08 15:21:00.520365 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.520352    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28dc2469-4158-48a8-9c6a-6facec33c40c" containerName="istio-proxy"
Sep 08 15:21:00.520365 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.520358    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="28dc2469-4158-48a8-9c6a-6facec33c40c" containerName="istio-proxy"
Sep 08 15:21:00.520497 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.520369    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28dc2469-4158-48a8-9c6a-6facec33c40c" containerName="istio-proxy"
Sep 08 15:21:00.520497 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.520375    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="28dc2469-4158-48a8-9c6a-6facec33c40c" containerName="istio-proxy"
Sep 08 15:21:00.520497 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.520385    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c447b1-dd39-48f9-aa6e-2b50f8c97e0a" containerName="main"
Sep 08 15:21:00.520497 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.520391    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c447b1-dd39-48f9-aa6e-2b50f8c97e0a" containerName="main"
Sep 08 15:21:00.520497 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.520451    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="02c447b1-dd39-48f9-aa6e-2b50f8c97e0a" containerName="main"
Sep 08 15:21:00.520497 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.520459    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="28dc2469-4158-48a8-9c6a-6facec33c40c" containerName="istio-proxy"
Sep 08 15:21:00.520497 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.520465    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="28dc2469-4158-48a8-9c6a-6facec33c40c" containerName="istio-proxy"
Sep 08 15:21:00.520497 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.520472    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d4e28b0-f804-4926-9a32-b52f53925469" containerName="revoke-keys"
Sep 08 15:21:00.523640 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.523623    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"
Sep 08 15:21:00.527302 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.527275    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-fa02a8-dockercfg-s7hcp\""
Sep 08 15:21:00.528015 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.527996    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-fa02a8\""
Sep 08 15:21:00.536089 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.536063    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"]
Sep 08 15:21:00.575829 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.575793    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"]
Sep 08 15:21:00.578380 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.578359    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"
Sep 08 15:21:00.597097 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.597060    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l894m\" (UniqueName: \"kubernetes.io/projected/899da0ad-57e0-4812-a891-daed7878eeb9-kube-api-access-l894m\") pod \"payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc\" (UID: \"899da0ad-57e0-4812-a891-daed7878eeb9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"
Sep 08 15:21:00.597238 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.597164    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/899da0ad-57e0-4812-a891-daed7878eeb9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc\" (UID: \"899da0ad-57e0-4812-a891-daed7878eeb9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"
Sep 08 15:21:00.597894 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.597875    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"]
Sep 08 15:21:00.698703 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.698658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/899da0ad-57e0-4812-a891-daed7878eeb9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc\" (UID: \"899da0ad-57e0-4812-a891-daed7878eeb9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"
Sep 08 15:21:00.698882 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.698750    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58065af6-81c1-4ce1-95d6-fb27788f9ebb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc\" (UID: \"58065af6-81c1-4ce1-95d6-fb27788f9ebb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"
Sep 08 15:21:00.698882 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.698768    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq2wq\" (UniqueName: \"kubernetes.io/projected/58065af6-81c1-4ce1-95d6-fb27788f9ebb-kube-api-access-fq2wq\") pod \"payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc\" (UID: \"58065af6-81c1-4ce1-95d6-fb27788f9ebb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"
Sep 08 15:21:00.698882 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.698833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l894m\" (UniqueName: \"kubernetes.io/projected/899da0ad-57e0-4812-a891-daed7878eeb9-kube-api-access-l894m\") pod \"payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc\" (UID: \"899da0ad-57e0-4812-a891-daed7878eeb9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"
Sep 08 15:21:00.699383 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.699363    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/899da0ad-57e0-4812-a891-daed7878eeb9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc\" (UID: \"899da0ad-57e0-4812-a891-daed7878eeb9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"
Sep 08 15:21:00.708230 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.708192    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l894m\" (UniqueName: \"kubernetes.io/projected/899da0ad-57e0-4812-a891-daed7878eeb9-kube-api-access-l894m\") pod \"payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc\" (UID: \"899da0ad-57e0-4812-a891-daed7878eeb9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"
Sep 08 15:21:00.799429 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.799336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58065af6-81c1-4ce1-95d6-fb27788f9ebb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc\" (UID: \"58065af6-81c1-4ce1-95d6-fb27788f9ebb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"
Sep 08 15:21:00.799429 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.799375    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq2wq\" (UniqueName: \"kubernetes.io/projected/58065af6-81c1-4ce1-95d6-fb27788f9ebb-kube-api-access-fq2wq\") pod \"payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc\" (UID: \"58065af6-81c1-4ce1-95d6-fb27788f9ebb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"
Sep 08 15:21:00.800073 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.800051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58065af6-81c1-4ce1-95d6-fb27788f9ebb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc\" (UID: \"58065af6-81c1-4ce1-95d6-fb27788f9ebb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"
Sep 08 15:21:00.807742 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.807714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq2wq\" (UniqueName: \"kubernetes.io/projected/58065af6-81c1-4ce1-95d6-fb27788f9ebb-kube-api-access-fq2wq\") pod \"payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc\" (UID: \"58065af6-81c1-4ce1-95d6-fb27788f9ebb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"
Sep 08 15:21:00.834668 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.834642    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"
Sep 08 15:21:00.889282 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:00.889008    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"
Sep 08 15:21:01.108905 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:01.108866    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"]
Sep 08 15:21:01.110212 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:21:01.110189    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899da0ad_57e0_4812_a891_daed7878eeb9.slice/crio-cf3e434aa61d3233b7942e65a59d4314146248590b1c2b93cc9128c5097c5286 WatchSource:0}: Error finding container cf3e434aa61d3233b7942e65a59d4314146248590b1c2b93cc9128c5097c5286: Status 404 returned error can't find the container with id cf3e434aa61d3233b7942e65a59d4314146248590b1c2b93cc9128c5097c5286
Sep 08 15:21:01.170203 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:01.170173    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"]
Sep 08 15:21:01.172777 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:21:01.172754    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58065af6_81c1_4ce1_95d6_fb27788f9ebb.slice/crio-aacd203591cf770a009d41964553be72fac8822124df21c21a88a93695b71baf WatchSource:0}: Error finding container aacd203591cf770a009d41964553be72fac8822124df21c21a88a93695b71baf: Status 404 returned error can't find the container with id aacd203591cf770a009d41964553be72fac8822124df21c21a88a93695b71baf
Sep 08 15:21:01.523729 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:01.523682    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc" event={"ID":"899da0ad-57e0-4812-a891-daed7878eeb9","Type":"ContainerStarted","Data":"d60135a45f5eeb3da8784e4f3f58088f0f390609ae3536a51375ce71632f2fdd"}
Sep 08 15:21:01.524187 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:01.523746    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc" event={"ID":"899da0ad-57e0-4812-a891-daed7878eeb9","Type":"ContainerStarted","Data":"cf3e434aa61d3233b7942e65a59d4314146248590b1c2b93cc9128c5097c5286"}
Sep 08 15:21:01.524187 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:01.523893    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"
Sep 08 15:21:01.525306 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:01.525281    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc" event={"ID":"58065af6-81c1-4ce1-95d6-fb27788f9ebb","Type":"ContainerStarted","Data":"3da20b922180ab0cb016f485059e8a398a7fe3bbbe933d0d92c9972d55f96682"}
Sep 08 15:21:01.525450 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:01.525326    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc" event={"ID":"58065af6-81c1-4ce1-95d6-fb27788f9ebb","Type":"ContainerStarted","Data":"aacd203591cf770a009d41964553be72fac8822124df21c21a88a93695b71baf"}
Sep 08 15:21:01.525450 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:01.525354    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"
Sep 08 15:21:01.541519 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:01.541451    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc" podStartSLOduration=1.541433122 podStartE2EDuration="1.541433122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:21:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:21:01.53909572 +0000 UTC m=+1540.871335306" watchObservedRunningTime="2026-09-08 15:21:01.541433122 +0000 UTC m=+1540.873672667"
Sep 08 15:21:01.556302 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:01.556243    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc" podStartSLOduration=1.556225611 podStartE2EDuration="1.556225611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:21:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:21:01.555258719 +0000 UTC m=+1540.887498268" watchObservedRunningTime="2026-09-08 15:21:01.556225611 +0000 UTC m=+1540.888465157"
Sep 08 15:21:04.716311 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:04.716269    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:21:12.536217 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:12.536176    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"
Sep 08 15:21:12.536925 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:12.536443    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"
Sep 08 15:21:21.434789 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:21.434760    2580 scope.go:117] "RemoveContainer" containerID="8b6f214e129ff588db26ec930f69516f349499c33220e312993c6e0fab10ed5e"
Sep 08 15:21:21.443305 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:21.443282    2580 scope.go:117] "RemoveContainer" containerID="a2c2fbb3e23421446db2f3e399aa696f306cb0c7fcb79adf0fb458dbd15ccfb6"
Sep 08 15:21:21.451429 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:21.451408    2580 scope.go:117] "RemoveContainer" containerID="11dbf8a32de20c6ad4f82d44ef0ffcc270135b838cd095398a3fb5c852bbb22e"
Sep 08 15:21:21.459199 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:21.459178    2580 scope.go:117] "RemoveContainer" containerID="a86d841e0260cc4673d93cef868e92a5c37644840f95b3c23e5510181446aacf"
Sep 08 15:21:21.467177 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:21.467155    2580 scope.go:117] "RemoveContainer" containerID="1229927cc9de89b2cc2860528d8063ffd420c7d9d651e7ecddc840007a6d7ef3"
Sep 08 15:21:28.617000 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:28.616970    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc_58065af6-81c1-4ce1-95d6-fb27788f9ebb/payload-processing/0.log"
Sep 08 15:21:35.404904 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:35.404862    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:21:54.112729 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:21:54.112684    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:22:01.479472 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:01.479444    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc_58065af6-81c1-4ce1-95d6-fb27788f9ebb/payload-processing/0.log"
Sep 08 15:22:02.064452 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.064414    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"]
Sep 08 15:22:02.069937 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.069911    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.072376 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.072351    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-f9a001-openshift-default-dockercfg-hh652\""
Sep 08 15:22:02.099085 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.099020    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"]
Sep 08 15:22:02.131978 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.131930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4wsw\" (UniqueName: \"kubernetes.io/projected/3655aea3-bdba-4c3c-9774-8fe6905dd842-kube-api-access-b4wsw\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.132147 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.132059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-token\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.132147 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.132120    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-credential-socket\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.132223 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.132201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-envoy\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.132268 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.132227    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-podinfo\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.132338 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.132311    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-workload-socket\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.132382 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.132356    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-workload-certs\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.132433 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.132417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3655aea3-bdba-4c3c-9774-8fe6905dd842-istiod-ca-cert\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.132478 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.132456    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-data\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.233318 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.233274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-token\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.233543 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.233333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-credential-socket\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.233543 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.233520    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-envoy\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.233684 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.233561    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-podinfo\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.233684 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.233606    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-workload-socket\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.233684 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.233645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-workload-certs\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.233851 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.233731    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-credential-socket\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.233851 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.233737    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3655aea3-bdba-4c3c-9774-8fe6905dd842-istiod-ca-cert\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.233851 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.233788    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-data\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.234019 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.233855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4wsw\" (UniqueName: \"kubernetes.io/projected/3655aea3-bdba-4c3c-9774-8fe6905dd842-kube-api-access-b4wsw\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.234019 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.233954    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-workload-certs\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.234019 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.233989    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-workload-socket\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.234169 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.234146    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-data\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.234688 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.234664    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3655aea3-bdba-4c3c-9774-8fe6905dd842-istiod-ca-cert\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.236250 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.236227    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-envoy\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.236402 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.236379    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-podinfo\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.241597 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.241571    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-token\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.241878 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.241855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4wsw\" (UniqueName: \"kubernetes.io/projected/3655aea3-bdba-4c3c-9774-8fe6905dd842-kube-api-access-b4wsw\") pod \"e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") " pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.380710 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.380604    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:02.664210 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.664179    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"]
Sep 08 15:22:02.666096 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:22:02.666067    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3655aea3_bdba_4c3c_9774_8fe6905dd842.slice/crio-a13d643baa3f11fe83bf8eaf7a5432d401f3bb2c9eb257c4ac2df595237a7617 WatchSource:0}: Error finding container a13d643baa3f11fe83bf8eaf7a5432d401f3bb2c9eb257c4ac2df595237a7617: Status 404 returned error can't find the container with id a13d643baa3f11fe83bf8eaf7a5432d401f3bb2c9eb257c4ac2df595237a7617
Sep 08 15:22:02.668368 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.668336    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:22:02.668448 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.668403    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:22:02.668448 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.668430    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:22:02.878266 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.878208    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c" event={"ID":"3655aea3-bdba-4c3c-9774-8fe6905dd842","Type":"ContainerStarted","Data":"18381549b88c51521e3e61cf8398a22fc7f74dbac3304e68c17b974777198718"}
Sep 08 15:22:02.878471 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.878291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c" event={"ID":"3655aea3-bdba-4c3c-9774-8fe6905dd842","Type":"ContainerStarted","Data":"a13d643baa3f11fe83bf8eaf7a5432d401f3bb2c9eb257c4ac2df595237a7617"}
Sep 08 15:22:02.899194 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:02.899136    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c" podStartSLOduration=0.899116715 podStartE2EDuration="899.116715ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:22:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:22:02.898277919 +0000 UTC m=+1602.230517466" watchObservedRunningTime="2026-09-08 15:22:02.899116715 +0000 UTC m=+1602.231356260"
Sep 08 15:22:03.381720 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:03.381683    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:03.383442 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:03.383413    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 08 15:22:03.383591 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:03.383467    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c" podUID="3655aea3-bdba-4c3c-9774-8fe6905dd842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 08 15:22:04.385655 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:04.385618    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:04.889840 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:04.889812    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:04.890801 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:04.890780    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:13.217258 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:13.217216    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:22:24.008449 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:24.008411    2580 generic.go:356] "Generic (PLEG): container finished" podID="3655aea3-bdba-4c3c-9774-8fe6905dd842" containerID="18381549b88c51521e3e61cf8398a22fc7f74dbac3304e68c17b974777198718" exitCode=0
Sep 08 15:22:24.009008 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:24.008499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c" event={"ID":"3655aea3-bdba-4c3c-9774-8fe6905dd842","Type":"ContainerDied","Data":"18381549b88c51521e3e61cf8398a22fc7f74dbac3304e68c17b974777198718"}
Sep 08 15:22:24.009155 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:24.009134    2580 scope.go:117] "RemoveContainer" containerID="18381549b88c51521e3e61cf8398a22fc7f74dbac3304e68c17b974777198718"
Sep 08 15:22:24.010327 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:24.010300    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:22:24.010387 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:24.010374    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:22:24.010429 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:24.010405    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:22:25.015773 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:25.015740    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c" event={"ID":"3655aea3-bdba-4c3c-9774-8fe6905dd842","Type":"ContainerStarted","Data":"273c0d74d4c0dbc6809cebc5544d99fa3034a92cad9057f1f5d54d0b3383f390"}
Sep 08 15:22:25.381066 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:25.380976    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:25.381226 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:25.381176    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 08 15:22:25.381277 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:25.381228    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c" podUID="3655aea3-bdba-4c3c-9774-8fe6905dd842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 08 15:22:26.381952 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:26.381919    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 08 15:22:26.382338 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:26.381976    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c" podUID="3655aea3-bdba-4c3c-9774-8fe6905dd842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 08 15:22:27.381760 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:27.381721    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 08 15:22:27.381962 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:27.381780    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c" podUID="3655aea3-bdba-4c3c-9774-8fe6905dd842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 08 15:22:28.381950 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:28.381917    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 08 15:22:28.382308 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:28.381972    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c" podUID="3655aea3-bdba-4c3c-9774-8fe6905dd842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 08 15:22:29.381259 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:29.381215    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 08 15:22:29.381474 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:29.381284    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c" podUID="3655aea3-bdba-4c3c-9774-8fe6905dd842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 08 15:22:30.385957 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:30.385929    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:30.386390 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:30.386198    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:30.387034 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:30.387016    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:30.554737 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:30.554702    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf"]
Sep 08 15:22:30.558376 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:30.558359    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf"
Sep 08 15:22:30.560870 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:30.560836    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:22:30.560984 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:30.560902    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:22:30.565826 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:30.565797    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf"]
Sep 08 15:22:30.617808 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:30.617765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf2d5a17-7a24-4495-b40d-3bc01f6b470c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf\" (UID: \"cf2d5a17-7a24-4495-b40d-3bc01f6b470c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf"
Sep 08 15:22:30.718821 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:30.718782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf2d5a17-7a24-4495-b40d-3bc01f6b470c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf\" (UID: \"cf2d5a17-7a24-4495-b40d-3bc01f6b470c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf"
Sep 08 15:22:30.719468 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:30.719449    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf2d5a17-7a24-4495-b40d-3bc01f6b470c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf\" (UID: \"cf2d5a17-7a24-4495-b40d-3bc01f6b470c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf"
Sep 08 15:22:30.871128 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:30.871074    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf"
Sep 08 15:22:31.142198 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:31.142169    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf"]
Sep 08 15:22:31.143944 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:22:31.143918    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf2d5a17_7a24_4495_b40d_3bc01f6b470c.slice/crio-9f3d2d741a5b85c20904b7a0f111d03163c24c21a22a67023436f7c4a5319df5 WatchSource:0}: Error finding container 9f3d2d741a5b85c20904b7a0f111d03163c24c21a22a67023436f7c4a5319df5: Status 404 returned error can't find the container with id 9f3d2d741a5b85c20904b7a0f111d03163c24c21a22a67023436f7c4a5319df5
Sep 08 15:22:32.062062 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:32.062022    2580 generic.go:356] "Generic (PLEG): container finished" podID="cf2d5a17-7a24-4495-b40d-3bc01f6b470c" containerID="fe9344b3cef0796e2016a6fd500e9330d6cb1cf64cf58221dedee9c7d614f929" exitCode=0
Sep 08 15:22:32.062486 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:32.062112    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf" event={"ID":"cf2d5a17-7a24-4495-b40d-3bc01f6b470c","Type":"ContainerDied","Data":"fe9344b3cef0796e2016a6fd500e9330d6cb1cf64cf58221dedee9c7d614f929"}
Sep 08 15:22:32.062486 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:32.062164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf" event={"ID":"cf2d5a17-7a24-4495-b40d-3bc01f6b470c","Type":"ContainerStarted","Data":"9f3d2d741a5b85c20904b7a0f111d03163c24c21a22a67023436f7c4a5319df5"}
Sep 08 15:22:33.212337 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:33.212309    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf"
Sep 08 15:22:33.345700 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:33.345594    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf2d5a17-7a24-4495-b40d-3bc01f6b470c-maas-api-service-ca\") pod \"cf2d5a17-7a24-4495-b40d-3bc01f6b470c\" (UID: \"cf2d5a17-7a24-4495-b40d-3bc01f6b470c\") "
Sep 08 15:22:33.345979 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:33.345952    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf2d5a17-7a24-4495-b40d-3bc01f6b470c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cf2d5a17-7a24-4495-b40d-3bc01f6b470c" (UID: "cf2d5a17-7a24-4495-b40d-3bc01f6b470c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:22:33.447177 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:33.447136    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf2d5a17-7a24-4495-b40d-3bc01f6b470c-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:22:34.074617 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:34.074585    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf"
Sep 08 15:22:34.074791 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:34.074607    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf" event={"ID":"cf2d5a17-7a24-4495-b40d-3bc01f6b470c","Type":"ContainerDied","Data":"9f3d2d741a5b85c20904b7a0f111d03163c24c21a22a67023436f7c4a5319df5"}
Sep 08 15:22:34.074791 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:34.074663    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f3d2d741a5b85c20904b7a0f111d03163c24c21a22a67023436f7c4a5319df5"
Sep 08 15:22:36.976205 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:36.976164    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf"]
Sep 08 15:22:36.980580 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:36.980554    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f9a001-l4rsf"]
Sep 08 15:22:37.163423 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:37.163385    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf2d5a17-7a24-4495-b40d-3bc01f6b470c" path="/var/lib/kubelet/pods/cf2d5a17-7a24-4495-b40d-3bc01f6b470c/volumes"
Sep 08 15:22:42.217606 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:42.217569    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:22:43.714048 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:43.714008    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"]
Sep 08 15:22:43.714558 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:43.714281    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c" podUID="3655aea3-bdba-4c3c-9774-8fe6905dd842" containerName="istio-proxy" containerID="cri-o://273c0d74d4c0dbc6809cebc5544d99fa3034a92cad9057f1f5d54d0b3383f390" gracePeriod=30
Sep 08 15:22:45.389333 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:45.389295    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:22:45.389822 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:45.389366    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c" podUID="3655aea3-bdba-4c3c-9774-8fe6905dd842" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:22:47.534933 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:47.534890    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6"]
Sep 08 15:22:47.535399 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:47.535383    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf2d5a17-7a24-4495-b40d-3bc01f6b470c" containerName="revoke-keys"
Sep 08 15:22:47.535455 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:47.535401    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf2d5a17-7a24-4495-b40d-3bc01f6b470c" containerName="revoke-keys"
Sep 08 15:22:47.535524 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:47.535491    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf2d5a17-7a24-4495-b40d-3bc01f6b470c" containerName="revoke-keys"
Sep 08 15:22:47.539151 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:47.539133    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6"
Sep 08 15:22:47.542075 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:47.542053    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:22:47.542210 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:47.542055    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:22:47.548300 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:47.548269    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6"]
Sep 08 15:22:47.700008 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:47.699958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08016a2d-a147-4bc3-b8ca-0d15e8a96772-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6\" (UID: \"08016a2d-a147-4bc3-b8ca-0d15e8a96772\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6"
Sep 08 15:22:47.801336 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:47.801244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08016a2d-a147-4bc3-b8ca-0d15e8a96772-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6\" (UID: \"08016a2d-a147-4bc3-b8ca-0d15e8a96772\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6"
Sep 08 15:22:47.801988 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:47.801964    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08016a2d-a147-4bc3-b8ca-0d15e8a96772-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6\" (UID: \"08016a2d-a147-4bc3-b8ca-0d15e8a96772\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6"
Sep 08 15:22:47.851458 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:47.851418    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6"
Sep 08 15:22:48.130725 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:48.130639    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6"]
Sep 08 15:22:48.134615 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:22:48.134583    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08016a2d_a147_4bc3_b8ca_0d15e8a96772.slice/crio-3bb6b1a504df5100014a75f344433bbe63d15ea994496775da852486e05e8396 WatchSource:0}: Error finding container 3bb6b1a504df5100014a75f344433bbe63d15ea994496775da852486e05e8396: Status 404 returned error can't find the container with id 3bb6b1a504df5100014a75f344433bbe63d15ea994496775da852486e05e8396
Sep 08 15:22:48.155030 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:48.155001    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6" event={"ID":"08016a2d-a147-4bc3-b8ca-0d15e8a96772","Type":"ContainerStarted","Data":"3bb6b1a504df5100014a75f344433bbe63d15ea994496775da852486e05e8396"}
Sep 08 15:22:48.984330 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:48.984262    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:49.116633 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.116585    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3655aea3-bdba-4c3c-9774-8fe6905dd842-istiod-ca-cert\") pod \"3655aea3-bdba-4c3c-9774-8fe6905dd842\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") "
Sep 08 15:22:49.116820 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.116643    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-data\") pod \"3655aea3-bdba-4c3c-9774-8fe6905dd842\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") "
Sep 08 15:22:49.116820 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.116720    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4wsw\" (UniqueName: \"kubernetes.io/projected/3655aea3-bdba-4c3c-9774-8fe6905dd842-kube-api-access-b4wsw\") pod \"3655aea3-bdba-4c3c-9774-8fe6905dd842\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") "
Sep 08 15:22:49.116820 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.116753    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-workload-socket\") pod \"3655aea3-bdba-4c3c-9774-8fe6905dd842\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") "
Sep 08 15:22:49.116820 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.116794    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-credential-socket\") pod \"3655aea3-bdba-4c3c-9774-8fe6905dd842\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") "
Sep 08 15:22:49.117058 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.116894    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-workload-certs\") pod \"3655aea3-bdba-4c3c-9774-8fe6905dd842\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") "
Sep 08 15:22:49.117058 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.116937    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-envoy\") pod \"3655aea3-bdba-4c3c-9774-8fe6905dd842\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") "
Sep 08 15:22:49.117058 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.116948    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-data" (OuterVolumeSpecName: "istio-data") pod "3655aea3-bdba-4c3c-9774-8fe6905dd842" (UID: "3655aea3-bdba-4c3c-9774-8fe6905dd842"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:22:49.117058 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.116967    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-podinfo\") pod \"3655aea3-bdba-4c3c-9774-8fe6905dd842\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") "
Sep 08 15:22:49.117058 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.116994    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-token\") pod \"3655aea3-bdba-4c3c-9774-8fe6905dd842\" (UID: \"3655aea3-bdba-4c3c-9774-8fe6905dd842\") "
Sep 08 15:22:49.117058 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.117014    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3655aea3-bdba-4c3c-9774-8fe6905dd842-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3655aea3-bdba-4c3c-9774-8fe6905dd842" (UID: "3655aea3-bdba-4c3c-9774-8fe6905dd842"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:22:49.117365 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.117063    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3655aea3-bdba-4c3c-9774-8fe6905dd842" (UID: "3655aea3-bdba-4c3c-9774-8fe6905dd842"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:22:49.117365 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.117207    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3655aea3-bdba-4c3c-9774-8fe6905dd842" (UID: "3655aea3-bdba-4c3c-9774-8fe6905dd842"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:22:49.117365 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.117219    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3655aea3-bdba-4c3c-9774-8fe6905dd842" (UID: "3655aea3-bdba-4c3c-9774-8fe6905dd842"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:22:49.117561 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.117379    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:22:49.117561 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.117398    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:22:49.117561 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.117413    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:22:49.117561 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.117426    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3655aea3-bdba-4c3c-9774-8fe6905dd842-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:22:49.117561 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.117439    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:22:49.119183 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.119154    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3655aea3-bdba-4c3c-9774-8fe6905dd842" (UID: "3655aea3-bdba-4c3c-9774-8fe6905dd842"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:22:49.119183 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.119173    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3655aea3-bdba-4c3c-9774-8fe6905dd842-kube-api-access-b4wsw" (OuterVolumeSpecName: "kube-api-access-b4wsw") pod "3655aea3-bdba-4c3c-9774-8fe6905dd842" (UID: "3655aea3-bdba-4c3c-9774-8fe6905dd842"). InnerVolumeSpecName "kube-api-access-b4wsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:22:49.119368 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.119175    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3655aea3-bdba-4c3c-9774-8fe6905dd842" (UID: "3655aea3-bdba-4c3c-9774-8fe6905dd842"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:22:49.119368 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.119210    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-token" (OuterVolumeSpecName: "istio-token") pod "3655aea3-bdba-4c3c-9774-8fe6905dd842" (UID: "3655aea3-bdba-4c3c-9774-8fe6905dd842"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:22:49.162075 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.162036    2580 generic.go:356] "Generic (PLEG): container finished" podID="3655aea3-bdba-4c3c-9774-8fe6905dd842" containerID="273c0d74d4c0dbc6809cebc5544d99fa3034a92cad9057f1f5d54d0b3383f390" exitCode=0
Sep 08 15:22:49.162248 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.162077    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"
Sep 08 15:22:49.162248 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.162109    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c" event={"ID":"3655aea3-bdba-4c3c-9774-8fe6905dd842","Type":"ContainerDied","Data":"273c0d74d4c0dbc6809cebc5544d99fa3034a92cad9057f1f5d54d0b3383f390"}
Sep 08 15:22:49.162248 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.162163    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c" event={"ID":"3655aea3-bdba-4c3c-9774-8fe6905dd842","Type":"ContainerDied","Data":"a13d643baa3f11fe83bf8eaf7a5432d401f3bb2c9eb257c4ac2df595237a7617"}
Sep 08 15:22:49.162248 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.162186    2580 scope.go:117] "RemoveContainer" containerID="273c0d74d4c0dbc6809cebc5544d99fa3034a92cad9057f1f5d54d0b3383f390"
Sep 08 15:22:49.164142 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.164118    2580 generic.go:356] "Generic (PLEG): container finished" podID="08016a2d-a147-4bc3-b8ca-0d15e8a96772" containerID="fde545da46ce9e93a6f35ed455c75ab23ffeae534047ca6c67904beccc7b39b9" exitCode=0
Sep 08 15:22:49.164270 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.164164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6" event={"ID":"08016a2d-a147-4bc3-b8ca-0d15e8a96772","Type":"ContainerDied","Data":"fde545da46ce9e93a6f35ed455c75ab23ffeae534047ca6c67904beccc7b39b9"}
Sep 08 15:22:49.173629 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.173613    2580 scope.go:117] "RemoveContainer" containerID="18381549b88c51521e3e61cf8398a22fc7f74dbac3304e68c17b974777198718"
Sep 08 15:22:49.184794 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.184477    2580 scope.go:117] "RemoveContainer" containerID="273c0d74d4c0dbc6809cebc5544d99fa3034a92cad9057f1f5d54d0b3383f390"
Sep 08 15:22:49.185218 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:22:49.185068    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"273c0d74d4c0dbc6809cebc5544d99fa3034a92cad9057f1f5d54d0b3383f390\": container with ID starting with 273c0d74d4c0dbc6809cebc5544d99fa3034a92cad9057f1f5d54d0b3383f390 not found: ID does not exist" containerID="273c0d74d4c0dbc6809cebc5544d99fa3034a92cad9057f1f5d54d0b3383f390"
Sep 08 15:22:49.185218 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.185107    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"273c0d74d4c0dbc6809cebc5544d99fa3034a92cad9057f1f5d54d0b3383f390"} err="failed to get container status \"273c0d74d4c0dbc6809cebc5544d99fa3034a92cad9057f1f5d54d0b3383f390\": rpc error: code = NotFound desc = could not find container \"273c0d74d4c0dbc6809cebc5544d99fa3034a92cad9057f1f5d54d0b3383f390\": container with ID starting with 273c0d74d4c0dbc6809cebc5544d99fa3034a92cad9057f1f5d54d0b3383f390 not found: ID does not exist"
Sep 08 15:22:49.185218 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.185133    2580 scope.go:117] "RemoveContainer" containerID="18381549b88c51521e3e61cf8398a22fc7f74dbac3304e68c17b974777198718"
Sep 08 15:22:49.186131 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:22:49.186052    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18381549b88c51521e3e61cf8398a22fc7f74dbac3304e68c17b974777198718\": container with ID starting with 18381549b88c51521e3e61cf8398a22fc7f74dbac3304e68c17b974777198718 not found: ID does not exist" containerID="18381549b88c51521e3e61cf8398a22fc7f74dbac3304e68c17b974777198718"
Sep 08 15:22:49.186131 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.186088    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18381549b88c51521e3e61cf8398a22fc7f74dbac3304e68c17b974777198718"} err="failed to get container status \"18381549b88c51521e3e61cf8398a22fc7f74dbac3304e68c17b974777198718\": rpc error: code = NotFound desc = could not find container \"18381549b88c51521e3e61cf8398a22fc7f74dbac3304e68c17b974777198718\": container with ID starting with 18381549b88c51521e3e61cf8398a22fc7f74dbac3304e68c17b974777198718 not found: ID does not exist"
Sep 08 15:22:49.201785 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.201739    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"]
Sep 08 15:22:49.205791 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.205758    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f9a001-openshift-default-57945bcb54-hrg9c"]
Sep 08 15:22:49.218909 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.218871    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:22:49.218909 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.218901    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:22:49.219113 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.218917    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3655aea3-bdba-4c3c-9774-8fe6905dd842-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:22:49.219113 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:49.218931    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4wsw\" (UniqueName: \"kubernetes.io/projected/3655aea3-bdba-4c3c-9774-8fe6905dd842-kube-api-access-b4wsw\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:22:50.321800 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:50.321772    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6"
Sep 08 15:22:50.432464 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:50.432372    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08016a2d-a147-4bc3-b8ca-0d15e8a96772-maas-api-service-ca\") pod \"08016a2d-a147-4bc3-b8ca-0d15e8a96772\" (UID: \"08016a2d-a147-4bc3-b8ca-0d15e8a96772\") "
Sep 08 15:22:50.432737 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:50.432709    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08016a2d-a147-4bc3-b8ca-0d15e8a96772-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "08016a2d-a147-4bc3-b8ca-0d15e8a96772" (UID: "08016a2d-a147-4bc3-b8ca-0d15e8a96772"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:22:50.534163 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:50.534125    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08016a2d-a147-4bc3-b8ca-0d15e8a96772-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:22:51.158106 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:51.158072    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3655aea3-bdba-4c3c-9774-8fe6905dd842" path="/var/lib/kubelet/pods/3655aea3-bdba-4c3c-9774-8fe6905dd842/volumes"
Sep 08 15:22:51.177381 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:51.177356    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6"
Sep 08 15:22:51.177545 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:51.177381    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6" event={"ID":"08016a2d-a147-4bc3-b8ca-0d15e8a96772","Type":"ContainerDied","Data":"3bb6b1a504df5100014a75f344433bbe63d15ea994496775da852486e05e8396"}
Sep 08 15:22:51.177545 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:22:51.177422    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3bb6b1a504df5100014a75f344433bbe63d15ea994496775da852486e05e8396"
Sep 08 15:23:01.704045 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:01.704004    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:23:03.093223 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:03.093186    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"]
Sep 08 15:23:03.093734 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:03.093432    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h" podUID="64c506b8-fdef-4140-80d9-1d34e8aafa47" containerName="payload-pre-processing" containerID="cri-o://74938e7d1d71ff2c664b99f4e90f761fff561bb6baf36cbfefffab5b4a8c383a" gracePeriod=30
Sep 08 15:23:03.248105 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:03.248059    2580 generic.go:356] "Generic (PLEG): container finished" podID="64c506b8-fdef-4140-80d9-1d34e8aafa47" containerID="74938e7d1d71ff2c664b99f4e90f761fff561bb6baf36cbfefffab5b4a8c383a" exitCode=0
Sep 08 15:23:03.248283 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:03.248125    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h" event={"ID":"64c506b8-fdef-4140-80d9-1d34e8aafa47","Type":"ContainerDied","Data":"74938e7d1d71ff2c664b99f4e90f761fff561bb6baf36cbfefffab5b4a8c383a"}
Sep 08 15:23:03.258482 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:03.258447    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6"]
Sep 08 15:23:03.262785 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:03.262755    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdd5c7-5zzd6"]
Sep 08 15:23:03.375220 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:03.375189    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"
Sep 08 15:23:03.455278 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:03.455244    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64c506b8-fdef-4140-80d9-1d34e8aafa47-plugins-config-volume\") pod \"64c506b8-fdef-4140-80d9-1d34e8aafa47\" (UID: \"64c506b8-fdef-4140-80d9-1d34e8aafa47\") "
Sep 08 15:23:03.455496 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:03.455380    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwc6c\" (UniqueName: \"kubernetes.io/projected/64c506b8-fdef-4140-80d9-1d34e8aafa47-kube-api-access-wwc6c\") pod \"64c506b8-fdef-4140-80d9-1d34e8aafa47\" (UID: \"64c506b8-fdef-4140-80d9-1d34e8aafa47\") "
Sep 08 15:23:03.455916 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:03.455882    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64c506b8-fdef-4140-80d9-1d34e8aafa47-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "64c506b8-fdef-4140-80d9-1d34e8aafa47" (UID: "64c506b8-fdef-4140-80d9-1d34e8aafa47"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:23:03.457989 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:03.457956    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64c506b8-fdef-4140-80d9-1d34e8aafa47-kube-api-access-wwc6c" (OuterVolumeSpecName: "kube-api-access-wwc6c") pod "64c506b8-fdef-4140-80d9-1d34e8aafa47" (UID: "64c506b8-fdef-4140-80d9-1d34e8aafa47"). InnerVolumeSpecName "kube-api-access-wwc6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:23:03.557007 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:03.556967    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwc6c\" (UniqueName: \"kubernetes.io/projected/64c506b8-fdef-4140-80d9-1d34e8aafa47-kube-api-access-wwc6c\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:23:03.557007 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:03.557003    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64c506b8-fdef-4140-80d9-1d34e8aafa47-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:23:04.255393 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:04.255363    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"
Sep 08 15:23:04.255888 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:04.255409    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h" event={"ID":"64c506b8-fdef-4140-80d9-1d34e8aafa47","Type":"ContainerDied","Data":"22b8229731f0c48e4a48bdfffff7a32bd7eead2b013abfeaef7cf8f7ec1996f0"}
Sep 08 15:23:04.255888 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:04.255484    2580 scope.go:117] "RemoveContainer" containerID="74938e7d1d71ff2c664b99f4e90f761fff561bb6baf36cbfefffab5b4a8c383a"
Sep 08 15:23:04.277709 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:04.277673    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"]
Sep 08 15:23:04.282081 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:04.282055    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h"]
Sep 08 15:23:04.325043 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:04.325004    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bdd5c7-765cc894c4-dn59h" podUID="64c506b8-fdef-4140-80d9-1d34e8aafa47" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.82:9004: i/o timeout"
Sep 08 15:23:05.157091 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:05.157060    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08016a2d-a147-4bc3-b8ca-0d15e8a96772" path="/var/lib/kubelet/pods/08016a2d-a147-4bc3-b8ca-0d15e8a96772/volumes"
Sep 08 15:23:05.157459 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:05.157445    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64c506b8-fdef-4140-80d9-1d34e8aafa47" path="/var/lib/kubelet/pods/64c506b8-fdef-4140-80d9-1d34e8aafa47/volumes"
Sep 08 15:23:13.009814 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:13.009772    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:23:21.535087 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:21.535050    2580 scope.go:117] "RemoveContainer" containerID="0ea0efaaf3521d9c06484576c554779a4619fcfbe7bae397d455a4504f907ebc"
Sep 08 15:23:51.673237 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:51.673151    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"]
Sep 08 15:23:51.673692 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:51.673439    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2" podUID="51ee169f-f921-44e2-89f3-5bbd93daaa41" containerName="istio-proxy" containerID="cri-o://6215e36298cef7676c895a1e767aaeb30f6a52cce46b0fb3368a449998b0245b" gracePeriod=30
Sep 08 15:23:52.063389 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.063354    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z"]
Sep 08 15:23:52.070744 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.070705    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64c506b8-fdef-4140-80d9-1d34e8aafa47" containerName="payload-pre-processing"
Sep 08 15:23:52.070970 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.070953    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="64c506b8-fdef-4140-80d9-1d34e8aafa47" containerName="payload-pre-processing"
Sep 08 15:23:52.071081 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.071065    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3655aea3-bdba-4c3c-9774-8fe6905dd842" containerName="istio-proxy"
Sep 08 15:23:52.071182 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.071170    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3655aea3-bdba-4c3c-9774-8fe6905dd842" containerName="istio-proxy"
Sep 08 15:23:52.071418 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.071395    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3655aea3-bdba-4c3c-9774-8fe6905dd842" containerName="istio-proxy"
Sep 08 15:23:52.071593 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.071570    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3655aea3-bdba-4c3c-9774-8fe6905dd842" containerName="istio-proxy"
Sep 08 15:23:52.071723 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.071598    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08016a2d-a147-4bc3-b8ca-0d15e8a96772" containerName="revoke-keys"
Sep 08 15:23:52.071723 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.071607    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="08016a2d-a147-4bc3-b8ca-0d15e8a96772" containerName="revoke-keys"
Sep 08 15:23:52.071994 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.071967    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3655aea3-bdba-4c3c-9774-8fe6905dd842" containerName="istio-proxy"
Sep 08 15:23:52.072091 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.072000    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="08016a2d-a147-4bc3-b8ca-0d15e8a96772" containerName="revoke-keys"
Sep 08 15:23:52.072091 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.072009    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="64c506b8-fdef-4140-80d9-1d34e8aafa47" containerName="payload-pre-processing"
Sep 08 15:23:52.075218 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.075196    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z"]
Sep 08 15:23:52.075322 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.075305    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z"
Sep 08 15:23:52.078758 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.078736    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:23:52.079026 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.079005    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:23:52.133098 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.133056    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z\" (UID: \"bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z"
Sep 08 15:23:52.234163 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.234115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z\" (UID: \"bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z"
Sep 08 15:23:52.234812 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.234784    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z\" (UID: \"bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z"
Sep 08 15:23:52.387813 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.387727    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z"
Sep 08 15:23:52.664498 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:52.664417    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z"]
Sep 08 15:23:52.667832 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:23:52.667800    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd2c0e8b_17d9_4f00_b683_097e2d5f6ce8.slice/crio-c0f174cfd6b7d478e29074c6fababaf6fb25027883d2c29ab83ec31ab4860594 WatchSource:0}: Error finding container c0f174cfd6b7d478e29074c6fababaf6fb25027883d2c29ab83ec31ab4860594: Status 404 returned error can't find the container with id c0f174cfd6b7d478e29074c6fababaf6fb25027883d2c29ab83ec31ab4860594
Sep 08 15:23:53.520649 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:53.520611    2580 generic.go:356] "Generic (PLEG): container finished" podID="bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8" containerID="314d6b026e6efe7cd14d10b1c378f75ed4558f270525e0e23f568b678b051c78" exitCode=0
Sep 08 15:23:53.521037 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:53.520700    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z" event={"ID":"bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8","Type":"ContainerDied","Data":"314d6b026e6efe7cd14d10b1c378f75ed4558f270525e0e23f568b678b051c78"}
Sep 08 15:23:53.521037 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:53.520751    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z" event={"ID":"bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8","Type":"ContainerStarted","Data":"c0f174cfd6b7d478e29074c6fababaf6fb25027883d2c29ab83ec31ab4860594"}
Sep 08 15:23:54.661924 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:54.661897    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z"
Sep 08 15:23:54.759572 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:54.759533    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8-maas-api-service-ca\") pod \"bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8\" (UID: \"bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8\") "
Sep 08 15:23:54.759927 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:54.759901    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8" (UID: "bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:23:54.861060 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:54.860974    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:23:55.533752 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:55.533722    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z"
Sep 08 15:23:55.533926 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:55.533752    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z" event={"ID":"bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8","Type":"ContainerDied","Data":"c0f174cfd6b7d478e29074c6fababaf6fb25027883d2c29ab83ec31ab4860594"}
Sep 08 15:23:55.533926 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:55.533797    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0f174cfd6b7d478e29074c6fababaf6fb25027883d2c29ab83ec31ab4860594"
Sep 08 15:23:56.934071 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:56.934007    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:23:57.081407 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.081349    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-envoy\") pod \"51ee169f-f921-44e2-89f3-5bbd93daaa41\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") "
Sep 08 15:23:57.081407 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.081414    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-podinfo\") pod \"51ee169f-f921-44e2-89f3-5bbd93daaa41\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") "
Sep 08 15:23:57.081701 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.081452    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-workload-socket\") pod \"51ee169f-f921-44e2-89f3-5bbd93daaa41\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") "
Sep 08 15:23:57.081701 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.081489    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-token\") pod \"51ee169f-f921-44e2-89f3-5bbd93daaa41\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") "
Sep 08 15:23:57.081701 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.081583    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-workload-certs\") pod \"51ee169f-f921-44e2-89f3-5bbd93daaa41\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") "
Sep 08 15:23:57.081701 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.081616    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51ee169f-f921-44e2-89f3-5bbd93daaa41-istiod-ca-cert\") pod \"51ee169f-f921-44e2-89f3-5bbd93daaa41\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") "
Sep 08 15:23:57.081701 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.081646    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4lxn\" (UniqueName: \"kubernetes.io/projected/51ee169f-f921-44e2-89f3-5bbd93daaa41-kube-api-access-z4lxn\") pod \"51ee169f-f921-44e2-89f3-5bbd93daaa41\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") "
Sep 08 15:23:57.081701 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.081676    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-credential-socket\") pod \"51ee169f-f921-44e2-89f3-5bbd93daaa41\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") "
Sep 08 15:23:57.082006 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.081725    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-data\") pod \"51ee169f-f921-44e2-89f3-5bbd93daaa41\" (UID: \"51ee169f-f921-44e2-89f3-5bbd93daaa41\") "
Sep 08 15:23:57.082006 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.081766    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51ee169f-f921-44e2-89f3-5bbd93daaa41" (UID: "51ee169f-f921-44e2-89f3-5bbd93daaa41"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:23:57.082006 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.081883    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51ee169f-f921-44e2-89f3-5bbd93daaa41" (UID: "51ee169f-f921-44e2-89f3-5bbd93daaa41"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:23:57.082006 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.081966    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ee169f-f921-44e2-89f3-5bbd93daaa41-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51ee169f-f921-44e2-89f3-5bbd93daaa41" (UID: "51ee169f-f921-44e2-89f3-5bbd93daaa41"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:23:57.082207 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.082147    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-data" (OuterVolumeSpecName: "istio-data") pod "51ee169f-f921-44e2-89f3-5bbd93daaa41" (UID: "51ee169f-f921-44e2-89f3-5bbd93daaa41"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:23:57.082207 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.082171    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51ee169f-f921-44e2-89f3-5bbd93daaa41" (UID: "51ee169f-f921-44e2-89f3-5bbd93daaa41"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:23:57.082207 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.082191    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51ee169f-f921-44e2-89f3-5bbd93daaa41-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:23:57.082310 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.082209    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:23:57.082310 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.082222    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:23:57.084227 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.084205    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ee169f-f921-44e2-89f3-5bbd93daaa41-kube-api-access-z4lxn" (OuterVolumeSpecName: "kube-api-access-z4lxn") pod "51ee169f-f921-44e2-89f3-5bbd93daaa41" (UID: "51ee169f-f921-44e2-89f3-5bbd93daaa41"). InnerVolumeSpecName "kube-api-access-z4lxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:23:57.084227 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.084205    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51ee169f-f921-44e2-89f3-5bbd93daaa41" (UID: "51ee169f-f921-44e2-89f3-5bbd93daaa41"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:23:57.084401 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.084244    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51ee169f-f921-44e2-89f3-5bbd93daaa41" (UID: "51ee169f-f921-44e2-89f3-5bbd93daaa41"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:23:57.084401 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.084252    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-token" (OuterVolumeSpecName: "istio-token") pod "51ee169f-f921-44e2-89f3-5bbd93daaa41" (UID: "51ee169f-f921-44e2-89f3-5bbd93daaa41"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:23:57.183301 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.183260    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4lxn\" (UniqueName: \"kubernetes.io/projected/51ee169f-f921-44e2-89f3-5bbd93daaa41-kube-api-access-z4lxn\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:23:57.183301 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.183292    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:23:57.183301 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.183302    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:23:57.183301 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.183311    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:23:57.183580 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.183320    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:23:57.183580 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.183327    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51ee169f-f921-44e2-89f3-5bbd93daaa41-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:23:57.546879 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.546843    2580 generic.go:356] "Generic (PLEG): container finished" podID="51ee169f-f921-44e2-89f3-5bbd93daaa41" containerID="6215e36298cef7676c895a1e767aaeb30f6a52cce46b0fb3368a449998b0245b" exitCode=0
Sep 08 15:23:57.547084 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.546905    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"
Sep 08 15:23:57.547084 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.546933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2" event={"ID":"51ee169f-f921-44e2-89f3-5bbd93daaa41","Type":"ContainerDied","Data":"6215e36298cef7676c895a1e767aaeb30f6a52cce46b0fb3368a449998b0245b"}
Sep 08 15:23:57.547084 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.547000    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2" event={"ID":"51ee169f-f921-44e2-89f3-5bbd93daaa41","Type":"ContainerDied","Data":"7939b37a9816acc8e848307f3256afd4ec1a86496fd04f5300213eab97a5c77f"}
Sep 08 15:23:57.547084 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.547029    2580 scope.go:117] "RemoveContainer" containerID="6215e36298cef7676c895a1e767aaeb30f6a52cce46b0fb3368a449998b0245b"
Sep 08 15:23:57.556073 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.556045    2580 scope.go:117] "RemoveContainer" containerID="e00677d95f29c68baa86e26c2eb9ee37e305fb2db876f971cb499ae82c9208b3"
Sep 08 15:23:57.564882 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.564861    2580 scope.go:117] "RemoveContainer" containerID="6215e36298cef7676c895a1e767aaeb30f6a52cce46b0fb3368a449998b0245b"
Sep 08 15:23:57.565217 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:23:57.565196    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6215e36298cef7676c895a1e767aaeb30f6a52cce46b0fb3368a449998b0245b\": container with ID starting with 6215e36298cef7676c895a1e767aaeb30f6a52cce46b0fb3368a449998b0245b not found: ID does not exist" containerID="6215e36298cef7676c895a1e767aaeb30f6a52cce46b0fb3368a449998b0245b"
Sep 08 15:23:57.565280 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.565225    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6215e36298cef7676c895a1e767aaeb30f6a52cce46b0fb3368a449998b0245b"} err="failed to get container status \"6215e36298cef7676c895a1e767aaeb30f6a52cce46b0fb3368a449998b0245b\": rpc error: code = NotFound desc = could not find container \"6215e36298cef7676c895a1e767aaeb30f6a52cce46b0fb3368a449998b0245b\": container with ID starting with 6215e36298cef7676c895a1e767aaeb30f6a52cce46b0fb3368a449998b0245b not found: ID does not exist"
Sep 08 15:23:57.565280 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.565248    2580 scope.go:117] "RemoveContainer" containerID="e00677d95f29c68baa86e26c2eb9ee37e305fb2db876f971cb499ae82c9208b3"
Sep 08 15:23:57.565544 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:23:57.565525    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e00677d95f29c68baa86e26c2eb9ee37e305fb2db876f971cb499ae82c9208b3\": container with ID starting with e00677d95f29c68baa86e26c2eb9ee37e305fb2db876f971cb499ae82c9208b3 not found: ID does not exist" containerID="e00677d95f29c68baa86e26c2eb9ee37e305fb2db876f971cb499ae82c9208b3"
Sep 08 15:23:57.565612 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.565553    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e00677d95f29c68baa86e26c2eb9ee37e305fb2db876f971cb499ae82c9208b3"} err="failed to get container status \"e00677d95f29c68baa86e26c2eb9ee37e305fb2db876f971cb499ae82c9208b3\": rpc error: code = NotFound desc = could not find container \"e00677d95f29c68baa86e26c2eb9ee37e305fb2db876f971cb499ae82c9208b3\": container with ID starting with e00677d95f29c68baa86e26c2eb9ee37e305fb2db876f971cb499ae82c9208b3 not found: ID does not exist"
Sep 08 15:23:57.569633 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.569610    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"]
Sep 08 15:23:57.574436 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:57.574413    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-bdd5c7-openshift-default-764846ff64-clxz2"]
Sep 08 15:23:59.156468 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:23:59.156430    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51ee169f-f921-44e2-89f3-5bbd93daaa41" path="/var/lib/kubelet/pods/51ee169f-f921-44e2-89f3-5bbd93daaa41/volumes"
Sep 08 15:24:02.719775 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:02.719736    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"]
Sep 08 15:24:02.720237 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:02.720000    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc" podUID="58065af6-81c1-4ce1-95d6-fb27788f9ebb" containerName="payload-processing" containerID="cri-o://3da20b922180ab0cb016f485059e8a398a7fe3bbbe933d0d92c9972d55f96682" gracePeriod=30
Sep 08 15:24:02.729642 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:02.729611    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"]
Sep 08 15:24:02.729880 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:02.729853    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc" podUID="899da0ad-57e0-4812-a891-daed7878eeb9" containerName="payload-pre-processing" containerID="cri-o://d60135a45f5eeb3da8784e4f3f58088f0f390609ae3536a51375ce71632f2fdd" gracePeriod=30
Sep 08 15:24:02.993621 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:02.993590    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"
Sep 08 15:24:03.039100 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.039069    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"
Sep 08 15:24:03.130875 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.130830    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z"]
Sep 08 15:24:03.132720 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.132693    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fa02a8-4nx4z"]
Sep 08 15:24:03.139648 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.139622    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/899da0ad-57e0-4812-a891-daed7878eeb9-plugins-config-volume\") pod \"899da0ad-57e0-4812-a891-daed7878eeb9\" (UID: \"899da0ad-57e0-4812-a891-daed7878eeb9\") "
Sep 08 15:24:03.139717 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.139661    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58065af6-81c1-4ce1-95d6-fb27788f9ebb-plugins-config-volume\") pod \"58065af6-81c1-4ce1-95d6-fb27788f9ebb\" (UID: \"58065af6-81c1-4ce1-95d6-fb27788f9ebb\") "
Sep 08 15:24:03.139717 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.139693    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l894m\" (UniqueName: \"kubernetes.io/projected/899da0ad-57e0-4812-a891-daed7878eeb9-kube-api-access-l894m\") pod \"899da0ad-57e0-4812-a891-daed7878eeb9\" (UID: \"899da0ad-57e0-4812-a891-daed7878eeb9\") "
Sep 08 15:24:03.139828 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.139809    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fq2wq\" (UniqueName: \"kubernetes.io/projected/58065af6-81c1-4ce1-95d6-fb27788f9ebb-kube-api-access-fq2wq\") pod \"58065af6-81c1-4ce1-95d6-fb27788f9ebb\" (UID: \"58065af6-81c1-4ce1-95d6-fb27788f9ebb\") "
Sep 08 15:24:03.140040 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.140016    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58065af6-81c1-4ce1-95d6-fb27788f9ebb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "58065af6-81c1-4ce1-95d6-fb27788f9ebb" (UID: "58065af6-81c1-4ce1-95d6-fb27788f9ebb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:24:03.140139 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.140073    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/899da0ad-57e0-4812-a891-daed7878eeb9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "899da0ad-57e0-4812-a891-daed7878eeb9" (UID: "899da0ad-57e0-4812-a891-daed7878eeb9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:24:03.140183 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.140145    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/899da0ad-57e0-4812-a891-daed7878eeb9-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:03.140183 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.140158    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58065af6-81c1-4ce1-95d6-fb27788f9ebb-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:03.141953 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.141928    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58065af6-81c1-4ce1-95d6-fb27788f9ebb-kube-api-access-fq2wq" (OuterVolumeSpecName: "kube-api-access-fq2wq") pod "58065af6-81c1-4ce1-95d6-fb27788f9ebb" (UID: "58065af6-81c1-4ce1-95d6-fb27788f9ebb"). InnerVolumeSpecName "kube-api-access-fq2wq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:24:03.142026 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.141965    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/899da0ad-57e0-4812-a891-daed7878eeb9-kube-api-access-l894m" (OuterVolumeSpecName: "kube-api-access-l894m") pod "899da0ad-57e0-4812-a891-daed7878eeb9" (UID: "899da0ad-57e0-4812-a891-daed7878eeb9"). InnerVolumeSpecName "kube-api-access-l894m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:24:03.156451 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.156420    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8" path="/var/lib/kubelet/pods/bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8/volumes"
Sep 08 15:24:03.241011 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.240904    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l894m\" (UniqueName: \"kubernetes.io/projected/899da0ad-57e0-4812-a891-daed7878eeb9-kube-api-access-l894m\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:03.241011 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.240943    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fq2wq\" (UniqueName: \"kubernetes.io/projected/58065af6-81c1-4ce1-95d6-fb27788f9ebb-kube-api-access-fq2wq\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:03.581174 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.581079    2580 generic.go:356] "Generic (PLEG): container finished" podID="899da0ad-57e0-4812-a891-daed7878eeb9" containerID="d60135a45f5eeb3da8784e4f3f58088f0f390609ae3536a51375ce71632f2fdd" exitCode=0
Sep 08 15:24:03.581174 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.581127    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"
Sep 08 15:24:03.581399 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.581165    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc" event={"ID":"899da0ad-57e0-4812-a891-daed7878eeb9","Type":"ContainerDied","Data":"d60135a45f5eeb3da8784e4f3f58088f0f390609ae3536a51375ce71632f2fdd"}
Sep 08 15:24:03.581399 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.581219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc" event={"ID":"899da0ad-57e0-4812-a891-daed7878eeb9","Type":"ContainerDied","Data":"cf3e434aa61d3233b7942e65a59d4314146248590b1c2b93cc9128c5097c5286"}
Sep 08 15:24:03.581399 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.581240    2580 scope.go:117] "RemoveContainer" containerID="d60135a45f5eeb3da8784e4f3f58088f0f390609ae3536a51375ce71632f2fdd"
Sep 08 15:24:03.582660 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.582632    2580 generic.go:356] "Generic (PLEG): container finished" podID="58065af6-81c1-4ce1-95d6-fb27788f9ebb" containerID="3da20b922180ab0cb016f485059e8a398a7fe3bbbe933d0d92c9972d55f96682" exitCode=0
Sep 08 15:24:03.582779 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.582685    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"
Sep 08 15:24:03.582779 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.582716    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc" event={"ID":"58065af6-81c1-4ce1-95d6-fb27788f9ebb","Type":"ContainerDied","Data":"3da20b922180ab0cb016f485059e8a398a7fe3bbbe933d0d92c9972d55f96682"}
Sep 08 15:24:03.582779 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.582763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc" event={"ID":"58065af6-81c1-4ce1-95d6-fb27788f9ebb","Type":"ContainerDied","Data":"aacd203591cf770a009d41964553be72fac8822124df21c21a88a93695b71baf"}
Sep 08 15:24:03.590588 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.590564    2580 scope.go:117] "RemoveContainer" containerID="d60135a45f5eeb3da8784e4f3f58088f0f390609ae3536a51375ce71632f2fdd"
Sep 08 15:24:03.590920 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:24:03.590891    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d60135a45f5eeb3da8784e4f3f58088f0f390609ae3536a51375ce71632f2fdd\": container with ID starting with d60135a45f5eeb3da8784e4f3f58088f0f390609ae3536a51375ce71632f2fdd not found: ID does not exist" containerID="d60135a45f5eeb3da8784e4f3f58088f0f390609ae3536a51375ce71632f2fdd"
Sep 08 15:24:03.590991 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.590924    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d60135a45f5eeb3da8784e4f3f58088f0f390609ae3536a51375ce71632f2fdd"} err="failed to get container status \"d60135a45f5eeb3da8784e4f3f58088f0f390609ae3536a51375ce71632f2fdd\": rpc error: code = NotFound desc = could not find container \"d60135a45f5eeb3da8784e4f3f58088f0f390609ae3536a51375ce71632f2fdd\": container with ID starting with d60135a45f5eeb3da8784e4f3f58088f0f390609ae3536a51375ce71632f2fdd not found: ID does not exist"
Sep 08 15:24:03.590991 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.590941    2580 scope.go:117] "RemoveContainer" containerID="3da20b922180ab0cb016f485059e8a398a7fe3bbbe933d0d92c9972d55f96682"
Sep 08 15:24:03.598067 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.598037    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"]
Sep 08 15:24:03.599746 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.599721    2580 scope.go:117] "RemoveContainer" containerID="3da20b922180ab0cb016f485059e8a398a7fe3bbbe933d0d92c9972d55f96682"
Sep 08 15:24:03.600129 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:24:03.600092    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3da20b922180ab0cb016f485059e8a398a7fe3bbbe933d0d92c9972d55f96682\": container with ID starting with 3da20b922180ab0cb016f485059e8a398a7fe3bbbe933d0d92c9972d55f96682 not found: ID does not exist" containerID="3da20b922180ab0cb016f485059e8a398a7fe3bbbe933d0d92c9972d55f96682"
Sep 08 15:24:03.600194 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.600140    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da20b922180ab0cb016f485059e8a398a7fe3bbbe933d0d92c9972d55f96682"} err="failed to get container status \"3da20b922180ab0cb016f485059e8a398a7fe3bbbe933d0d92c9972d55f96682\": rpc error: code = NotFound desc = could not find container \"3da20b922180ab0cb016f485059e8a398a7fe3bbbe933d0d92c9972d55f96682\": container with ID starting with 3da20b922180ab0cb016f485059e8a398a7fe3bbbe933d0d92c9972d55f96682 not found: ID does not exist"
Sep 08 15:24:03.602051 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.602031    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fa02a8-d74465f8c-f5qgc"]
Sep 08 15:24:03.613263 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.613235    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"]
Sep 08 15:24:03.618152 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:03.618126    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fa02a8-6c9c8bbb-cffrc"]
Sep 08 15:24:05.156953 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:05.156921    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58065af6-81c1-4ce1-95d6-fb27788f9ebb" path="/var/lib/kubelet/pods/58065af6-81c1-4ce1-95d6-fb27788f9ebb/volumes"
Sep 08 15:24:05.157330 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:05.157299    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="899da0ad-57e0-4812-a891-daed7878eeb9" path="/var/lib/kubelet/pods/899da0ad-57e0-4812-a891-daed7878eeb9/volumes"
Sep 08 15:24:06.504891 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:06.504844    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:24:10.235481 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.235446    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj"]
Sep 08 15:24:10.235881 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.235848    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="899da0ad-57e0-4812-a891-daed7878eeb9" containerName="payload-pre-processing"
Sep 08 15:24:10.235881 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.235865    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="899da0ad-57e0-4812-a891-daed7878eeb9" containerName="payload-pre-processing"
Sep 08 15:24:10.235967 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.235890    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58065af6-81c1-4ce1-95d6-fb27788f9ebb" containerName="payload-processing"
Sep 08 15:24:10.235967 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.235899    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="58065af6-81c1-4ce1-95d6-fb27788f9ebb" containerName="payload-processing"
Sep 08 15:24:10.235967 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.235920    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ee169f-f921-44e2-89f3-5bbd93daaa41" containerName="istio-proxy"
Sep 08 15:24:10.235967 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.235928    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ee169f-f921-44e2-89f3-5bbd93daaa41" containerName="istio-proxy"
Sep 08 15:24:10.235967 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.235946    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8" containerName="revoke-keys"
Sep 08 15:24:10.235967 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.235955    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8" containerName="revoke-keys"
Sep 08 15:24:10.235967 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.235963    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ee169f-f921-44e2-89f3-5bbd93daaa41" containerName="istio-proxy"
Sep 08 15:24:10.235967 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.235968    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ee169f-f921-44e2-89f3-5bbd93daaa41" containerName="istio-proxy"
Sep 08 15:24:10.236360 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.236034    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="51ee169f-f921-44e2-89f3-5bbd93daaa41" containerName="istio-proxy"
Sep 08 15:24:10.236360 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.236043    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="899da0ad-57e0-4812-a891-daed7878eeb9" containerName="payload-pre-processing"
Sep 08 15:24:10.236360 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.236050    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3655aea3-bdba-4c3c-9774-8fe6905dd842" containerName="istio-proxy"
Sep 08 15:24:10.236360 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.236057    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd2c0e8b-17d9-4f00-b683-097e2d5f6ce8" containerName="revoke-keys"
Sep 08 15:24:10.236360 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.236063    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="58065af6-81c1-4ce1-95d6-fb27788f9ebb" containerName="payload-processing"
Sep 08 15:24:10.240834 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.240815    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj"
Sep 08 15:24:10.244338 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.244317    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:24:10.244458 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.244321    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:24:10.246431 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.246405    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj"]
Sep 08 15:24:10.415431 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.415394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf6f6b8-aac8-4218-ba1d-fabd23167935-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj\" (UID: \"adf6f6b8-aac8-4218-ba1d-fabd23167935\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj"
Sep 08 15:24:10.516117 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.516022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf6f6b8-aac8-4218-ba1d-fabd23167935-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj\" (UID: \"adf6f6b8-aac8-4218-ba1d-fabd23167935\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj"
Sep 08 15:24:10.516728 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.516710    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf6f6b8-aac8-4218-ba1d-fabd23167935-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj\" (UID: \"adf6f6b8-aac8-4218-ba1d-fabd23167935\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj"
Sep 08 15:24:10.553002 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.552964    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj"
Sep 08 15:24:10.824678 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:10.824643    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj"]
Sep 08 15:24:10.827220 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:24:10.827195    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf6f6b8_aac8_4218_ba1d_fabd23167935.slice/crio-76e44dd72dbc0d83bf335b2f5ebc6533e3cf52b3033e8cee8cc978d0e35d7988 WatchSource:0}: Error finding container 76e44dd72dbc0d83bf335b2f5ebc6533e3cf52b3033e8cee8cc978d0e35d7988: Status 404 returned error can't find the container with id 76e44dd72dbc0d83bf335b2f5ebc6533e3cf52b3033e8cee8cc978d0e35d7988
Sep 08 15:24:11.630535 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:11.630484    2580 generic.go:356] "Generic (PLEG): container finished" podID="adf6f6b8-aac8-4218-ba1d-fabd23167935" containerID="e54d124a9583662d8336e7b6b60bf991415fc3da602f0d124d5e3521b7ff1564" exitCode=0
Sep 08 15:24:11.630902 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:11.630554    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj" event={"ID":"adf6f6b8-aac8-4218-ba1d-fabd23167935","Type":"ContainerDied","Data":"e54d124a9583662d8336e7b6b60bf991415fc3da602f0d124d5e3521b7ff1564"}
Sep 08 15:24:11.630902 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:11.630617    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj" event={"ID":"adf6f6b8-aac8-4218-ba1d-fabd23167935","Type":"ContainerStarted","Data":"76e44dd72dbc0d83bf335b2f5ebc6533e3cf52b3033e8cee8cc978d0e35d7988"}
Sep 08 15:24:12.762411 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:12.762387    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj"
Sep 08 15:24:12.940230 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:12.940130    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf6f6b8-aac8-4218-ba1d-fabd23167935-maas-api-service-ca\") pod \"adf6f6b8-aac8-4218-ba1d-fabd23167935\" (UID: \"adf6f6b8-aac8-4218-ba1d-fabd23167935\") "
Sep 08 15:24:12.940524 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:12.940483    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf6f6b8-aac8-4218-ba1d-fabd23167935-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "adf6f6b8-aac8-4218-ba1d-fabd23167935" (UID: "adf6f6b8-aac8-4218-ba1d-fabd23167935"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:24:13.041823 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:13.041784    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf6f6b8-aac8-4218-ba1d-fabd23167935-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:13.642855 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:13.642824    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj"
Sep 08 15:24:13.642855 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:13.642841    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj" event={"ID":"adf6f6b8-aac8-4218-ba1d-fabd23167935","Type":"ContainerDied","Data":"76e44dd72dbc0d83bf335b2f5ebc6533e3cf52b3033e8cee8cc978d0e35d7988"}
Sep 08 15:24:13.643078 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:13.642883    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76e44dd72dbc0d83bf335b2f5ebc6533e3cf52b3033e8cee8cc978d0e35d7988"
Sep 08 15:24:20.841069 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:20.841035    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"]
Sep 08 15:24:20.841528 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:20.841295    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92" podUID="6a0904cf-e2e2-4d76-bb4f-915f04031923" containerName="payload-pre-processing" containerID="cri-o://293ee8097a12b27c1f869906af4a55bd45aefa5899b3eb34072d091169540ad5" gracePeriod=30
Sep 08 15:24:20.999410 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:20.999367    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj"]
Sep 08 15:24:21.001964 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:21.001934    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ffa941-w4jfj"]
Sep 08 15:24:21.114611 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:21.114584    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"
Sep 08 15:24:21.166744 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:21.166705    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adf6f6b8-aac8-4218-ba1d-fabd23167935" path="/var/lib/kubelet/pods/adf6f6b8-aac8-4218-ba1d-fabd23167935/volumes"
Sep 08 15:24:21.215759 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:21.215705    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2qks\" (UniqueName: \"kubernetes.io/projected/6a0904cf-e2e2-4d76-bb4f-915f04031923-kube-api-access-d2qks\") pod \"6a0904cf-e2e2-4d76-bb4f-915f04031923\" (UID: \"6a0904cf-e2e2-4d76-bb4f-915f04031923\") "
Sep 08 15:24:21.215964 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:21.215843    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a0904cf-e2e2-4d76-bb4f-915f04031923-plugins-config-volume\") pod \"6a0904cf-e2e2-4d76-bb4f-915f04031923\" (UID: \"6a0904cf-e2e2-4d76-bb4f-915f04031923\") "
Sep 08 15:24:21.216211 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:21.216182    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a0904cf-e2e2-4d76-bb4f-915f04031923-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6a0904cf-e2e2-4d76-bb4f-915f04031923" (UID: "6a0904cf-e2e2-4d76-bb4f-915f04031923"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:24:21.217880 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:21.217856    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a0904cf-e2e2-4d76-bb4f-915f04031923-kube-api-access-d2qks" (OuterVolumeSpecName: "kube-api-access-d2qks") pod "6a0904cf-e2e2-4d76-bb4f-915f04031923" (UID: "6a0904cf-e2e2-4d76-bb4f-915f04031923"). InnerVolumeSpecName "kube-api-access-d2qks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:24:21.317231 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:21.317197    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2qks\" (UniqueName: \"kubernetes.io/projected/6a0904cf-e2e2-4d76-bb4f-915f04031923-kube-api-access-d2qks\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:21.317231 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:21.317226    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a0904cf-e2e2-4d76-bb4f-915f04031923-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:21.567627 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:21.567597    2580 scope.go:117] "RemoveContainer" containerID="e2f8a382d20f3c94103582e3e26725b9df8bce711d9d75733f9de659d8992241"
Sep 08 15:24:21.578849 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:21.578812    2580 scope.go:117] "RemoveContainer" containerID="293ee8097a12b27c1f869906af4a55bd45aefa5899b3eb34072d091169540ad5"
Sep 08 15:24:21.685018 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:21.684980    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92" event={"ID":"6a0904cf-e2e2-4d76-bb4f-915f04031923","Type":"ContainerDied","Data":"293ee8097a12b27c1f869906af4a55bd45aefa5899b3eb34072d091169540ad5"}
Sep 08 15:24:21.685217 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:21.685028    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"
Sep 08 15:24:21.685217 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:21.685039    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92" event={"ID":"6a0904cf-e2e2-4d76-bb4f-915f04031923","Type":"ContainerDied","Data":"9a4d269766ce34ecdd605c6b4c0d40e315b231a9a234b97b6152cd291b76b6ea"}
Sep 08 15:24:21.712884 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:21.712846    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"]
Sep 08 15:24:21.718625 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:21.718596    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ffa941-758b45b74b-xst92"]
Sep 08 15:24:23.117477 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:23.117439    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:24:23.156621 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:23.156588    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a0904cf-e2e2-4d76-bb4f-915f04031923" path="/var/lib/kubelet/pods/6a0904cf-e2e2-4d76-bb4f-915f04031923/volumes"
Sep 08 15:24:28.179330 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.179291    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"]
Sep 08 15:24:28.179899 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.179573    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l" podUID="48063ef5-8d74-4b72-a67c-5329839dc225" containerName="istio-proxy" containerID="cri-o://89f30f38bbe9da6c5f5c8dc9e3618d9c854c3a918c14f8861dc50002df2ae15a" gracePeriod=30
Sep 08 15:24:28.553212 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.553177    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4"]
Sep 08 15:24:28.553582 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.553568    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf6f6b8-aac8-4218-ba1d-fabd23167935" containerName="revoke-keys"
Sep 08 15:24:28.553640 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.553584    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf6f6b8-aac8-4218-ba1d-fabd23167935" containerName="revoke-keys"
Sep 08 15:24:28.553640 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.553593    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a0904cf-e2e2-4d76-bb4f-915f04031923" containerName="payload-pre-processing"
Sep 08 15:24:28.553640 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.553599    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a0904cf-e2e2-4d76-bb4f-915f04031923" containerName="payload-pre-processing"
Sep 08 15:24:28.553739 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.553676    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a0904cf-e2e2-4d76-bb4f-915f04031923" containerName="payload-pre-processing"
Sep 08 15:24:28.553739 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.553685    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="51ee169f-f921-44e2-89f3-5bbd93daaa41" containerName="istio-proxy"
Sep 08 15:24:28.553739 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.553692    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf6f6b8-aac8-4218-ba1d-fabd23167935" containerName="revoke-keys"
Sep 08 15:24:28.556763 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.556744    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4"
Sep 08 15:24:28.559599 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.559579    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:24:28.559872 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.559852    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:24:28.568842 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.568816    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4"]
Sep 08 15:24:28.685681 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.685648    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c57b5616-700f-4c45-897b-6694c8400e43-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4\" (UID: \"c57b5616-700f-4c45-897b-6694c8400e43\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4"
Sep 08 15:24:28.786808 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.786775    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c57b5616-700f-4c45-897b-6694c8400e43-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4\" (UID: \"c57b5616-700f-4c45-897b-6694c8400e43\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4"
Sep 08 15:24:28.787374 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.787353    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c57b5616-700f-4c45-897b-6694c8400e43-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4\" (UID: \"c57b5616-700f-4c45-897b-6694c8400e43\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4"
Sep 08 15:24:28.866695 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:28.866610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4"
Sep 08 15:24:29.141026 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:29.140993    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4"]
Sep 08 15:24:29.143779 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:24:29.143748    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57b5616_700f_4c45_897b_6694c8400e43.slice/crio-33129bf596379e6092ec4d2d9807594363882844c880bf38f2bac6a4b6ce93c3 WatchSource:0}: Error finding container 33129bf596379e6092ec4d2d9807594363882844c880bf38f2bac6a4b6ce93c3: Status 404 returned error can't find the container with id 33129bf596379e6092ec4d2d9807594363882844c880bf38f2bac6a4b6ce93c3
Sep 08 15:24:29.733279 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:29.733243    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4" event={"ID":"c57b5616-700f-4c45-897b-6694c8400e43","Type":"ContainerStarted","Data":"120c48c8ed69711e71608b8cc508e60ae70f6a6497a9c41cebc0aaeafc9416bd"}
Sep 08 15:24:29.733684 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:29.733294    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4" event={"ID":"c57b5616-700f-4c45-897b-6694c8400e43","Type":"ContainerStarted","Data":"33129bf596379e6092ec4d2d9807594363882844c880bf38f2bac6a4b6ce93c3"}
Sep 08 15:24:29.748869 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:29.748820    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4" podStartSLOduration=1.7488058990000002 podStartE2EDuration="1.748805899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:24:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:24:29.748031708 +0000 UTC m=+1749.080271258" watchObservedRunningTime="2026-09-08 15:24:29.748805899 +0000 UTC m=+1749.081045444"
Sep 08 15:24:30.740155 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:30.740123    2580 generic.go:356] "Generic (PLEG): container finished" podID="c57b5616-700f-4c45-897b-6694c8400e43" containerID="120c48c8ed69711e71608b8cc508e60ae70f6a6497a9c41cebc0aaeafc9416bd" exitCode=0
Sep 08 15:24:30.740565 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:30.740213    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4" event={"ID":"c57b5616-700f-4c45-897b-6694c8400e43","Type":"ContainerDied","Data":"120c48c8ed69711e71608b8cc508e60ae70f6a6497a9c41cebc0aaeafc9416bd"}
Sep 08 15:24:31.891208 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:31.891182    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4"
Sep 08 15:24:32.020414 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:32.020321    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c57b5616-700f-4c45-897b-6694c8400e43-maas-api-service-ca\") pod \"c57b5616-700f-4c45-897b-6694c8400e43\" (UID: \"c57b5616-700f-4c45-897b-6694c8400e43\") "
Sep 08 15:24:32.020701 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:32.020677    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c57b5616-700f-4c45-897b-6694c8400e43-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c57b5616-700f-4c45-897b-6694c8400e43" (UID: "c57b5616-700f-4c45-897b-6694c8400e43"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:24:32.121297 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:32.121259    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c57b5616-700f-4c45-897b-6694c8400e43-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:32.752319 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:32.752290    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4"
Sep 08 15:24:32.752495 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:32.752294    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4" event={"ID":"c57b5616-700f-4c45-897b-6694c8400e43","Type":"ContainerDied","Data":"33129bf596379e6092ec4d2d9807594363882844c880bf38f2bac6a4b6ce93c3"}
Sep 08 15:24:32.752495 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:32.752416    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33129bf596379e6092ec4d2d9807594363882844c880bf38f2bac6a4b6ce93c3"
Sep 08 15:24:33.065846 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.065757    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:24:33.065846 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.065827    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l" podUID="48063ef5-8d74-4b72-a67c-5329839dc225" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:24:33.433685 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.433659    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:24:33.534207 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.534163    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-workload-socket\") pod \"48063ef5-8d74-4b72-a67c-5329839dc225\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") "
Sep 08 15:24:33.534360 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.534226    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48063ef5-8d74-4b72-a67c-5329839dc225-istio-token\") pod \"48063ef5-8d74-4b72-a67c-5329839dc225\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") "
Sep 08 15:24:33.534360 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.534268    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf95l\" (UniqueName: \"kubernetes.io/projected/48063ef5-8d74-4b72-a67c-5329839dc225-kube-api-access-kf95l\") pod \"48063ef5-8d74-4b72-a67c-5329839dc225\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") "
Sep 08 15:24:33.534360 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.534296    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-istio-envoy\") pod \"48063ef5-8d74-4b72-a67c-5329839dc225\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") "
Sep 08 15:24:33.534360 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.534342    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48063ef5-8d74-4b72-a67c-5329839dc225-istiod-ca-cert\") pod \"48063ef5-8d74-4b72-a67c-5329839dc225\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") "
Sep 08 15:24:33.534604 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.534384    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48063ef5-8d74-4b72-a67c-5329839dc225-istio-podinfo\") pod \"48063ef5-8d74-4b72-a67c-5329839dc225\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") "
Sep 08 15:24:33.534604 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.534412    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-workload-certs\") pod \"48063ef5-8d74-4b72-a67c-5329839dc225\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") "
Sep 08 15:24:33.534604 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.534438    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-istio-data\") pod \"48063ef5-8d74-4b72-a67c-5329839dc225\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") "
Sep 08 15:24:33.534604 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.534467    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-credential-socket\") pod \"48063ef5-8d74-4b72-a67c-5329839dc225\" (UID: \"48063ef5-8d74-4b72-a67c-5329839dc225\") "
Sep 08 15:24:33.534604 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.534478    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "48063ef5-8d74-4b72-a67c-5329839dc225" (UID: "48063ef5-8d74-4b72-a67c-5329839dc225"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:24:33.534955 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.534808    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:33.534955 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.534806    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "48063ef5-8d74-4b72-a67c-5329839dc225" (UID: "48063ef5-8d74-4b72-a67c-5329839dc225"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:24:33.534955 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.534824    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-istio-data" (OuterVolumeSpecName: "istio-data") pod "48063ef5-8d74-4b72-a67c-5329839dc225" (UID: "48063ef5-8d74-4b72-a67c-5329839dc225"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:24:33.535124 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.535003    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "48063ef5-8d74-4b72-a67c-5329839dc225" (UID: "48063ef5-8d74-4b72-a67c-5329839dc225"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:24:33.535124 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.535045    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48063ef5-8d74-4b72-a67c-5329839dc225-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "48063ef5-8d74-4b72-a67c-5329839dc225" (UID: "48063ef5-8d74-4b72-a67c-5329839dc225"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:24:33.536686 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.536650    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/48063ef5-8d74-4b72-a67c-5329839dc225-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "48063ef5-8d74-4b72-a67c-5329839dc225" (UID: "48063ef5-8d74-4b72-a67c-5329839dc225"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:24:33.536797 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.536656    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48063ef5-8d74-4b72-a67c-5329839dc225-istio-token" (OuterVolumeSpecName: "istio-token") pod "48063ef5-8d74-4b72-a67c-5329839dc225" (UID: "48063ef5-8d74-4b72-a67c-5329839dc225"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:24:33.536797 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.536660    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48063ef5-8d74-4b72-a67c-5329839dc225-kube-api-access-kf95l" (OuterVolumeSpecName: "kube-api-access-kf95l") pod "48063ef5-8d74-4b72-a67c-5329839dc225" (UID: "48063ef5-8d74-4b72-a67c-5329839dc225"). InnerVolumeSpecName "kube-api-access-kf95l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:24:33.536797 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.536717    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "48063ef5-8d74-4b72-a67c-5329839dc225" (UID: "48063ef5-8d74-4b72-a67c-5329839dc225"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:24:33.636271 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.636183    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48063ef5-8d74-4b72-a67c-5329839dc225-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:33.636271 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.636216    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48063ef5-8d74-4b72-a67c-5329839dc225-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:33.636271 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.636225    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:33.636271 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.636234    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:33.636271 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.636241    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:33.636271 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.636251    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48063ef5-8d74-4b72-a67c-5329839dc225-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:33.636271 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.636259    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf95l\" (UniqueName: \"kubernetes.io/projected/48063ef5-8d74-4b72-a67c-5329839dc225-kube-api-access-kf95l\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:33.636271 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.636267    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48063ef5-8d74-4b72-a67c-5329839dc225-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:33.759022 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.758993    2580 generic.go:356] "Generic (PLEG): container finished" podID="48063ef5-8d74-4b72-a67c-5329839dc225" containerID="89f30f38bbe9da6c5f5c8dc9e3618d9c854c3a918c14f8861dc50002df2ae15a" exitCode=0
Sep 08 15:24:33.759174 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.759052    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"
Sep 08 15:24:33.759174 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.759074    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l" event={"ID":"48063ef5-8d74-4b72-a67c-5329839dc225","Type":"ContainerDied","Data":"89f30f38bbe9da6c5f5c8dc9e3618d9c854c3a918c14f8861dc50002df2ae15a"}
Sep 08 15:24:33.759174 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.759128    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l" event={"ID":"48063ef5-8d74-4b72-a67c-5329839dc225","Type":"ContainerDied","Data":"22c7a1fc82ef9d233d99c4db6f80b6e08b4f718bf2a9da911fa7b5dad5930dd0"}
Sep 08 15:24:33.759174 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.759154    2580 scope.go:117] "RemoveContainer" containerID="89f30f38bbe9da6c5f5c8dc9e3618d9c854c3a918c14f8861dc50002df2ae15a"
Sep 08 15:24:33.769272 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.769249    2580 scope.go:117] "RemoveContainer" containerID="b8871f053c1b379f7f836401c625ed21cd2811692e9c1abf2811017f96bc4d60"
Sep 08 15:24:33.779421 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.779397    2580 scope.go:117] "RemoveContainer" containerID="89f30f38bbe9da6c5f5c8dc9e3618d9c854c3a918c14f8861dc50002df2ae15a"
Sep 08 15:24:33.779775 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:24:33.779751    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89f30f38bbe9da6c5f5c8dc9e3618d9c854c3a918c14f8861dc50002df2ae15a\": container with ID starting with 89f30f38bbe9da6c5f5c8dc9e3618d9c854c3a918c14f8861dc50002df2ae15a not found: ID does not exist" containerID="89f30f38bbe9da6c5f5c8dc9e3618d9c854c3a918c14f8861dc50002df2ae15a"
Sep 08 15:24:33.779898 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.779787    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89f30f38bbe9da6c5f5c8dc9e3618d9c854c3a918c14f8861dc50002df2ae15a"} err="failed to get container status \"89f30f38bbe9da6c5f5c8dc9e3618d9c854c3a918c14f8861dc50002df2ae15a\": rpc error: code = NotFound desc = could not find container \"89f30f38bbe9da6c5f5c8dc9e3618d9c854c3a918c14f8861dc50002df2ae15a\": container with ID starting with 89f30f38bbe9da6c5f5c8dc9e3618d9c854c3a918c14f8861dc50002df2ae15a not found: ID does not exist"
Sep 08 15:24:33.779898 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.779813    2580 scope.go:117] "RemoveContainer" containerID="b8871f053c1b379f7f836401c625ed21cd2811692e9c1abf2811017f96bc4d60"
Sep 08 15:24:33.780166 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:24:33.780140    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8871f053c1b379f7f836401c625ed21cd2811692e9c1abf2811017f96bc4d60\": container with ID starting with b8871f053c1b379f7f836401c625ed21cd2811692e9c1abf2811017f96bc4d60 not found: ID does not exist" containerID="b8871f053c1b379f7f836401c625ed21cd2811692e9c1abf2811017f96bc4d60"
Sep 08 15:24:33.780287 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.780171    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8871f053c1b379f7f836401c625ed21cd2811692e9c1abf2811017f96bc4d60"} err="failed to get container status \"b8871f053c1b379f7f836401c625ed21cd2811692e9c1abf2811017f96bc4d60\": rpc error: code = NotFound desc = could not find container \"b8871f053c1b379f7f836401c625ed21cd2811692e9c1abf2811017f96bc4d60\": container with ID starting with b8871f053c1b379f7f836401c625ed21cd2811692e9c1abf2811017f96bc4d60 not found: ID does not exist"
Sep 08 15:24:33.783943 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.783911    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"]
Sep 08 15:24:33.787258 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:33.787236    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ffa941-openshift-default-86f699fb7d-cqx5l"]
Sep 08 15:24:35.156124 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:35.156091    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48063ef5-8d74-4b72-a67c-5329839dc225" path="/var/lib/kubelet/pods/48063ef5-8d74-4b72-a67c-5329839dc225/volumes"
Sep 08 15:24:39.158086 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:39.158048    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7be222-29814675-pktxd"]
Sep 08 15:24:39.159347 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:39.159324    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7be222-29814675-pktxd"]
Sep 08 15:24:39.372922 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:39.372875    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4"]
Sep 08 15:24:39.377263 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:39.377238    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7be222-nv6m4"]
Sep 08 15:24:41.156008 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:41.155976    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a01b065-153f-4ce6-8665-2f5c8f12021d" path="/var/lib/kubelet/pods/0a01b065-153f-4ce6-8665-2f5c8f12021d/volumes"
Sep 08 15:24:41.156383 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:41.156283    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c57b5616-700f-4c45-897b-6694c8400e43" path="/var/lib/kubelet/pods/c57b5616-700f-4c45-897b-6694c8400e43/volumes"
Sep 08 15:24:41.713193 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:41.713155    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:24:45.825175 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:45.825143    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"]
Sep 08 15:24:45.825667 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:45.825427    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh" podUID="d2800f88-b692-414e-8928-35d7f7ab1d33" containerName="istio-proxy" containerID="cri-o://147d624279b836ba6440716218e01976ea01dfe31b91b9caae6ff87a7bb18325" gracePeriod=30
Sep 08 15:24:49.660703 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:49.660664    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:24:49.661082 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:49.660745    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh" podUID="d2800f88-b692-414e-8928-35d7f7ab1d33" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:24:51.072599 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.072569    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:24:51.202225 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202125    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2800f88-b692-414e-8928-35d7f7ab1d33-istiod-ca-cert\") pod \"d2800f88-b692-414e-8928-35d7f7ab1d33\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") "
Sep 08 15:24:51.202399 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202232    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-token\") pod \"d2800f88-b692-414e-8928-35d7f7ab1d33\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") "
Sep 08 15:24:51.202399 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202263    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-workload-certs\") pod \"d2800f88-b692-414e-8928-35d7f7ab1d33\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") "
Sep 08 15:24:51.202399 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202290    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-envoy\") pod \"d2800f88-b692-414e-8928-35d7f7ab1d33\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") "
Sep 08 15:24:51.202399 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202320    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54s8d\" (UniqueName: \"kubernetes.io/projected/d2800f88-b692-414e-8928-35d7f7ab1d33-kube-api-access-54s8d\") pod \"d2800f88-b692-414e-8928-35d7f7ab1d33\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") "
Sep 08 15:24:51.202399 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202356    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-workload-socket\") pod \"d2800f88-b692-414e-8928-35d7f7ab1d33\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") "
Sep 08 15:24:51.202399 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202388    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-podinfo\") pod \"d2800f88-b692-414e-8928-35d7f7ab1d33\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") "
Sep 08 15:24:51.202742 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202426    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-data\") pod \"d2800f88-b692-414e-8928-35d7f7ab1d33\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") "
Sep 08 15:24:51.202742 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202467    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-credential-socket\") pod \"d2800f88-b692-414e-8928-35d7f7ab1d33\" (UID: \"d2800f88-b692-414e-8928-35d7f7ab1d33\") "
Sep 08 15:24:51.202742 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202627    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2800f88-b692-414e-8928-35d7f7ab1d33-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d2800f88-b692-414e-8928-35d7f7ab1d33" (UID: "d2800f88-b692-414e-8928-35d7f7ab1d33"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:24:51.202742 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202636    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d2800f88-b692-414e-8928-35d7f7ab1d33" (UID: "d2800f88-b692-414e-8928-35d7f7ab1d33"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:24:51.202742 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202714    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d2800f88-b692-414e-8928-35d7f7ab1d33" (UID: "d2800f88-b692-414e-8928-35d7f7ab1d33"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:24:51.203001 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202801    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-data" (OuterVolumeSpecName: "istio-data") pod "d2800f88-b692-414e-8928-35d7f7ab1d33" (UID: "d2800f88-b692-414e-8928-35d7f7ab1d33"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:24:51.203001 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202875    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d2800f88-b692-414e-8928-35d7f7ab1d33" (UID: "d2800f88-b692-414e-8928-35d7f7ab1d33"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:24:51.203001 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202888    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:51.203001 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202906    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:51.203001 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202919    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:51.203001 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.202935    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2800f88-b692-414e-8928-35d7f7ab1d33-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:51.204599 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.204563    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d2800f88-b692-414e-8928-35d7f7ab1d33" (UID: "d2800f88-b692-414e-8928-35d7f7ab1d33"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:24:51.204733 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.204702    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-token" (OuterVolumeSpecName: "istio-token") pod "d2800f88-b692-414e-8928-35d7f7ab1d33" (UID: "d2800f88-b692-414e-8928-35d7f7ab1d33"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:24:51.204796 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.204764    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d2800f88-b692-414e-8928-35d7f7ab1d33" (UID: "d2800f88-b692-414e-8928-35d7f7ab1d33"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:24:51.204854 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.204834    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2800f88-b692-414e-8928-35d7f7ab1d33-kube-api-access-54s8d" (OuterVolumeSpecName: "kube-api-access-54s8d") pod "d2800f88-b692-414e-8928-35d7f7ab1d33" (UID: "d2800f88-b692-414e-8928-35d7f7ab1d33"). InnerVolumeSpecName "kube-api-access-54s8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:24:51.304268 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.304226    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:51.304268 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.304262    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:51.304268 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.304275    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54s8d\" (UniqueName: \"kubernetes.io/projected/d2800f88-b692-414e-8928-35d7f7ab1d33-kube-api-access-54s8d\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:51.304527 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.304288    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2800f88-b692-414e-8928-35d7f7ab1d33-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:51.304527 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.304300    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2800f88-b692-414e-8928-35d7f7ab1d33-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:24:51.857874 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.857838    2580 generic.go:356] "Generic (PLEG): container finished" podID="d2800f88-b692-414e-8928-35d7f7ab1d33" containerID="147d624279b836ba6440716218e01976ea01dfe31b91b9caae6ff87a7bb18325" exitCode=0
Sep 08 15:24:51.858055 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.857906    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"
Sep 08 15:24:51.858055 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.857923    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh" event={"ID":"d2800f88-b692-414e-8928-35d7f7ab1d33","Type":"ContainerDied","Data":"147d624279b836ba6440716218e01976ea01dfe31b91b9caae6ff87a7bb18325"}
Sep 08 15:24:51.858055 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.857983    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh" event={"ID":"d2800f88-b692-414e-8928-35d7f7ab1d33","Type":"ContainerDied","Data":"0f200a2b9f3c5365a5a120ce53b61f2876c4519e6ec9f5b758c95e03c4263bc9"}
Sep 08 15:24:51.858055 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.858005    2580 scope.go:117] "RemoveContainer" containerID="147d624279b836ba6440716218e01976ea01dfe31b91b9caae6ff87a7bb18325"
Sep 08 15:24:51.867494 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.867474    2580 scope.go:117] "RemoveContainer" containerID="f984fe1f0aec8ca4a5df1af2bfc9a5b8de00141b87498a5e0eb8918d5ed2cba2"
Sep 08 15:24:51.876025 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.876005    2580 scope.go:117] "RemoveContainer" containerID="147d624279b836ba6440716218e01976ea01dfe31b91b9caae6ff87a7bb18325"
Sep 08 15:24:51.876328 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:24:51.876307    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"147d624279b836ba6440716218e01976ea01dfe31b91b9caae6ff87a7bb18325\": container with ID starting with 147d624279b836ba6440716218e01976ea01dfe31b91b9caae6ff87a7bb18325 not found: ID does not exist" containerID="147d624279b836ba6440716218e01976ea01dfe31b91b9caae6ff87a7bb18325"
Sep 08 15:24:51.876377 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.876337    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"147d624279b836ba6440716218e01976ea01dfe31b91b9caae6ff87a7bb18325"} err="failed to get container status \"147d624279b836ba6440716218e01976ea01dfe31b91b9caae6ff87a7bb18325\": rpc error: code = NotFound desc = could not find container \"147d624279b836ba6440716218e01976ea01dfe31b91b9caae6ff87a7bb18325\": container with ID starting with 147d624279b836ba6440716218e01976ea01dfe31b91b9caae6ff87a7bb18325 not found: ID does not exist"
Sep 08 15:24:51.876377 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.876356    2580 scope.go:117] "RemoveContainer" containerID="f984fe1f0aec8ca4a5df1af2bfc9a5b8de00141b87498a5e0eb8918d5ed2cba2"
Sep 08 15:24:51.876669 ip-10-0-134-147 kubenswrapper[2580]: E0908 15:24:51.876650    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f984fe1f0aec8ca4a5df1af2bfc9a5b8de00141b87498a5e0eb8918d5ed2cba2\": container with ID starting with f984fe1f0aec8ca4a5df1af2bfc9a5b8de00141b87498a5e0eb8918d5ed2cba2 not found: ID does not exist" containerID="f984fe1f0aec8ca4a5df1af2bfc9a5b8de00141b87498a5e0eb8918d5ed2cba2"
Sep 08 15:24:51.876725 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.876677    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f984fe1f0aec8ca4a5df1af2bfc9a5b8de00141b87498a5e0eb8918d5ed2cba2"} err="failed to get container status \"f984fe1f0aec8ca4a5df1af2bfc9a5b8de00141b87498a5e0eb8918d5ed2cba2\": rpc error: code = NotFound desc = could not find container \"f984fe1f0aec8ca4a5df1af2bfc9a5b8de00141b87498a5e0eb8918d5ed2cba2\": container with ID starting with f984fe1f0aec8ca4a5df1af2bfc9a5b8de00141b87498a5e0eb8918d5ed2cba2 not found: ID does not exist"
Sep 08 15:24:51.880482 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.880459    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"]
Sep 08 15:24:51.887014 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.886985    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7be222-openshift-default-7fd8985f58-7hqxh"]
Sep 08 15:24:51.910335 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:51.910297    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:24:53.158588 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:24:53.158545    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2800f88-b692-414e-8928-35d7f7ab1d33" path="/var/lib/kubelet/pods/d2800f88-b692-414e-8928-35d7f7ab1d33/volumes"
Sep 08 15:25:21.212289 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:25:21.212262    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 15:25:21.221656 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:25:21.221630    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 15:25:21.614965 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:25:21.614938    2580 scope.go:117] "RemoveContainer" containerID="cc90c9946f89225da76e7f48c5972940cf2971bb6a5f0f56d379150d9d246237"
Sep 08 15:26:13.400057 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:26:13.400019    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:26:21.644032 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:26:21.643998    2580 scope.go:117] "RemoveContainer" containerID="4fada9374965b8396edec5efe45e40afa6770593bf6d228007b4fd426f9e6a24"
Sep 08 15:26:21.652221 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:26:21.652199    2580 scope.go:117] "RemoveContainer" containerID="4cca5f1d31c156831b1c9e8cbe2417307e62f13cc31da51147f2c15c4904983e"
Sep 08 15:26:21.659955 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:26:21.659933    2580 scope.go:117] "RemoveContainer" containerID="bf4436b842385cea6c8da319e2994b013a17c237a55ed54948f6b5f3d820e8ec"
Sep 08 15:26:39.004083 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:26:39.004045    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:26:45.899477 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:26:45.899396    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:26:53.808324 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:26:53.808284    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:27:01.999336 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:27:01.999300    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:27:11.298323 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:27:11.298286    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:27:20.805691 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:27:20.805650    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:27:21.687395 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:27:21.687362    2580 scope.go:117] "RemoveContainer" containerID="107dd1d61ff2197f222ca85091727b74f1590d57bb6a2afd02248b3d7dbba0c6"
Sep 08 15:28:49.599682 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:28:49.599645    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:28:55.410440 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:28:55.410402    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:29:02.216798 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:02.216743    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:29:07.907134 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:07.907097    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:29:19.619982 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:19.619939    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:29:21.713861 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:21.713828    2580 scope.go:117] "RemoveContainer" containerID="fde545da46ce9e93a6f35ed455c75ab23ffeae534047ca6c67904beccc7b39b9"
Sep 08 15:29:21.722115 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:21.722096    2580 scope.go:117] "RemoveContainer" containerID="fe9344b3cef0796e2016a6fd500e9330d6cb1cf64cf58221dedee9c7d614f929"
Sep 08 15:29:31.398203 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.398169    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"]
Sep 08 15:29:31.398689 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.398666    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48063ef5-8d74-4b72-a67c-5329839dc225" containerName="istio-proxy"
Sep 08 15:29:31.398689 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.398682    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="48063ef5-8d74-4b72-a67c-5329839dc225" containerName="istio-proxy"
Sep 08 15:29:31.398689 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.398689    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48063ef5-8d74-4b72-a67c-5329839dc225" containerName="istio-proxy"
Sep 08 15:29:31.398802 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.398695    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="48063ef5-8d74-4b72-a67c-5329839dc225" containerName="istio-proxy"
Sep 08 15:29:31.398802 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.398703    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2800f88-b692-414e-8928-35d7f7ab1d33" containerName="istio-proxy"
Sep 08 15:29:31.398802 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.398709    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2800f88-b692-414e-8928-35d7f7ab1d33" containerName="istio-proxy"
Sep 08 15:29:31.398802 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.398719    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c57b5616-700f-4c45-897b-6694c8400e43" containerName="revoke-keys"
Sep 08 15:29:31.398802 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.398724    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c57b5616-700f-4c45-897b-6694c8400e43" containerName="revoke-keys"
Sep 08 15:29:31.398802 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.398732    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2800f88-b692-414e-8928-35d7f7ab1d33" containerName="istio-proxy"
Sep 08 15:29:31.398802 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.398737    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2800f88-b692-414e-8928-35d7f7ab1d33" containerName="istio-proxy"
Sep 08 15:29:31.398802 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.398792    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="48063ef5-8d74-4b72-a67c-5329839dc225" containerName="istio-proxy"
Sep 08 15:29:31.398802 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.398800    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c57b5616-700f-4c45-897b-6694c8400e43" containerName="revoke-keys"
Sep 08 15:29:31.399064 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.398807    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="48063ef5-8d74-4b72-a67c-5329839dc225" containerName="istio-proxy"
Sep 08 15:29:31.399064 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.398814    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2800f88-b692-414e-8928-35d7f7ab1d33" containerName="istio-proxy"
Sep 08 15:29:31.399064 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.398820    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2800f88-b692-414e-8928-35d7f7ab1d33" containerName="istio-proxy"
Sep 08 15:29:31.401739 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.401722    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.404392 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.404372    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-0572b5a6-kserve-self-signed-certs\""
Sep 08 15:29:31.411245 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.411222    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"]
Sep 08 15:29:31.523277 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.523242    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-tmp-dir\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.523458 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.523294    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-home\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.523458 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.523357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-model-cache\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.523458 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.523392    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-dshm\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.523597 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.523486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngml2\" (UniqueName: \"kubernetes.io/projected/09c0a36a-9007-4077-8dbe-ac063463746b-kube-api-access-ngml2\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.523597 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.523542    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09c0a36a-9007-4077-8dbe-ac063463746b-tls-certs\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.624353 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.624313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngml2\" (UniqueName: \"kubernetes.io/projected/09c0a36a-9007-4077-8dbe-ac063463746b-kube-api-access-ngml2\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.624353 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.624359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09c0a36a-9007-4077-8dbe-ac063463746b-tls-certs\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.624660 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.624395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-tmp-dir\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.624660 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.624422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-home\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.624660 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.624444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-model-cache\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.624660 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.624477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-dshm\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.624916 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.624891    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-tmp-dir\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.624978 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.624910    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-model-cache\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.624978 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.624962    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-home\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.626780 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.626751    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-dshm\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.627101 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.627082    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09c0a36a-9007-4077-8dbe-ac063463746b-tls-certs\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.632524 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.632491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngml2\" (UniqueName: \"kubernetes.io/projected/09c0a36a-9007-4077-8dbe-ac063463746b-kube-api-access-ngml2\") pod \"e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") " pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.711827 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.711730    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:31.987341 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:31.987313    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"]
Sep 08 15:29:31.989373 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:29:31.989346    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09c0a36a_9007_4077_8dbe_ac063463746b.slice/crio-1817aaa177a83406e216ef57d167e60133b4fb49a96eb99e96e3976a9b99b0c1 WatchSource:0}: Error finding container 1817aaa177a83406e216ef57d167e60133b4fb49a96eb99e96e3976a9b99b0c1: Status 404 returned error can't find the container with id 1817aaa177a83406e216ef57d167e60133b4fb49a96eb99e96e3976a9b99b0c1
Sep 08 15:29:32.247315 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:32.247219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969" event={"ID":"09c0a36a-9007-4077-8dbe-ac063463746b","Type":"ContainerStarted","Data":"98d0fcd46eb046325215ca09ee77aad885323418e31b346c114868be861e1118"}
Sep 08 15:29:32.247315 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:32.247272    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969" event={"ID":"09c0a36a-9007-4077-8dbe-ac063463746b","Type":"ContainerStarted","Data":"1817aaa177a83406e216ef57d167e60133b4fb49a96eb99e96e3976a9b99b0c1"}
Sep 08 15:29:32.264465 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:32.264406    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969" podStartSLOduration=1.264390409 podStartE2EDuration="1.264390409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:29:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:29:32.262912009 +0000 UTC m=+2051.595151572" watchObservedRunningTime="2026-09-08 15:29:32.264390409 +0000 UTC m=+2051.596629954"
Sep 08 15:29:34.318241 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:34.318204    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:29:41.712459 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:41.712419    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:41.712970 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:41.712481    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:41.726055 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:41.726020    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:42.306234 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:42.306202    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:29:49.179843 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:49.179746    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"]
Sep 08 15:29:51.713558 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:29:51.713503    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:30:00.139634 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:00.139597    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814690-qvn2s"]
Sep 08 15:30:00.142893 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:00.142874    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-qvn2s"
Sep 08 15:30:00.145480 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:00.145459    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b8vrf\""
Sep 08 15:30:00.151995 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:00.151963    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814690-qvn2s"]
Sep 08 15:30:00.154650 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:00.154630    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-qvn2s"
Sep 08 15:30:00.419365 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:00.419281    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:30:00.432455 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:00.432424    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814690-qvn2s"]
Sep 08 15:30:00.435707 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:30:00.435671    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde2e4b94_0152_42e4_97b5_7b887df5b4dc.slice/crio-f18beacbaba85f4a3ec468a72c6b3829122f249663a461a352c00dc53ac29968 WatchSource:0}: Error finding container f18beacbaba85f4a3ec468a72c6b3829122f249663a461a352c00dc53ac29968: Status 404 returned error can't find the container with id f18beacbaba85f4a3ec468a72c6b3829122f249663a461a352c00dc53ac29968
Sep 08 15:30:01.391986 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:01.391935    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-qvn2s" event={"ID":"de2e4b94-0152-42e4-97b5-7b887df5b4dc","Type":"ContainerStarted","Data":"d025d26eab21a97181737aa59e9dffe917d679dcb79a38aeee831685ac5b295f"}
Sep 08 15:30:01.392492 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:01.392005    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-qvn2s" event={"ID":"de2e4b94-0152-42e4-97b5-7b887df5b4dc","Type":"ContainerStarted","Data":"f18beacbaba85f4a3ec468a72c6b3829122f249663a461a352c00dc53ac29968"}
Sep 08 15:30:01.408203 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:01.408153    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-qvn2s" podStartSLOduration=1.408139367 podStartE2EDuration="1.408139367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:30:01.405701928 +0000 UTC m=+2080.737941474" watchObservedRunningTime="2026-09-08 15:30:01.408139367 +0000 UTC m=+2080.740378970"
Sep 08 15:30:02.399585 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:02.399543    2580 generic.go:356] "Generic (PLEG): container finished" podID="de2e4b94-0152-42e4-97b5-7b887df5b4dc" containerID="d025d26eab21a97181737aa59e9dffe917d679dcb79a38aeee831685ac5b295f" exitCode=0
Sep 08 15:30:02.400000 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:02.399605    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-qvn2s" event={"ID":"de2e4b94-0152-42e4-97b5-7b887df5b4dc","Type":"ContainerDied","Data":"d025d26eab21a97181737aa59e9dffe917d679dcb79a38aeee831685ac5b295f"}
Sep 08 15:30:03.536930 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:03.536903    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-qvn2s"
Sep 08 15:30:04.199814 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.199771    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969" podUID="09c0a36a-9007-4077-8dbe-ac063463746b" containerName="main" containerID="cri-o://98d0fcd46eb046325215ca09ee77aad885323418e31b346c114868be861e1118" gracePeriod=45
Sep 08 15:30:04.412810 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.412773    2580 generic.go:356] "Generic (PLEG): container finished" podID="09c0a36a-9007-4077-8dbe-ac063463746b" containerID="98d0fcd46eb046325215ca09ee77aad885323418e31b346c114868be861e1118" exitCode=0
Sep 08 15:30:04.413174 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.412861    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969" event={"ID":"09c0a36a-9007-4077-8dbe-ac063463746b","Type":"ContainerDied","Data":"98d0fcd46eb046325215ca09ee77aad885323418e31b346c114868be861e1118"}
Sep 08 15:30:04.414665 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.414640    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-qvn2s" event={"ID":"de2e4b94-0152-42e4-97b5-7b887df5b4dc","Type":"ContainerDied","Data":"f18beacbaba85f4a3ec468a72c6b3829122f249663a461a352c00dc53ac29968"}
Sep 08 15:30:04.414665 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.414658    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-qvn2s"
Sep 08 15:30:04.414876 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.414687    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f18beacbaba85f4a3ec468a72c6b3829122f249663a461a352c00dc53ac29968"
Sep 08 15:30:04.455131 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.455066    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:30:04.543379 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.543350    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-tmp-dir\") pod \"09c0a36a-9007-4077-8dbe-ac063463746b\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") "
Sep 08 15:30:04.543875 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.543408    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-dshm\") pod \"09c0a36a-9007-4077-8dbe-ac063463746b\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") "
Sep 08 15:30:04.543875 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.543433    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngml2\" (UniqueName: \"kubernetes.io/projected/09c0a36a-9007-4077-8dbe-ac063463746b-kube-api-access-ngml2\") pod \"09c0a36a-9007-4077-8dbe-ac063463746b\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") "
Sep 08 15:30:04.543875 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.543464    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09c0a36a-9007-4077-8dbe-ac063463746b-tls-certs\") pod \"09c0a36a-9007-4077-8dbe-ac063463746b\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") "
Sep 08 15:30:04.543875 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.543502    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-model-cache\") pod \"09c0a36a-9007-4077-8dbe-ac063463746b\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") "
Sep 08 15:30:04.543875 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.543591    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-home\") pod \"09c0a36a-9007-4077-8dbe-ac063463746b\" (UID: \"09c0a36a-9007-4077-8dbe-ac063463746b\") "
Sep 08 15:30:04.543875 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.543721    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "09c0a36a-9007-4077-8dbe-ac063463746b" (UID: "09c0a36a-9007-4077-8dbe-ac063463746b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:30:04.543875 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.543872    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-tmp-dir\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:30:04.544251 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.544137    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-model-cache" (OuterVolumeSpecName: "model-cache") pod "09c0a36a-9007-4077-8dbe-ac063463746b" (UID: "09c0a36a-9007-4077-8dbe-ac063463746b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:30:04.544251 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.544156    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-home" (OuterVolumeSpecName: "home") pod "09c0a36a-9007-4077-8dbe-ac063463746b" (UID: "09c0a36a-9007-4077-8dbe-ac063463746b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:30:04.545938 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.545908    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09c0a36a-9007-4077-8dbe-ac063463746b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "09c0a36a-9007-4077-8dbe-ac063463746b" (UID: "09c0a36a-9007-4077-8dbe-ac063463746b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:30:04.545938 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.545908    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-dshm" (OuterVolumeSpecName: "dshm") pod "09c0a36a-9007-4077-8dbe-ac063463746b" (UID: "09c0a36a-9007-4077-8dbe-ac063463746b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:30:04.546108 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.545989    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09c0a36a-9007-4077-8dbe-ac063463746b-kube-api-access-ngml2" (OuterVolumeSpecName: "kube-api-access-ngml2") pod "09c0a36a-9007-4077-8dbe-ac063463746b" (UID: "09c0a36a-9007-4077-8dbe-ac063463746b"). InnerVolumeSpecName "kube-api-access-ngml2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:30:04.644609 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.644572    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-home\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:30:04.644609 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.644603    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-dshm\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:30:04.644609 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.644614    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngml2\" (UniqueName: \"kubernetes.io/projected/09c0a36a-9007-4077-8dbe-ac063463746b-kube-api-access-ngml2\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:30:04.644850 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.644624    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09c0a36a-9007-4077-8dbe-ac063463746b-tls-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:30:04.644850 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:04.644633    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09c0a36a-9007-4077-8dbe-ac063463746b-model-cache\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 08 15:30:05.421399 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:05.421308    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"
Sep 08 15:30:05.421399 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:05.421349    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969" event={"ID":"09c0a36a-9007-4077-8dbe-ac063463746b","Type":"ContainerDied","Data":"1817aaa177a83406e216ef57d167e60133b4fb49a96eb99e96e3976a9b99b0c1"}
Sep 08 15:30:05.421756 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:05.421411    2580 scope.go:117] "RemoveContainer" containerID="98d0fcd46eb046325215ca09ee77aad885323418e31b346c114868be861e1118"
Sep 08 15:30:05.439413 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:05.439381    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"]
Sep 08 15:30:05.443391 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:05.443363    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-0572b5a6-kserve-687ff84f7f-tl969"]
Sep 08 15:30:06.828447 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:06.828406    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:30:07.156232 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:07.156134    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09c0a36a-9007-4077-8dbe-ac063463746b" path="/var/lib/kubelet/pods/09c0a36a-9007-4077-8dbe-ac063463746b/volumes"
Sep 08 15:30:16.310998 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:16.310960    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:30:21.242122 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:21.242084    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 15:30:21.255441 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:21.255418    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8c5lk_3f7f485e-e925-44c2-83b5-5ab147b6a6b8/ovn-acl-logging/0.log"
Sep 08 15:30:21.745238 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:21.745203    2580 scope.go:117] "RemoveContainer" containerID="e54d124a9583662d8336e7b6b60bf991415fc3da602f0d124d5e3521b7ff1564"
Sep 08 15:30:21.753441 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:21.753420    2580 scope.go:117] "RemoveContainer" containerID="314d6b026e6efe7cd14d10b1c378f75ed4558f270525e0e23f568b678b051c78"
Sep 08 15:30:23.529485 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:23.529450    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:30:29.213953 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:29.213916    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:30:37.323703 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:37.323668    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6psdp"]
Sep 08 15:30:46.034053 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:46.034021    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9zkbx_a9b6c624-140c-4a56-b5c2-f7427873325b/manager/0.log"
Sep 08 15:30:46.196445 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:46.196415    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rmnm6_bd23a109-8749-4cbe-978d-aa385c5bdd01/manager/0.log"
Sep 08 15:30:46.492227 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:46.492199    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tgcgq_5ba86d35-3e5c-4cd5-a99d-f80f388d2396/server/0.log"
Sep 08 15:30:46.628934 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:46.628896    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jfjft_6d3c97b7-cabb-4071-83c0-3dcc587c3c26/manager/0.log"
Sep 08 15:30:47.069767 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:47.069734    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b574fc88f-7n6vv_8dac890c-2121-4d99-bfae-a2a974fbe2de/manager/0.log"
Sep 08 15:30:47.079991 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:47.079965    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b574fc88f-7n6vv_8dac890c-2121-4d99-bfae-a2a974fbe2de/copy-manifests/0.log"
Sep 08 15:30:47.807220 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:47.807195    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29814690-qvn2s_de2e4b94-0152-42e4-97b5-7b887df5b4dc/cleanup/0.log"
Sep 08 15:30:49.502483 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:49.502453    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-6psdp_f31b9e16-e542-407a-8925-cce16945f442/limitador/0.log"
Sep 08 15:30:50.030230 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:50.030202    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq_1debce1f-10a9-48f3-9478-8044c57ae2bf/istio-proxy/0.log"
Sep 08 15:30:50.558095 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:50.558058    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-f8qzg_d05e790c-f20b-4a8f-8e15-d88b08d529e7/istio-proxy/1.log"
Sep 08 15:30:50.696710 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:50.696678    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zbtzp_80e35f98-1e75-4fbb-b44a-bfd930bb8458/payload-pre-processing/0.log"
Sep 08 15:30:51.335616 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:51.335587    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-p7z2s_fd24f357-0c38-461c-bebd-93623fe82120/main/0.log"
Sep 08 15:30:51.889143 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:51.889107    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsm89_e3230790-1c5a-4c7e-ad0c-8a374ca5087c/main/0.log"
Sep 08 15:30:58.091009 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.090972    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5z7hh/must-gather-hstbp"]
Sep 08 15:30:58.091614 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.091532    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de2e4b94-0152-42e4-97b5-7b887df5b4dc" containerName="cleanup"
Sep 08 15:30:58.091614 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.091554    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="de2e4b94-0152-42e4-97b5-7b887df5b4dc" containerName="cleanup"
Sep 08 15:30:58.091614 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.091597    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c0a36a-9007-4077-8dbe-ac063463746b" containerName="main"
Sep 08 15:30:58.091614 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.091605    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c0a36a-9007-4077-8dbe-ac063463746b" containerName="main"
Sep 08 15:30:58.091852 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.091694    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="09c0a36a-9007-4077-8dbe-ac063463746b" containerName="main"
Sep 08 15:30:58.091852 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.091710    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="de2e4b94-0152-42e4-97b5-7b887df5b4dc" containerName="cleanup"
Sep 08 15:30:58.094648 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.094627    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5z7hh/must-gather-hstbp"
Sep 08 15:30:58.098173 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.098146    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5z7hh\"/\"default-dockercfg-8ph62\""
Sep 08 15:30:58.098289 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.098238    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5z7hh\"/\"kube-root-ca.crt\""
Sep 08 15:30:58.098607 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.098588    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5z7hh\"/\"openshift-service-ca.crt\""
Sep 08 15:30:58.119896 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.119868    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5z7hh/must-gather-hstbp"]
Sep 08 15:30:58.160368 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.160333    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p2l2\" (UniqueName: \"kubernetes.io/projected/5064428e-3764-48b3-96de-1ce8f7ccc0a8-kube-api-access-7p2l2\") pod \"must-gather-hstbp\" (UID: \"5064428e-3764-48b3-96de-1ce8f7ccc0a8\") " pod="openshift-must-gather-5z7hh/must-gather-hstbp"
Sep 08 15:30:58.160600 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.160451    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5064428e-3764-48b3-96de-1ce8f7ccc0a8-must-gather-output\") pod \"must-gather-hstbp\" (UID: \"5064428e-3764-48b3-96de-1ce8f7ccc0a8\") " pod="openshift-must-gather-5z7hh/must-gather-hstbp"
Sep 08 15:30:58.261338 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.261303    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2l2\" (UniqueName: \"kubernetes.io/projected/5064428e-3764-48b3-96de-1ce8f7ccc0a8-kube-api-access-7p2l2\") pod \"must-gather-hstbp\" (UID: \"5064428e-3764-48b3-96de-1ce8f7ccc0a8\") " pod="openshift-must-gather-5z7hh/must-gather-hstbp"
Sep 08 15:30:58.261570 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.261357    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5064428e-3764-48b3-96de-1ce8f7ccc0a8-must-gather-output\") pod \"must-gather-hstbp\" (UID: \"5064428e-3764-48b3-96de-1ce8f7ccc0a8\") " pod="openshift-must-gather-5z7hh/must-gather-hstbp"
Sep 08 15:30:58.261676 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.261660    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5064428e-3764-48b3-96de-1ce8f7ccc0a8-must-gather-output\") pod \"must-gather-hstbp\" (UID: \"5064428e-3764-48b3-96de-1ce8f7ccc0a8\") " pod="openshift-must-gather-5z7hh/must-gather-hstbp"
Sep 08 15:30:58.277178 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.277150    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p2l2\" (UniqueName: \"kubernetes.io/projected/5064428e-3764-48b3-96de-1ce8f7ccc0a8-kube-api-access-7p2l2\") pod \"must-gather-hstbp\" (UID: \"5064428e-3764-48b3-96de-1ce8f7ccc0a8\") " pod="openshift-must-gather-5z7hh/must-gather-hstbp"
Sep 08 15:30:58.403718 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.403638    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5z7hh/must-gather-hstbp"
Sep 08 15:30:58.701912 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.701886    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5z7hh/must-gather-hstbp"]
Sep 08 15:30:58.704441 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:30:58.704406    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5064428e_3764_48b3_96de_1ce8f7ccc0a8.slice/crio-931aea604760e36bc4c1de455314441064c12f9b2fe618cb1773e1ad09e609e0 WatchSource:0}: Error finding container 931aea604760e36bc4c1de455314441064c12f9b2fe618cb1773e1ad09e609e0: Status 404 returned error can't find the container with id 931aea604760e36bc4c1de455314441064c12f9b2fe618cb1773e1ad09e609e0
Sep 08 15:30:58.706227 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:58.706213    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:30:59.701180 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:59.701115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5z7hh/must-gather-hstbp" event={"ID":"5064428e-3764-48b3-96de-1ce8f7ccc0a8","Type":"ContainerStarted","Data":"e72f570ac56c7926be89b7fab4896d10d6b5c42a7b7acae3865d59c3e5422026"}
Sep 08 15:30:59.701180 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:30:59.701173    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5z7hh/must-gather-hstbp" event={"ID":"5064428e-3764-48b3-96de-1ce8f7ccc0a8","Type":"ContainerStarted","Data":"931aea604760e36bc4c1de455314441064c12f9b2fe618cb1773e1ad09e609e0"}
Sep 08 15:31:00.716450 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:00.716413    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5z7hh/must-gather-hstbp" event={"ID":"5064428e-3764-48b3-96de-1ce8f7ccc0a8","Type":"ContainerStarted","Data":"430fd65397233c139c1b4c2745439c7ec94637f0df7d373d07633dbad292b873"}
Sep 08 15:31:00.735395 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:00.735333    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5z7hh/must-gather-hstbp" podStartSLOduration=1.863198686 podStartE2EDuration="2.735311022s" totalImagesPullingTime="872.112336ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:31:00.733768089 +0000 UTC m=+2140.066007658" watchObservedRunningTime="2026-09-08 15:31:00.735311022 +0000 UTC m=+2140.067550569"
Sep 08 15:31:01.358064 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:01.358030    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hjhs7_cc66186e-7479-4d5f-8e81-fa0d49a60ef1/global-pull-secret-syncer/0.log"
Sep 08 15:31:01.586760 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:01.586724    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sl7g8_b8fa1793-9a61-454c-9e42-7a3374e3c0fb/konnectivity-agent/0.log"
Sep 08 15:31:01.615193 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:01.615093    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-147.ec2.internal_1fe981aef88d6cd2cc7b16faaac99f73/haproxy/0.log"
Sep 08 15:31:06.438897 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:06.438864    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-6psdp_f31b9e16-e542-407a-8925-cce16945f442/limitador/0.log"
Sep 08 15:31:08.186056 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:08.186017    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-h44k8_af0780d7-52f1-4ee6-9a32-db285e2c220c/cluster-monitoring-operator/0.log"
Sep 08 15:31:08.352478 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:08.352398    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-fvmdp_4ff46f58-6f12-4fcc-9ecc-46870e168246/monitoring-plugin/0.log"
Sep 08 15:31:08.412737 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:08.412704    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bhdbr_106ef39d-941e-49e7-9763-e27bfd453144/node-exporter/0.log"
Sep 08 15:31:08.441819 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:08.441766    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bhdbr_106ef39d-941e-49e7-9763-e27bfd453144/kube-rbac-proxy/0.log"
Sep 08 15:31:08.472594 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:08.472563    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bhdbr_106ef39d-941e-49e7-9763-e27bfd453144/init-textfile/0.log"
Sep 08 15:31:08.839033 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:08.838999    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be148675-7ffb-429d-8571-ef41a0bf5ac0/prometheus/0.log"
Sep 08 15:31:08.862233 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:08.862194    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be148675-7ffb-429d-8571-ef41a0bf5ac0/config-reloader/0.log"
Sep 08 15:31:08.891404 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:08.891363    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be148675-7ffb-429d-8571-ef41a0bf5ac0/thanos-sidecar/0.log"
Sep 08 15:31:08.916768 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:08.916741    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be148675-7ffb-429d-8571-ef41a0bf5ac0/kube-rbac-proxy-web/0.log"
Sep 08 15:31:08.939552 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:08.939520    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be148675-7ffb-429d-8571-ef41a0bf5ac0/kube-rbac-proxy/0.log"
Sep 08 15:31:08.965914 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:08.965861    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be148675-7ffb-429d-8571-ef41a0bf5ac0/kube-rbac-proxy-thanos/0.log"
Sep 08 15:31:08.995825 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:08.995783    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be148675-7ffb-429d-8571-ef41a0bf5ac0/init-config-reloader/0.log"
Sep 08 15:31:09.030728 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:09.030687    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-lgngg_4f00f64e-5aa8-4d7e-8ff1-68c5c7484433/prometheus-operator/0.log"
Sep 08 15:31:09.055597 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:09.055558    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-lgngg_4f00f64e-5aa8-4d7e-8ff1-68c5c7484433/kube-rbac-proxy/0.log"
Sep 08 15:31:11.608261 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.608221    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"]
Sep 08 15:31:11.611893 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.611871    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:11.627181 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.627147    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"]
Sep 08 15:31:11.719961 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.719923    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxsd6\" (UniqueName: \"kubernetes.io/projected/77f24d02-cf81-4df0-9590-0a1d17ce1f35-kube-api-access-cxsd6\") pod \"perf-node-gather-daemonset-shj8s\" (UID: \"77f24d02-cf81-4df0-9590-0a1d17ce1f35\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:11.720291 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.720268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/77f24d02-cf81-4df0-9590-0a1d17ce1f35-podres\") pod \"perf-node-gather-daemonset-shj8s\" (UID: \"77f24d02-cf81-4df0-9590-0a1d17ce1f35\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:11.720439 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.720425    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77f24d02-cf81-4df0-9590-0a1d17ce1f35-lib-modules\") pod \"perf-node-gather-daemonset-shj8s\" (UID: \"77f24d02-cf81-4df0-9590-0a1d17ce1f35\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:11.720637 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.720623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77f24d02-cf81-4df0-9590-0a1d17ce1f35-sys\") pod \"perf-node-gather-daemonset-shj8s\" (UID: \"77f24d02-cf81-4df0-9590-0a1d17ce1f35\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:11.720807 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.720789    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/77f24d02-cf81-4df0-9590-0a1d17ce1f35-proc\") pod \"perf-node-gather-daemonset-shj8s\" (UID: \"77f24d02-cf81-4df0-9590-0a1d17ce1f35\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:11.821843 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.821804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxsd6\" (UniqueName: \"kubernetes.io/projected/77f24d02-cf81-4df0-9590-0a1d17ce1f35-kube-api-access-cxsd6\") pod \"perf-node-gather-daemonset-shj8s\" (UID: \"77f24d02-cf81-4df0-9590-0a1d17ce1f35\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:11.822033 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.821861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/77f24d02-cf81-4df0-9590-0a1d17ce1f35-podres\") pod \"perf-node-gather-daemonset-shj8s\" (UID: \"77f24d02-cf81-4df0-9590-0a1d17ce1f35\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:11.822033 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.821897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77f24d02-cf81-4df0-9590-0a1d17ce1f35-lib-modules\") pod \"perf-node-gather-daemonset-shj8s\" (UID: \"77f24d02-cf81-4df0-9590-0a1d17ce1f35\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:11.822033 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.821946    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77f24d02-cf81-4df0-9590-0a1d17ce1f35-sys\") pod \"perf-node-gather-daemonset-shj8s\" (UID: \"77f24d02-cf81-4df0-9590-0a1d17ce1f35\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:11.822033 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.821970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/77f24d02-cf81-4df0-9590-0a1d17ce1f35-proc\") pod \"perf-node-gather-daemonset-shj8s\" (UID: \"77f24d02-cf81-4df0-9590-0a1d17ce1f35\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:11.822289 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.822040    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/77f24d02-cf81-4df0-9590-0a1d17ce1f35-proc\") pod \"perf-node-gather-daemonset-shj8s\" (UID: \"77f24d02-cf81-4df0-9590-0a1d17ce1f35\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:11.822289 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.822081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77f24d02-cf81-4df0-9590-0a1d17ce1f35-sys\") pod \"perf-node-gather-daemonset-shj8s\" (UID: \"77f24d02-cf81-4df0-9590-0a1d17ce1f35\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:11.822289 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.822097    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77f24d02-cf81-4df0-9590-0a1d17ce1f35-lib-modules\") pod \"perf-node-gather-daemonset-shj8s\" (UID: \"77f24d02-cf81-4df0-9590-0a1d17ce1f35\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:11.822289 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.822180    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/77f24d02-cf81-4df0-9590-0a1d17ce1f35-podres\") pod \"perf-node-gather-daemonset-shj8s\" (UID: \"77f24d02-cf81-4df0-9590-0a1d17ce1f35\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:11.830890 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.830857    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxsd6\" (UniqueName: \"kubernetes.io/projected/77f24d02-cf81-4df0-9590-0a1d17ce1f35-kube-api-access-cxsd6\") pod \"perf-node-gather-daemonset-shj8s\" (UID: \"77f24d02-cf81-4df0-9590-0a1d17ce1f35\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:11.926871 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:11.926774    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:12.081957 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:12.081923    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-5zskh_21a8fde4-ee11-4c50-8daf-6fb231d5bb23/download-server/0.log"
Sep 08 15:31:12.243806 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:12.243756    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"]
Sep 08 15:31:12.247253 ip-10-0-134-147 kubenswrapper[2580]: W0908 15:31:12.247219    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod77f24d02_cf81_4df0_9590_0a1d17ce1f35.slice/crio-f3fa73ef5851adff4c7fecf0e9b04e520834c94d0850c9dbcecaf8a741d2941a WatchSource:0}: Error finding container f3fa73ef5851adff4c7fecf0e9b04e520834c94d0850c9dbcecaf8a741d2941a: Status 404 returned error can't find the container with id f3fa73ef5851adff4c7fecf0e9b04e520834c94d0850c9dbcecaf8a741d2941a
Sep 08 15:31:12.805655 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:12.805611    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s" event={"ID":"77f24d02-cf81-4df0-9590-0a1d17ce1f35","Type":"ContainerStarted","Data":"cce9c28a9da4bc204389ac11d96830d297f0e133e082710f721134293fb77751"}
Sep 08 15:31:12.806128 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:12.805685    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s" event={"ID":"77f24d02-cf81-4df0-9590-0a1d17ce1f35","Type":"ContainerStarted","Data":"f3fa73ef5851adff4c7fecf0e9b04e520834c94d0850c9dbcecaf8a741d2941a"}
Sep 08 15:31:12.806525 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:12.806480    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:12.823867 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:12.823781    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s" podStartSLOduration=1.823758905 podStartE2EDuration="1.823758905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:31:12.823332585 +0000 UTC m=+2152.155572132" watchObservedRunningTime="2026-09-08 15:31:12.823758905 +0000 UTC m=+2152.155998455"
Sep 08 15:31:13.876457 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:13.876371    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-knvj7_2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66/dns/0.log"
Sep 08 15:31:13.900990 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:13.900936    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-knvj7_2b871cd4-c07d-4b3d-bb2f-6e7f6d6d9b66/kube-rbac-proxy/0.log"
Sep 08 15:31:14.111526 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:14.111484    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qngmr_06b64b48-3059-46f5-bbb9-c29ba4697270/dns-node-resolver/0.log"
Sep 08 15:31:14.689657 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:14.689622    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-dfcb95cfc-gp5ss_091179fe-28c3-4e61-89f9-85470b799854/registry/0.log"
Sep 08 15:31:14.715581 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:14.715545    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b64k8_a8fa8fbd-736e-4bf2-a7c7-d9db65334a61/node-ca/0.log"
Sep 08 15:31:15.819565 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:15.819536    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq_1debce1f-10a9-48f3-9478-8044c57ae2bf/istio-proxy/0.log"
Sep 08 15:31:16.217107 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:16.217076    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-f8qzg_d05e790c-f20b-4a8f-8e15-d88b08d529e7/istio-proxy/0.log"
Sep 08 15:31:16.234611 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:16.234572    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-f8qzg_d05e790c-f20b-4a8f-8e15-d88b08d529e7/istio-proxy/1.log"
Sep 08 15:31:16.294226 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:16.294193    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zbtzp_80e35f98-1e75-4fbb-b44a-bfd930bb8458/payload-pre-processing/0.log"
Sep 08 15:31:17.377743 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:17.377706    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v48sd_9fec39b5-fe04-4bdf-a96d-e97f8d99f1e6/serve-healthcheck-canary/0.log"
Sep 08 15:31:18.327158 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:18.327131    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zk74n_17bdd47e-5354-44a5-a19b-c6d7f6b82cef/kube-rbac-proxy/0.log"
Sep 08 15:31:18.376131 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:18.376103    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zk74n_17bdd47e-5354-44a5-a19b-c6d7f6b82cef/exporter/0.log"
Sep 08 15:31:18.409790 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:18.409745    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zk74n_17bdd47e-5354-44a5-a19b-c6d7f6b82cef/extractor/0.log"
Sep 08 15:31:19.828853 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:19.828825    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-shj8s"
Sep 08 15:31:20.816191 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:20.816156    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9zkbx_a9b6c624-140c-4a56-b5c2-f7427873325b/manager/0.log"
Sep 08 15:31:21.110279 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:21.110173    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rmnm6_bd23a109-8749-4cbe-978d-aa385c5bdd01/manager/0.log"
Sep 08 15:31:21.388998 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:21.388905    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tgcgq_5ba86d35-3e5c-4cd5-a99d-f80f388d2396/server/0.log"
Sep 08 15:31:21.642093 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:21.641983    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jfjft_6d3c97b7-cabb-4071-83c0-3dcc587c3c26/manager/0.log"
Sep 08 15:31:21.780247 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:21.780205    2580 scope.go:117] "RemoveContainer" containerID="120c48c8ed69711e71608b8cc508e60ae70f6a6497a9c41cebc0aaeafc9416bd"
Sep 08 15:31:22.008027 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:22.007995    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq_1debce1f-10a9-48f3-9478-8044c57ae2bf/istio-proxy/0.log"
Sep 08 15:31:22.131111 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:22.131076    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b574fc88f-7n6vv_8dac890c-2121-4d99-bfae-a2a974fbe2de/manager/0.log"
Sep 08 15:31:22.387595 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:22.387501    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b574fc88f-7n6vv_8dac890c-2121-4d99-bfae-a2a974fbe2de/copy-manifests/0.log"
Sep 08 15:31:22.497181 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:22.495630    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-f8qzg_d05e790c-f20b-4a8f-8e15-d88b08d529e7/istio-proxy/0.log"
Sep 08 15:31:22.508671 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:22.508635    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-f8qzg_d05e790c-f20b-4a8f-8e15-d88b08d529e7/istio-proxy/1.log"
Sep 08 15:31:22.596069 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:22.596030    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zbtzp_80e35f98-1e75-4fbb-b44a-bfd930bb8458/payload-pre-processing/0.log"
Sep 08 15:31:24.069481 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:24.069391    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c458b45b4-rjkkl_5bb2ab7a-9b16-4fdf-923c-75def46227f9/manager/0.log"
Sep 08 15:31:24.157656 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:24.157612    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-qtrlg_874cfd3f-0d20-482d-9484-2bae3af7fc9d/openshift-lws-operator/0.log"
Sep 08 15:31:24.451784 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:24.451701    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ckzdfq_1debce1f-10a9-48f3-9478-8044c57ae2bf/istio-proxy/0.log"
Sep 08 15:31:24.933966 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:24.933919    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-f8qzg_d05e790c-f20b-4a8f-8e15-d88b08d529e7/istio-proxy/0.log"
Sep 08 15:31:24.953895 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:24.953863    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-f8qzg_d05e790c-f20b-4a8f-8e15-d88b08d529e7/istio-proxy/1.log"
Sep 08 15:31:25.000487 ip-10-0-134-147 kubenswrapper[2580]: I0908 15:31:25.000459    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zbtzp_80e35f98-1e75-4fbb-b44a-bfd930bb8458/payload-pre-processing/0.log"