Sep 09 14:10:47.877638 ip-10-0-142-209 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 14:10:48.298040 ip-10-0-142-209 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 14:10:48.298040 ip-10-0-142-209 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 14:10:48.298040 ip-10-0-142-209 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 14:10:48.298040 ip-10-0-142-209 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 14:10:48.298040 ip-10-0-142-209 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 14:10:48.298947 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.298867    2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 14:10:48.305603 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305580    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 14:10:48.305603 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305600    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 14:10:48.305603 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305605    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 14:10:48.305603 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305610    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305615    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305619    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305623    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305627    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305631    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305634    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305638    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305642    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305646    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305649    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305653    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305657    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305660    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305664    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305668    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305671    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305675    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305679    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305683    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 14:10:48.305858 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305687    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305691    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305695    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305699    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305702    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305707    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305711    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305715    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305719    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305723    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305727    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305731    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305735    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305739    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305744    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305749    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305755    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305761    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305769    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305773    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 14:10:48.306683 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305777    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305781    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305785    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305789    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305794    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305799    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305803    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305807    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305811    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305815    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305819    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305823    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305828    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305832    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305837    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305841    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305845    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305850    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305854    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305859    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 14:10:48.307640 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305863    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305867    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305871    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305875    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305879    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305884    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305888    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305893    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305897    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305902    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305906    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305913    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305918    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305923    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305929    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305934    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305938    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305942    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305946    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 14:10:48.308507 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305950    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305956    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305962    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305966    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305973    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305979    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305984    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305989    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305993    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.305999    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.306003    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.306008    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.306013    2553 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.306017    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.306022    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.306026    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.306031    2553 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307208    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307219    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307225    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 14:10:48.309328 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307229    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307234    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307238    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307243    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307248    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307252    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307256    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307260    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307264    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307269    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307273    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307277    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307282    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307286    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307291    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307295    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307299    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307303    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307307    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307312    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 14:10:48.310195 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307316    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307321    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307325    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307329    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307333    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307337    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307341    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307346    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307350    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307353    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307357    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307362    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307366    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307370    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307375    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307395    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307399    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307403    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307407    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307412    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 14:10:48.310813 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307416    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307420    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307424    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307428    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307432    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307436    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307440    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307445    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307451    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307455    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307459    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307464    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307468    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307472    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307477    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307481    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307485    2553 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307490    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307494    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307498    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 14:10:48.311442 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307503    2553 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307507    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307511    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307515    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307520    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307525    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307529    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307533    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307538    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307542    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307546    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307550    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307558    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307565    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307569    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307574    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307579    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307583    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307588    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307592    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 14:10:48.311962 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307597    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307602    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307606    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307610    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307617    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307621    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307625    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307629    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307635    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307639    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307645    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307650    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307655    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307659    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307664    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.307669    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308304    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308315    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308322    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 14:10:48.312579 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308327    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308332    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308337    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308341    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308345    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308350    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308354    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308358    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308362    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308366    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308370    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308375    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308397    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308403    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308407    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308411    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308415    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308422    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308426    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308430    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 14:10:48.313138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308434    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308438    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308443    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308447    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308452    2553 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308457    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308461    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308465    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308469    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308474    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308478    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308482    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308486    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308491    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308495    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308499    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308505    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308509    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308513    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308517    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 14:10:48.313681 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308521    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308525    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308529    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308533    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308538    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308542    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308548    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308552    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308556    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308562    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308567    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308571    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308575    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308579    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308584    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308588    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308592    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308597    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308601    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308608    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 14:10:48.314214 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308613    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308621    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308625    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308630    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308635    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308639    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308643    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308648    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308652    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308656    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308660    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308665    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308669    2553 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308673    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308677    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308682    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308686    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308690    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308694    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308699    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 14:10:48.314731 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308703    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308709    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308713    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308719    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308724    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308729    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308733    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308737    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308741    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308745    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308750    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308754    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308758    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308763    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308767    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.308771    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.308874    2553 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.308928    2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.308939    2553 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.308946    2553 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 14:10:48.315221 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.308953    2553 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.308959    2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.308965    2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.308971    2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.308977    2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.308981    2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.308987    2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.308992    2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.308997    2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309002    2553 flags.go:64] FLAG: --cgroup-root=""
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309007    2553 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309012    2553 flags.go:64] FLAG: --client-ca-file=""
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309017    2553 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309024    2553 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309029    2553 flags.go:64] FLAG: --cluster-domain=""
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309034    2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309039    2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309045    2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309050    2553 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309056    2553 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309061    2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309066    2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309072    2553 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309077    2553 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 14:10:48.315714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309082    2553 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309087    2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309092    2553 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309097    2553 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309103    2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309108    2553 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309112    2553 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309117    2553 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309122    2553 flags.go:64] FLAG: --enable-server="true"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309127    2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309134    2553 flags.go:64] FLAG: --event-burst="100"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309138    2553 flags.go:64] FLAG: --event-qps="50"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309143    2553 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309148    2553 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309153    2553 flags.go:64] FLAG: --eviction-hard=""
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309158    2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309163    2553 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309168    2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309173    2553 flags.go:64] FLAG: --eviction-soft=""
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309178    2553 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309182    2553 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309189    2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309194    2553 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309198    2553 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309203    2553 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 14:10:48.316367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309208    2553 flags.go:64] FLAG: --feature-gates=""
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309214    2553 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309219    2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309224    2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309230    2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309234    2553 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309239    2553 flags.go:64] FLAG: --help="false"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309244    2553 flags.go:64] FLAG: --hostname-override="ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309249    2553 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309254    2553 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309258    2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309264    2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309270    2553 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309274    2553 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309279    2553 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309284    2553 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309288    2553 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309293    2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309298    2553 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309303    2553 flags.go:64] FLAG: --kube-reserved=""
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309308    2553 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309312    2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309317    2553 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309322    2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 14:10:48.317072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309326    2553 flags.go:64] FLAG: --lock-file=""
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309331    2553 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309335    2553 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309340    2553 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309348    2553 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309354    2553 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309358    2553 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309363    2553 flags.go:64] FLAG: --logging-format="text"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309368    2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309373    2553 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309393    2553 flags.go:64] FLAG: --manifest-url=""
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309399    2553 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309408    2553 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309412    2553 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309418    2553 flags.go:64] FLAG: --max-pods="110"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309423    2553 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309428    2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309432    2553 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309437    2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309442    2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309447    2553 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309452    2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309464    2553 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309469    2553 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309473    2553 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 14:10:48.317709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309478    2553 flags.go:64] FLAG: --pod-cidr=""
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309483    2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309491    2553 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309495    2553 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309500    2553 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309504    2553 flags.go:64] FLAG: --port="10250"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309509    2553 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309514    2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0772e153ecf92e147"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309520    2553 flags.go:64] FLAG: --qos-reserved=""
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309524    2553 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309530    2553 flags.go:64] FLAG: --register-node="true"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309535    2553 flags.go:64] FLAG: --register-with-taints=""
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309547    2553 flags.go:64] FLAG: --registry-burst="10"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309553    2553 flags.go:64] FLAG: --registry-qps="5"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309558    2553 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309563    2553 flags.go:64] FLAG: --reserved-memory=""
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309568    2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309574    2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309579    2553 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309583    2553 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309591    2553 flags.go:64] FLAG: --runonce="false"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309595    2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309601    2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309606    2553 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309611    2553 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 14:10:48.318319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309616    2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309621    2553 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309626    2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309630    2553 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309635    2553 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309640    2553 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309645    2553 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309649    2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309654    2553 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309659    2553 flags.go:64] FLAG: --system-cgroups=""
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309663    2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309672    2553 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309677    2553 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309681    2553 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309688    2553 flags.go:64] FLAG: --tls-min-version=""
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309693    2553 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309697    2553 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309702    2553 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309707    2553 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309712    2553 flags.go:64] FLAG: --v="2"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309718    2553 flags.go:64] FLAG: --version="false"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309725    2553 flags.go:64] FLAG: --vmodule=""
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309731    2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.309737    2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.309950    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 14:10:48.318946 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.309957    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.309963    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.309969    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.309974    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.309979    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.309986    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.309992    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.309996    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310001    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310005    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310009    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310014    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310018    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310022    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310026    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310030    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310035    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310039    2553 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310043    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 14:10:48.319586 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310050    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310055    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310060    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310064    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310068    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310072    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310076    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310081    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310086    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310090    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310095    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310099    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310104    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310108    2553 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310113    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310119    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310124    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310128    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310132    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310136    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 14:10:48.320050 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310140    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310145    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310149    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310153    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310157    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310162    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310166    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310170    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310176    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310181    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310185    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310189    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310193    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310197    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310201    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310205    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310209    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310213    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310217    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310221    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 14:10:48.320597 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310225    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310229    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310234    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310239    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310243    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310247    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310251    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310259    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310263    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310267    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310271    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310275    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310279    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310284    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310288    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310292    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310297    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310301    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310305    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310309    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 14:10:48.321107 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310315    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310319    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310323    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310328    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310332    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310336    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310340    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310344    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310349    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310353    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310357    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310363    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310369    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310374    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310393    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310398    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310404    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310408    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 14:10:48.321617 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.310413    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 14:10:48.322057 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.310976    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 14:10:48.322057 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.317946    2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 14:10:48.322057 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.317961    2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 14:10:48.322057 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.318751    2553 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 14:10:48.322057 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.318758    2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 14:10:48.322057 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318813    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 14:10:48.322057 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318820    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 14:10:48.322057 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318823    2553 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 14:10:48.322057 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318826    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 14:10:48.322057 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318829    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 14:10:48.322057 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318832    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 14:10:48.322057 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318835    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 14:10:48.322057 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318838    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 14:10:48.322057 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318840    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318843    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318846    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318848    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318851    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318854    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318857    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318859    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318863    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318867    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318870    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318873    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318876    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318879    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318882    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318885    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318888    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318891    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318894    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 14:10:48.322431 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318896    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318900    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318903    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318905    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318908    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318911    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318913    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318916    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318918    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318921    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318923    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318926    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318929    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318931    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318934    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318936    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318939    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318941    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318944    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318947    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 14:10:48.322896 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318950    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318953    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318956    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318958    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318961    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318964    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318966    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318969    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318971    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318974    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318977    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318980    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318983    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318985    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318989    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318993    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318996    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.318999    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319001    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 14:10:48.323369 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319004    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319006    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319009    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319011    2553 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319014    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319016    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319019    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319021    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319024    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319035    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319038    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319041    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319043    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319046    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319048    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319051    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319053    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319056    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319058    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319061    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 14:10:48.323853 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319063    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 14:10:48.324354 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319066    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 14:10:48.324354 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319069    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 14:10:48.324354 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319071    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 14:10:48.324354 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319075    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 14:10:48.324354 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319078    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 14:10:48.324354 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319080    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 14:10:48.324354 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319083    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 14:10:48.324354 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319085    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 14:10:48.324354 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319088    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 14:10:48.324354 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319090    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 14:10:48.324354 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319093    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 14:10:48.324354 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319095    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 14:10:48.324354 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.319100    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 14:10:48.324354 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319222    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 14:10:48.324354 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319227    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319230    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319233    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319236    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319238    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319241    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319243    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319247    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319251    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319254    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319257    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319259    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319262    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319264    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319267    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319270    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319272    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319275    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319277    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 14:10:48.324732 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319280    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319282    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319285    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319288    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319291    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319294    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319296    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319299    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319301    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319303    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319306    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319308    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319311    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319313    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319316    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319318    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319321    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319323    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319326    2553 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319328    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 14:10:48.325198 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319331    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319333    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319336    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319338    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319340    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319343    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319346    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319348    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319351    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319355    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319358    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319360    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319363    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319366    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319370    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319373    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319396    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319402    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319406    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 14:10:48.325734 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319408    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319411    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319414    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319416    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319419    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319421    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319424    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319426    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319429    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319431    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319434    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319436    2553 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319439    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319441    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319445    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319449    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319452    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319454    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319457    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319459    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 14:10:48.326194 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319462    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319464    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319467    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319469    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319472    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319474    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319476    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319481    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319484    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319487    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319491    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319494    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319496    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319499    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319502    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319504    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319507    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319509    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319512    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 14:10:48.326788 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:48.319515    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 14:10:48.327412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.319519    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 14:10:48.327412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.319609    2553 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 14:10:48.327412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.321550    2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 14:10:48.327412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.322637    2553 server.go:1019] "Starting client certificate rotation"
Sep 09 14:10:48.327412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.322729    2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 14:10:48.327412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.322765    2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 14:10:48.327412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.325255    2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 14:10:48.327412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.326721    2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 14:10:48.336457 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.336439    2553 log.go:25] "Validated CRI v1 runtime API"
Sep 09 14:10:48.339377 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.339364    2553 log.go:25] "Validated CRI v1 image API"
Sep 09 14:10:48.341067 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.341049    2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 14:10:48.344410 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.344374    2553 fs.go:135] Filesystem UUIDs: map[40d29c0c-1d3f-44ca-a72d-bb192fc2a163:/dev/nvme0n1p4 73732715-feff-4543-b8a4-cd7020aee033:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 09 14:10:48.344471 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.344411    2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 14:10:48.349424 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.349303    2553 manager.go:216] Machine: {Timestamp:2026-09-09 14:10:48.347969243 +0000 UTC m=+0.350135131 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097353 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2502c855255bbce6c7a8dc0272b06a SystemUUID:ec2502c8-5525-5bbc-e6c7-a8dc0272b06a BootID:8bc2faa5-d298-4029-91ad-87faa55243ea Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:00:83:03:9e:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:00:83:03:9e:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:0f:da:3d:68:db Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 14:10:48.349424 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.349419    2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 14:10:48.349530 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.349488    2553 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 14:10:48.352848 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.352825    2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 14:10:48.352987 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.352851    2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-209.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 14:10:48.353663 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.353652    2553 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 14:10:48.353694 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.353665    2553 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 14:10:48.353694 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.353673    2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 14:10:48.354267 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.354257    2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 14:10:48.355070 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.355059    2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 14:10:48.355468 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.355453    2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 14:10:48.358717 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.358705    2553 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 14:10:48.358816 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.358808    2553 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 14:10:48.358851 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.358836    2553 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 14:10:48.358851 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.358845    2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 14:10:48.358906 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.358858    2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 14:10:48.358906 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.358868    2553 kubelet.go:398] "Adding apiserver pod source"
Sep 09 14:10:48.358906 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.358877    2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 14:10:48.359216 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.359202    2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 14:10:48.359256 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.359231    2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 14:10:48.361212 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.361190    2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 14:10:48.363855 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.363841    2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 14:10:48.363912 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.363870    2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 14:10:48.364874 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.364861    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 14:10:48.364922 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.364882    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 14:10:48.364922 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.364889    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 14:10:48.364922 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.364894    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 14:10:48.364922 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.364903    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 14:10:48.364922 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.364909    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 14:10:48.364922 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.364922    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 14:10:48.365083 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.364929    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 14:10:48.365083 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.364935    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 14:10:48.365083 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.364940    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 14:10:48.365083 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.364954    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 14:10:48.365083 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.364959    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 14:10:48.365736 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.365724    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 14:10:48.365736 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.365736    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 14:10:48.367938 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.367903    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 14:10:48.368039 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.367930    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-209.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 14:10:48.370913 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.370895    2553 server.go:1268] "Started kubelet"
Sep 09 14:10:48.371000 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.370977    2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 14:10:48.371055 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.370979    2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 14:10:48.371098 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.371052    2553 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 14:10:48.371229 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.371213    2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-209.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 14:10:48.371702 ip-10-0-142-209 systemd[1]: Started Kubernetes Kubelet.
Sep 09 14:10:48.373007 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.371930    2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 14:10:48.373007 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.372876    2553 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 14:10:48.375245 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.375225    2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 14:10:48.376960 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.376946    2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h6w9x"
Sep 09 14:10:48.378519 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.378503    2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 14:10:48.378519 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.378516    2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 14:10:48.378635 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.378583    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-209.ec2.internal\" not found"
Sep 09 14:10:48.379125 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.379006    2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 14:10:48.379125 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.379033    2553 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 14:10:48.379125 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.379067    2553 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 14:10:48.379285 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.379179    2553 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 14:10:48.379285 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.379187    2553 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 14:10:48.379391 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.379361    2553 factory.go:55] Registering systemd factory
Sep 09 14:10:48.379391 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.379376    2553 factory.go:223] Registration of the systemd container factory successfully
Sep 09 14:10:48.379484 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.378276    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-209.ec2.internal.18d3ac6a06720e99  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-209.ec2.internal,UID:ip-10-0-142-209.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-209.ec2.internal,},FirstTimestamp:2026-09-09 14:10:48.370867865 +0000 UTC m=+0.373033733,LastTimestamp:2026-09-09 14:10:48.370867865 +0000 UTC m=+0.373033733,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-209.ec2.internal,}"
Sep 09 14:10:48.379616 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.379595    2553 factory.go:153] Registering CRI-O factory
Sep 09 14:10:48.379616 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.379615    2553 factory.go:223] Registration of the crio container factory successfully
Sep 09 14:10:48.379780 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.379663    2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 14:10:48.379780 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.379678    2553 factory.go:103] Registering Raw factory
Sep 09 14:10:48.379780 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.379692    2553 manager.go:1196] Started watching for new ooms in manager
Sep 09 14:10:48.380055 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.380041    2553 manager.go:349] Starting recovery of all containers
Sep 09 14:10:48.385601 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.385493    2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h6w9x"
Sep 09 14:10:48.386414 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.386372    2553 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-209.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 14:10:48.386536 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.386439    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 14:10:48.392228 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.392212    2553 manager.go:354] Recovery completed
Sep 09 14:10:48.396043 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.396031    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 14:10:48.397808 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.397789    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 14:10:48.397884 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.397825    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 14:10:48.397884 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.397842    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasSufficientPID"
Sep 09 14:10:48.398394 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.398368    2553 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 14:10:48.398453 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.398396    2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 14:10:48.398453 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.398413    2553 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 14:10:48.398453 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.398450    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 14:10:48.399496 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.399426    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-209.ec2.internal.18d3ac6a080d1fe6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-209.ec2.internal,UID:ip-10-0-142-209.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-209.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-209.ec2.internal,},FirstTimestamp:2026-09-09 14:10:48.39780759 +0000 UTC m=+0.399973462,LastTimestamp:2026-09-09 14:10:48.39780759 +0000 UTC m=+0.399973462,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-209.ec2.internal,}"
Sep 09 14:10:48.399915 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.399884    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 14:10:48.399984 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.399915    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 14:10:48.399984 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.399930    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasSufficientPID"
Sep 09 14:10:48.400494 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.400481    2553 policy_none.go:49] "None policy: Start"
Sep 09 14:10:48.400548 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.400497    2553 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 14:10:48.400548 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.400507    2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 14:10:48.402510 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.402499    2553 policy_none.go:47] "Start"
Sep 09 14:10:48.428974 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.428958    2553 manager.go:337] "Starting Device Plugin manager"
Sep 09 14:10:48.454074 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.429034    2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 14:10:48.454074 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.429049    2553 server.go:87] "Starting device plugin registration server"
Sep 09 14:10:48.454074 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.429310    2553 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 14:10:48.454074 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.429324    2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 14:10:48.454074 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.429428    2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 14:10:48.454074 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.429499    2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 14:10:48.454074 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.429508    2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 14:10:48.454074 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.430850    2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 14:10:48.454074 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.430894    2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-209.ec2.internal\" not found"
Sep 09 14:10:48.454074 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.440467    2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 14:10:48.454074 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.441566    2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 14:10:48.454074 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.441605    2553 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 14:10:48.454074 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.441624    2553 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 14:10:48.454074 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.441661    2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 14:10:48.454074 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.444114    2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 14:10:48.530277 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.530257    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 14:10:48.531041 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.531012    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 14:10:48.531124 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.531053    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 14:10:48.531124 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.531068    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasSufficientPID"
Sep 09 14:10:48.531124 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.531092    2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.539169 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.539154    2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.539220 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.539174    2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-209.ec2.internal\": node \"ip-10-0-142-209.ec2.internal\" not found"
Sep 09 14:10:48.541753 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.541721    2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-209.ec2.internal"]
Sep 09 14:10:48.541816 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.541804    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 14:10:48.542525 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.542510    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 14:10:48.542605 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.542535    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 14:10:48.542605 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.542551    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasSufficientPID"
Sep 09 14:10:48.544763 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.544749    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 14:10:48.544888 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.544875    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.544933 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.544901    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 14:10:48.545422 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.545404    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 14:10:48.545422 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.545416    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 14:10:48.545546 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.545435    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 14:10:48.545546 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.545438    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 14:10:48.545546 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.545446    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasSufficientPID"
Sep 09 14:10:48.545546 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.545448    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasSufficientPID"
Sep 09 14:10:48.547665 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.547649    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.547744 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.547674    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 14:10:48.548354 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.548300    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 14:10:48.548354 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.548330    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 14:10:48.548354 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.548345    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeHasSufficientPID"
Sep 09 14:10:48.555062 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.555048    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-209.ec2.internal\" not found"
Sep 09 14:10:48.580630 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.580614    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/41fcb2aaf86bde291d1277e410f2d123-config\") pod \"kube-apiserver-proxy-ip-10-0-142-209.ec2.internal\" (UID: \"41fcb2aaf86bde291d1277e410f2d123\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.580704 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.580637    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a90c67abb42ed00b6d40f8d2b6ad9bee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal\" (UID: \"a90c67abb42ed00b6d40f8d2b6ad9bee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.580704 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.580652    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a90c67abb42ed00b6d40f8d2b6ad9bee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal\" (UID: \"a90c67abb42ed00b6d40f8d2b6ad9bee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.584918 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.584906    2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-209.ec2.internal\" not found" node="ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.589283 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.589266    2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-209.ec2.internal\" not found" node="ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.655306 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.655288    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-209.ec2.internal\" not found"
Sep 09 14:10:48.681091 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.681072    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a90c67abb42ed00b6d40f8d2b6ad9bee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal\" (UID: \"a90c67abb42ed00b6d40f8d2b6ad9bee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.681161 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.681094    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a90c67abb42ed00b6d40f8d2b6ad9bee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal\" (UID: \"a90c67abb42ed00b6d40f8d2b6ad9bee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.681161 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.681111    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/41fcb2aaf86bde291d1277e410f2d123-config\") pod \"kube-apiserver-proxy-ip-10-0-142-209.ec2.internal\" (UID: \"41fcb2aaf86bde291d1277e410f2d123\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.681161 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.681133    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/41fcb2aaf86bde291d1277e410f2d123-config\") pod \"kube-apiserver-proxy-ip-10-0-142-209.ec2.internal\" (UID: \"41fcb2aaf86bde291d1277e410f2d123\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.681270 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.681157    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a90c67abb42ed00b6d40f8d2b6ad9bee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal\" (UID: \"a90c67abb42ed00b6d40f8d2b6ad9bee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.681270 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.681169    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a90c67abb42ed00b6d40f8d2b6ad9bee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal\" (UID: \"a90c67abb42ed00b6d40f8d2b6ad9bee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.756141 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.756119    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-209.ec2.internal\" not found"
Sep 09 14:10:48.856749 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.856693    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-209.ec2.internal\" not found"
Sep 09 14:10:48.887356 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.887332    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.893307 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:48.893288    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-209.ec2.internal"
Sep 09 14:10:48.956785 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:48.956752    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-209.ec2.internal\" not found"
Sep 09 14:10:49.057283 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:49.057260    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-209.ec2.internal\" not found"
Sep 09 14:10:49.157764 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:49.157706    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-209.ec2.internal\" not found"
Sep 09 14:10:49.258479 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:49.258452    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-209.ec2.internal\" not found"
Sep 09 14:10:50.520010 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:50.519985    2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 14:10:50.520344 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:50.520138    2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 14:10:50.557280 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:50.557262    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-209.ec2.internal\" not found"
Sep 09 14:10:50.588484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:50.588458    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 14:05:49 +0000 UTC" deadline="2028-04-24 10:24:24.378384541 +0000 UTC"
Sep 09 14:10:50.588484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:50.588483    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14228h13m33.789904441s"
Sep 09 14:10:50.658087 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:50.658063    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-209.ec2.internal\" not found"
Sep 09 14:10:50.667036 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:50.666769    2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 14:10:50.733046 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:50.733013    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41fcb2aaf86bde291d1277e410f2d123.slice/crio-9d64f4c6db4a476866f7a91bf6604a25770aa759fec0ac3dfbfe4d81865218ac WatchSource:0}: Error finding container 9d64f4c6db4a476866f7a91bf6604a25770aa759fec0ac3dfbfe4d81865218ac: Status 404 returned error can't find the container with id 9d64f4c6db4a476866f7a91bf6604a25770aa759fec0ac3dfbfe4d81865218ac
Sep 09 14:10:50.733264 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:50.733245    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda90c67abb42ed00b6d40f8d2b6ad9bee.slice/crio-1bd6c744ff33f203bd45683a7935116e5146b57669e2828a9376371f7c4dd444 WatchSource:0}: Error finding container 1bd6c744ff33f203bd45683a7935116e5146b57669e2828a9376371f7c4dd444: Status 404 returned error can't find the container with id 1bd6c744ff33f203bd45683a7935116e5146b57669e2828a9376371f7c4dd444
Sep 09 14:10:50.737945 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:50.737928    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 14:10:50.758635 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:50.758612    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-209.ec2.internal\" not found"
Sep 09 14:10:50.858818 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:50.858767    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-209.ec2.internal\" not found"
Sep 09 14:10:50.858818 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:50.858792    2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 14:10:50.877611 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:50.877595    2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal"
Sep 09 14:10:50.888707 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:50.888691    2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 14:10:50.890103 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:50.890090    2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-209.ec2.internal"
Sep 09 14:10:50.896100 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:50.896088    2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 14:10:50.924696 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:50.924676    2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 14:10:51.376686 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.376658    2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 14:10:51.557793 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.557764    2553 apiserver.go:52] "Watching apiserver"
Sep 09 14:10:51.566364 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.566342    2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 14:10:51.567662 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.567637    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq","openshift-image-registry/node-ca-ww47d","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal","openshift-multus/multus-additional-cni-plugins-wxsqq","openshift-multus/multus-lzzk8","openshift-network-diagnostics/network-check-target-bnc5m","kube-system/global-pull-secret-syncer-22vlz","kube-system/kube-apiserver-proxy-ip-10-0-142-209.ec2.internal","openshift-cluster-node-tuning-operator/tuned-74qrd","openshift-dns/node-resolver-ldbss","openshift-multus/network-metrics-daemon-hgx77","openshift-network-operator/iptables-alerter-fbv7p","openshift-ovn-kubernetes/ovnkube-node-72sxp","kube-system/konnectivity-agent-lp4m6"]
Sep 09 14:10:51.570102 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.570076    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:51.570205 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:51.570156    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:10:51.572394 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.572374    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.574531 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.574511    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lp4m6"
Sep 09 14:10:51.574758 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.574690    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 14:10:51.574838 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.574781    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h4k89\""
Sep 09 14:10:51.575052 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.574924    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 14:10:51.575052 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.575028    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 14:10:51.575616 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.575597    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 14:10:51.575876 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.575807    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 14:10:51.575876 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.575804    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 14:10:51.576653 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.576593    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 14:10:51.576894 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.576854    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.577460 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.577053    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 14:10:51.577460 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.577150    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2lbkx\""
Sep 09 14:10:51.578649 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.577967    2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 14:10:51.578881 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.578865    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 14:10:51.579113 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.579093    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 14:10:51.579502 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.579484    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.579697 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.579680    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 14:10:51.579914 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.579897    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 14:10:51.579987 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.579963    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r59z9\""
Sep 09 14:10:51.580220 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.580201    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 14:10:51.581901 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.581664    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 14:10:51.581901 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.581890    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-296hk\""
Sep 09 14:10:51.582152 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.582130    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:10:51.582241 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:51.582190    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:10:51.584404 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.584386    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.587482 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.587459    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 14:10:51.587729 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.587701    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5shc7\""
Sep 09 14:10:51.587923 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.587903    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 14:10:51.588119 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.588104    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.592526 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.592488    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-multus-cni-dir\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.592639 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.592616    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-run-multus-certs\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.592702 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.592676    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07b89a46-bf5c-4842-976f-ff7830f1c2ae-kubelet-config\") pod \"global-pull-secret-syncer-22vlz\" (UID: \"07b89a46-bf5c-4842-976f-ff7830f1c2ae\") " pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:51.592757 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.592720    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-var-lib-cni-bin\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.592807 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.592768    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-systemd-units\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.592807 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.592801    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-var-lib-openvswitch\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.592933 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.592914    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ww47d"
Sep 09 14:10:51.594279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.593446    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-run-ovn-kubernetes\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.594279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.593506    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c9ef420-d914-4112-bd40-416873951a81-env-overrides\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.594279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.593548    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c9ef420-d914-4112-bd40-416873951a81-ovn-node-metrics-cert\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.594279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.593607    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c9ef420-d914-4112-bd40-416873951a81-ovnkube-script-lib\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.594279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.593673    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-multus-socket-dir-parent\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.594279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.593696    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07b89a46-bf5c-4842-976f-ff7830f1c2ae-dbus\") pod \"global-pull-secret-syncer-22vlz\" (UID: \"07b89a46-bf5c-4842-976f-ff7830f1c2ae\") " pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:51.594279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.593726    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-run-systemd\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.594279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.593771    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-cni-netd\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.594279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.593805    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f28d3ef-366f-4ea4-9f4d-faf5cb7b22a7-konnectivity-ca\") pod \"konnectivity-agent-lp4m6\" (UID: \"4f28d3ef-366f-4ea4-9f4d-faf5cb7b22a7\") " pod="kube-system/konnectivity-agent-lp4m6"
Sep 09 14:10:51.594279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.593836    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.594279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.593866    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-cni-binary-copy\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.594279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.593900    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-run-k8s-cni-cncf-io\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.594279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.593928    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-hostroot\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.594279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.593971    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-etc-openvswitch\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.594279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.594004    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-run-openvswitch\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.594279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.594027    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f28d3ef-366f-4ea4-9f4d-faf5cb7b22a7-agent-certs\") pod \"konnectivity-agent-lp4m6\" (UID: \"4f28d3ef-366f-4ea4-9f4d-faf5cb7b22a7\") " pod="kube-system/konnectivity-agent-lp4m6"
Sep 09 14:10:51.595038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.594062    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-225nc\" (UniqueName: \"kubernetes.io/projected/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-kube-api-access-225nc\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.595038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.594092    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-cnibin\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.595038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.594132    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-var-lib-cni-multus\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.595038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.594159    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-var-lib-kubelet\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.595038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.594204    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-run-ovn\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.595038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.594243    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.595038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.594524    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-792w5\" (UniqueName: \"kubernetes.io/projected/7c9ef420-d914-4112-bd40-416873951a81-kube-api-access-792w5\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.595038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.594556    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.595038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.594626    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-multus-daemon-config\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.595038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.594670    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzwv7\" (UniqueName: \"kubernetes.io/projected/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-kube-api-access-gzwv7\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.595038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.594734    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-slash\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.595038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.594774    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-run-netns\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.595617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.594801    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-log-socket\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.595617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.595115    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-system-cni-dir\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.595617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.595129    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ldbss"
Sep 09 14:10:51.595617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.595158    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-cnibin\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.595617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.595204    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.595617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.595249    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-run-netns\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.595617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.595285    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-etc-kubernetes\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.595617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.595304    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-cni-bin\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.595617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.595320    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.595617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.595337    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-system-cni-dir\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.595617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.595353    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-multus-conf-dir\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.595617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.595370    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret\") pod \"global-pull-secret-syncer-22vlz\" (UID: \"07b89a46-bf5c-4842-976f-ff7830f1c2ae\") " pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:51.595617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.595425    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-kubelet\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.595617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.595461    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-node-log\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.595617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.595494    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c9ef420-d914-4112-bd40-416873951a81-ovnkube-config\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.596251 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.595650    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:10:51.596251 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:51.595759    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:10:51.597531 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.596891    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 14:10:51.597531 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.597116    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 14:10:51.597531 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.597182    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 14:10:51.597531 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.597280    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dbfvh\""
Sep 09 14:10:51.597531 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.597321    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 14:10:51.597531 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.597335    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fwm9w\""
Sep 09 14:10:51.597531 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.597396    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 14:10:51.597531 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.597284    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 14:10:51.597951 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.597722    2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 14:10:51.597951 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.597938    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7spm4\""
Sep 09 14:10:51.598045 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.598007    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 14:10:51.598099 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.597942    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 14:10:51.598791 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.598773    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fbv7p"
Sep 09 14:10:51.600972 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.600921    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 14:10:51.600972 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.600956    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z9f9m\""
Sep 09 14:10:51.601116 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.600972    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 14:10:51.601116 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.601065    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 14:10:51.611946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.611072    2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xpwrr"
Sep 09 14:10:51.617331 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.616722    2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xpwrr"
Sep 09 14:10:51.647444 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.647403    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-209.ec2.internal" event={"ID":"41fcb2aaf86bde291d1277e410f2d123","Type":"ContainerStarted","Data":"9d64f4c6db4a476866f7a91bf6604a25770aa759fec0ac3dfbfe4d81865218ac"}
Sep 09 14:10:51.648997 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.648968    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal" event={"ID":"a90c67abb42ed00b6d40f8d2b6ad9bee","Type":"ContainerStarted","Data":"1bd6c744ff33f203bd45683a7935116e5146b57669e2828a9376371f7c4dd444"}
Sep 09 14:10:51.679276 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.679253    2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 14:10:51.695824 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.695795    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-cni-bin\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.695939 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.695841    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.695939 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.695866    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-system-cni-dir\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.695939 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.695892    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9hc7\" (UniqueName: \"kubernetes.io/projected/15a8db16-3b65-48f6-8939-7317af3c9764-kube-api-access-b9hc7\") pod \"iptables-alerter-fbv7p\" (UID: \"15a8db16-3b65-48f6-8939-7317af3c9764\") " pod="openshift-network-operator/iptables-alerter-fbv7p"
Sep 09 14:10:51.695939 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.695900    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-cni-bin\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.695939 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.695917    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-registration-dir\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.696090 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.695946    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-modprobe-d\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.696090 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.695973    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-kubelet\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.696090 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.695995    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-multus-cni-dir\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.696090 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696018    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07b89a46-bf5c-4842-976f-ff7830f1c2ae-kubelet-config\") pod \"global-pull-secret-syncer-22vlz\" (UID: \"07b89a46-bf5c-4842-976f-ff7830f1c2ae\") " pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:51.696090 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696040    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-lib-modules\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.696090 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696060    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7073d92b-77ab-46c2-98bd-ac827126c826-serviceca\") pod \"node-ca-ww47d\" (UID: \"7073d92b-77ab-46c2-98bd-ac827126c826\") " pod="openshift-image-registry/node-ca-ww47d"
Sep 09 14:10:51.696090 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696083    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-var-lib-openvswitch\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.696325 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696108    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c9ef420-d914-4112-bd40-416873951a81-ovnkube-script-lib\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.696325 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696133    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-multus-socket-dir-parent\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.696325 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696174    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-hostroot\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.696325 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696198    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs\") pod \"network-metrics-daemon-hgx77\" (UID: \"464b2caf-067c-434c-ac2d-6b73c3855127\") " pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:10:51.696325 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696222    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2l96\" (UniqueName: \"kubernetes.io/projected/24c63b1d-604c-4cda-843e-34aab2a36e9d-kube-api-access-j2l96\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.696325 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696245    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7x7s\" (UniqueName: \"kubernetes.io/projected/0256961f-5a7f-4e42-b718-e430e65924fd-kube-api-access-k7x7s\") pod \"node-resolver-ldbss\" (UID: \"0256961f-5a7f-4e42-b718-e430e65924fd\") " pod="openshift-dns/node-resolver-ldbss"
Sep 09 14:10:51.696325 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696270    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-cni-netd\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.696325 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696295    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.696325 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696322    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-run-k8s-cni-cncf-io\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.696682 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696350    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-run-openvswitch\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.696682 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696373    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f28d3ef-366f-4ea4-9f4d-faf5cb7b22a7-agent-certs\") pod \"konnectivity-agent-lp4m6\" (UID: \"4f28d3ef-366f-4ea4-9f4d-faf5cb7b22a7\") " pod="kube-system/konnectivity-agent-lp4m6"
Sep 09 14:10:51.696682 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696398    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-225nc\" (UniqueName: \"kubernetes.io/projected/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-kube-api-access-225nc\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.696682 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696421    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-cnibin\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.696682 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696462    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-var-lib-cni-multus\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.696682 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696481    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.696682 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696487    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-var-lib-kubelet\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.696682 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696513    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/15a8db16-3b65-48f6-8939-7317af3c9764-iptables-alerter-script\") pod \"iptables-alerter-fbv7p\" (UID: \"15a8db16-3b65-48f6-8939-7317af3c9764\") " pod="openshift-network-operator/iptables-alerter-fbv7p"
Sep 09 14:10:51.696682 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696540    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.696682 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696606    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.696682 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696668    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-system-cni-dir\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.696682 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696679    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-792w5\" (UniqueName: \"kubernetes.io/projected/7c9ef420-d914-4112-bd40-416873951a81-kube-api-access-792w5\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696711    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-multus-socket-dir-parent\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696718    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696684    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-var-lib-cni-multus\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696730    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-var-lib-openvswitch\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696683    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-kubelet\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696761    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696776    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696779    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-multus-cni-dir\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696805    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-sys-fs\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696832    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-sysconfig\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696854    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-host\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696777    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-var-lib-kubelet\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696917    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvjt6\" (UniqueName: \"kubernetes.io/projected/7073d92b-77ab-46c2-98bd-ac827126c826-kube-api-access-kvjt6\") pod \"node-ca-ww47d\" (UID: \"7073d92b-77ab-46c2-98bd-ac827126c826\") " pod="openshift-image-registry/node-ca-ww47d"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696945    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-slash\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696969    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-run-netns\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.696996    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-cnibin\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.697096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697024    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-etc-kubernetes\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697050    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0256961f-5a7f-4e42-b718-e430e65924fd-tmp-dir\") pod \"node-resolver-ldbss\" (UID: \"0256961f-5a7f-4e42-b718-e430e65924fd\") " pod="openshift-dns/node-resolver-ldbss"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697055    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-cni-netd\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697075    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-multus-conf-dir\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697119    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-cnibin\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697154    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-device-dir\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697180    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-sysctl-conf\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697205    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-tuned\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697221    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697239    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret\") pod \"global-pull-secret-syncer-22vlz\" (UID: \"07b89a46-bf5c-4842-976f-ff7830f1c2ae\") " pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697247    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697263    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-node-log\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697279    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07b89a46-bf5c-4842-976f-ff7830f1c2ae-kubelet-config\") pod \"global-pull-secret-syncer-22vlz\" (UID: \"07b89a46-bf5c-4842-976f-ff7830f1c2ae\") " pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697295    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-etc-kubernetes\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697287    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c9ef420-d914-4112-bd40-416873951a81-ovnkube-config\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697309    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c9ef420-d914-4112-bd40-416873951a81-ovnkube-script-lib\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697328    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-run-multus-certs\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.697604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697330    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-multus-conf-dir\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697321    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-run-openvswitch\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697351    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-run-k8s-cni-cncf-io\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697357    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-socket-dir\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697393    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-cnibin\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697403    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-slash\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697414    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-hostroot\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697425    2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697953    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-var-lib-cni-bin\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697976    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-run-netns\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:51.697992    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.697998    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5lmd\" (UniqueName: \"kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd\") pod \"network-check-target-bnc5m\" (UID: \"6869fb67-38e1-4f8c-851b-71063a6c4942\") " pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698031    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-run-multus-certs\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:51.698087    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret podName:07b89a46-bf5c-4842-976f-ff7830f1c2ae nodeName:}" failed. No retries permitted until 2026-09-09 14:10:52.198049769 +0000 UTC m=+3.002032769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret") pod "global-pull-secret-syncer-22vlz" (UID: "07b89a46-bf5c-4842-976f-ff7830f1c2ae") : object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698192    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0256961f-5a7f-4e42-b718-e430e65924fd-hosts-file\") pod \"node-resolver-ldbss\" (UID: \"0256961f-5a7f-4e42-b718-e430e65924fd\") " pod="openshift-dns/node-resolver-ldbss"
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698216    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/15a8db16-3b65-48f6-8939-7317af3c9764-host-slash\") pod \"iptables-alerter-fbv7p\" (UID: \"15a8db16-3b65-48f6-8939-7317af3c9764\") " pod="openshift-network-operator/iptables-alerter-fbv7p"
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698256    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-systemd-units\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.698314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698286    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-var-lib-cni-bin\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698316    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-run-ovn-kubernetes\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698322    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-node-log\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698371    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c9ef420-d914-4112-bd40-416873951a81-env-overrides\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698399    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c9ef420-d914-4112-bd40-416873951a81-ovn-node-metrics-cert\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698426    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-run\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698451    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-sys\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698469    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c9ef420-d914-4112-bd40-416873951a81-ovnkube-config\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698532    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86s8r\" (UniqueName: \"kubernetes.io/projected/464b2caf-067c-434c-ac2d-6b73c3855127-kube-api-access-86s8r\") pod \"network-metrics-daemon-hgx77\" (UID: \"464b2caf-067c-434c-ac2d-6b73c3855127\") " pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698578    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07b89a46-bf5c-4842-976f-ff7830f1c2ae-dbus\") pod \"global-pull-secret-syncer-22vlz\" (UID: \"07b89a46-bf5c-4842-976f-ff7830f1c2ae\") " pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698606    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-run-systemd\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698642    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f28d3ef-366f-4ea4-9f4d-faf5cb7b22a7-konnectivity-ca\") pod \"konnectivity-agent-lp4m6\" (UID: \"4f28d3ef-366f-4ea4-9f4d-faf5cb7b22a7\") " pod="kube-system/konnectivity-agent-lp4m6"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698668    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-cni-binary-copy\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698691    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-kubernetes\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698712    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7073d92b-77ab-46c2-98bd-ac827126c826-host\") pod \"node-ca-ww47d\" (UID: \"7073d92b-77ab-46c2-98bd-ac827126c826\") " pod="openshift-image-registry/node-ca-ww47d"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698759    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-etc-openvswitch\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698784    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-multus-daemon-config\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.699160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698807    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-sysctl-d\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698829    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-systemd\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698853    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqtkt\" (UniqueName: \"kubernetes.io/projected/feee570d-dcbc-4f6f-93eb-4ce439013d04-kube-api-access-jqtkt\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698871    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c9ef420-d914-4112-bd40-416873951a81-env-overrides\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698879    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-run-ovn\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698919    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-host-run-ovn-kubernetes\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698934    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-etc-openvswitch\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.698982    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07b89a46-bf5c-4842-976f-ff7830f1c2ae-dbus\") pod \"global-pull-secret-syncer-22vlz\" (UID: \"07b89a46-bf5c-4842-976f-ff7830f1c2ae\") " pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699019    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-run-ovn\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699052    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-run-systemd\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699215    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-systemd-units\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699250    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzwv7\" (UniqueName: \"kubernetes.io/projected/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-kube-api-access-gzwv7\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699297    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-var-lib-kubelet\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699323    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feee570d-dcbc-4f6f-93eb-4ce439013d04-tmp\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699373    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-log-socket\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699403    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f28d3ef-366f-4ea4-9f4d-faf5cb7b22a7-konnectivity-ca\") pod \"konnectivity-agent-lp4m6\" (UID: \"4f28d3ef-366f-4ea4-9f4d-faf5cb7b22a7\") " pod="kube-system/konnectivity-agent-lp4m6"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699400    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-system-cni-dir\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.699976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699443    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.700609 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699483    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-multus-daemon-config\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.700609 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699610    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-run-netns\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.700609 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699619    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c9ef420-d914-4112-bd40-416873951a81-log-socket\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.700609 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699695    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-system-cni-dir\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.700609 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699736    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-host-run-netns\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.700609 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699772    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.700609 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.699843    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-cni-binary-copy\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.702547 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.702525    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f28d3ef-366f-4ea4-9f4d-faf5cb7b22a7-agent-certs\") pod \"konnectivity-agent-lp4m6\" (UID: \"4f28d3ef-366f-4ea4-9f4d-faf5cb7b22a7\") " pod="kube-system/konnectivity-agent-lp4m6"
Sep 09 14:10:51.703035 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.702808    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c9ef420-d914-4112-bd40-416873951a81-ovn-node-metrics-cert\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.708800 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.708775    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-225nc\" (UniqueName: \"kubernetes.io/projected/86fae8d0-b7af-4df3-98d0-ebb2719ecdbd-kube-api-access-225nc\") pod \"multus-additional-cni-plugins-wxsqq\" (UID: \"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd\") " pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.712690 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.712648    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzwv7\" (UniqueName: \"kubernetes.io/projected/b9455b7b-bf7b-4b9b-bb97-0e744b913a6e-kube-api-access-gzwv7\") pod \"multus-lzzk8\" (UID: \"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e\") " pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.714356 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.714335    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-792w5\" (UniqueName: \"kubernetes.io/projected/7c9ef420-d914-4112-bd40-416873951a81-kube-api-access-792w5\") pod \"ovnkube-node-72sxp\" (UID: \"7c9ef420-d914-4112-bd40-416873951a81\") " pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.800523 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800497    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.800658 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800532    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-sys-fs\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.800658 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800554    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-sysconfig\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.800658 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800593    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-host\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.800658 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800604    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.800658 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800616    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvjt6\" (UniqueName: \"kubernetes.io/projected/7073d92b-77ab-46c2-98bd-ac827126c826-kube-api-access-kvjt6\") pod \"node-ca-ww47d\" (UID: \"7073d92b-77ab-46c2-98bd-ac827126c826\") " pod="openshift-image-registry/node-ca-ww47d"
Sep 09 14:10:51.800658 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800642    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0256961f-5a7f-4e42-b718-e430e65924fd-tmp-dir\") pod \"node-resolver-ldbss\" (UID: \"0256961f-5a7f-4e42-b718-e430e65924fd\") " pod="openshift-dns/node-resolver-ldbss"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800664    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-host\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800667    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-device-dir\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800672    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-sys-fs\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800714    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-sysconfig\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800729    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-sysctl-conf\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800758    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-device-dir\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800790    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-tuned\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800826    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-socket-dir\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800851    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5lmd\" (UniqueName: \"kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd\") pod \"network-check-target-bnc5m\" (UID: \"6869fb67-38e1-4f8c-851b-71063a6c4942\") " pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800875    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0256961f-5a7f-4e42-b718-e430e65924fd-hosts-file\") pod \"node-resolver-ldbss\" (UID: \"0256961f-5a7f-4e42-b718-e430e65924fd\") " pod="openshift-dns/node-resolver-ldbss"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800898    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/15a8db16-3b65-48f6-8939-7317af3c9764-host-slash\") pod \"iptables-alerter-fbv7p\" (UID: \"15a8db16-3b65-48f6-8939-7317af3c9764\") " pod="openshift-network-operator/iptables-alerter-fbv7p"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800904    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-sysctl-conf\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800923    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-run\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800944    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-sys\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800961    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86s8r\" (UniqueName: \"kubernetes.io/projected/464b2caf-067c-434c-ac2d-6b73c3855127-kube-api-access-86s8r\") pod \"network-metrics-daemon-hgx77\" (UID: \"464b2caf-067c-434c-ac2d-6b73c3855127\") " pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800978    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-kubernetes\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.800991    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7073d92b-77ab-46c2-98bd-ac827126c826-host\") pod \"node-ca-ww47d\" (UID: \"7073d92b-77ab-46c2-98bd-ac827126c826\") " pod="openshift-image-registry/node-ca-ww47d"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801006    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-sysctl-d\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801022    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-systemd\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801029    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0256961f-5a7f-4e42-b718-e430e65924fd-tmp-dir\") pod \"node-resolver-ldbss\" (UID: \"0256961f-5a7f-4e42-b718-e430e65924fd\") " pod="openshift-dns/node-resolver-ldbss"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801041    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqtkt\" (UniqueName: \"kubernetes.io/projected/feee570d-dcbc-4f6f-93eb-4ce439013d04-kube-api-access-jqtkt\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801063    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-var-lib-kubelet\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801086    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feee570d-dcbc-4f6f-93eb-4ce439013d04-tmp\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801115    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9hc7\" (UniqueName: \"kubernetes.io/projected/15a8db16-3b65-48f6-8939-7317af3c9764-kube-api-access-b9hc7\") pod \"iptables-alerter-fbv7p\" (UID: \"15a8db16-3b65-48f6-8939-7317af3c9764\") " pod="openshift-network-operator/iptables-alerter-fbv7p"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801122    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0256961f-5a7f-4e42-b718-e430e65924fd-hosts-file\") pod \"node-resolver-ldbss\" (UID: \"0256961f-5a7f-4e42-b718-e430e65924fd\") " pod="openshift-dns/node-resolver-ldbss"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801125    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/15a8db16-3b65-48f6-8939-7317af3c9764-host-slash\") pod \"iptables-alerter-fbv7p\" (UID: \"15a8db16-3b65-48f6-8939-7317af3c9764\") " pod="openshift-network-operator/iptables-alerter-fbv7p"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801165    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-run\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801137    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-registration-dir\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801185    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7073d92b-77ab-46c2-98bd-ac827126c826-host\") pod \"node-ca-ww47d\" (UID: \"7073d92b-77ab-46c2-98bd-ac827126c826\") " pod="openshift-image-registry/node-ca-ww47d"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801191    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-registration-dir\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801199    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-sys\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801161    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-socket-dir\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801200    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-modprobe-d\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801244    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-kubernetes\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.801735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801250    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-lib-modules\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.802484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801279    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7073d92b-77ab-46c2-98bd-ac827126c826-serviceca\") pod \"node-ca-ww47d\" (UID: \"7073d92b-77ab-46c2-98bd-ac827126c826\") " pod="openshift-image-registry/node-ca-ww47d"
Sep 09 14:10:51.802484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801297    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-var-lib-kubelet\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.802484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801307    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs\") pod \"network-metrics-daemon-hgx77\" (UID: \"464b2caf-067c-434c-ac2d-6b73c3855127\") " pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:10:51.802484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801332    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2l96\" (UniqueName: \"kubernetes.io/projected/24c63b1d-604c-4cda-843e-34aab2a36e9d-kube-api-access-j2l96\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.802484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801390    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-sysctl-d\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.802484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801422    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-systemd\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.802484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801479    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-lib-modules\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.802484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801491    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-modprobe-d\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.802484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801508    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7x7s\" (UniqueName: \"kubernetes.io/projected/0256961f-5a7f-4e42-b718-e430e65924fd-kube-api-access-k7x7s\") pod \"node-resolver-ldbss\" (UID: \"0256961f-5a7f-4e42-b718-e430e65924fd\") " pod="openshift-dns/node-resolver-ldbss"
Sep 09 14:10:51.802484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801669    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/15a8db16-3b65-48f6-8939-7317af3c9764-iptables-alerter-script\") pod \"iptables-alerter-fbv7p\" (UID: \"15a8db16-3b65-48f6-8939-7317af3c9764\") " pod="openshift-network-operator/iptables-alerter-fbv7p"
Sep 09 14:10:51.802484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801696    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.802484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801750    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7073d92b-77ab-46c2-98bd-ac827126c826-serviceca\") pod \"node-ca-ww47d\" (UID: \"7073d92b-77ab-46c2-98bd-ac827126c826\") " pod="openshift-image-registry/node-ca-ww47d"
Sep 09 14:10:51.802484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.801767    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24c63b1d-604c-4cda-843e-34aab2a36e9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.802484 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:51.801924    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:51.802484 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:51.801981    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs podName:464b2caf-067c-434c-ac2d-6b73c3855127 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:52.30196369 +0000 UTC m=+3.105946687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs") pod "network-metrics-daemon-hgx77" (UID: "464b2caf-067c-434c-ac2d-6b73c3855127") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:51.803066 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.802701    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/15a8db16-3b65-48f6-8939-7317af3c9764-iptables-alerter-script\") pod \"iptables-alerter-fbv7p\" (UID: \"15a8db16-3b65-48f6-8939-7317af3c9764\") " pod="openshift-network-operator/iptables-alerter-fbv7p"
Sep 09 14:10:51.803424 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.803402    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/feee570d-dcbc-4f6f-93eb-4ce439013d04-etc-tuned\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.803688 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.803660    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feee570d-dcbc-4f6f-93eb-4ce439013d04-tmp\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.811391 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:51.811143    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 14:10:51.811391 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:51.811164    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 14:10:51.811391 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:51.811177    2553 projected.go:196] Error preparing data for projected volume kube-api-access-z5lmd for pod openshift-network-diagnostics/network-check-target-bnc5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:51.811391 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:51.811239    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd podName:6869fb67-38e1-4f8c-851b-71063a6c4942 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:52.311222869 +0000 UTC m=+3.115205868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z5lmd" (UniqueName: "kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd") pod "network-check-target-bnc5m" (UID: "6869fb67-38e1-4f8c-851b-71063a6c4942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:51.812677 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.812650    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvjt6\" (UniqueName: \"kubernetes.io/projected/7073d92b-77ab-46c2-98bd-ac827126c826-kube-api-access-kvjt6\") pod \"node-ca-ww47d\" (UID: \"7073d92b-77ab-46c2-98bd-ac827126c826\") " pod="openshift-image-registry/node-ca-ww47d"
Sep 09 14:10:51.813023 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.812987    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9hc7\" (UniqueName: \"kubernetes.io/projected/15a8db16-3b65-48f6-8939-7317af3c9764-kube-api-access-b9hc7\") pod \"iptables-alerter-fbv7p\" (UID: \"15a8db16-3b65-48f6-8939-7317af3c9764\") " pod="openshift-network-operator/iptables-alerter-fbv7p"
Sep 09 14:10:51.813254 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.813233    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2l96\" (UniqueName: \"kubernetes.io/projected/24c63b1d-604c-4cda-843e-34aab2a36e9d-kube-api-access-j2l96\") pod \"aws-ebs-csi-driver-node-pz8sq\" (UID: \"24c63b1d-604c-4cda-843e-34aab2a36e9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.813484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.813464    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqtkt\" (UniqueName: \"kubernetes.io/projected/feee570d-dcbc-4f6f-93eb-4ce439013d04-kube-api-access-jqtkt\") pod \"tuned-74qrd\" (UID: \"feee570d-dcbc-4f6f-93eb-4ce439013d04\") " pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.813919 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.813897    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7x7s\" (UniqueName: \"kubernetes.io/projected/0256961f-5a7f-4e42-b718-e430e65924fd-kube-api-access-k7x7s\") pod \"node-resolver-ldbss\" (UID: \"0256961f-5a7f-4e42-b718-e430e65924fd\") " pod="openshift-dns/node-resolver-ldbss"
Sep 09 14:10:51.814087 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.814071    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86s8r\" (UniqueName: \"kubernetes.io/projected/464b2caf-067c-434c-ac2d-6b73c3855127-kube-api-access-86s8r\") pod \"network-metrics-daemon-hgx77\" (UID: \"464b2caf-067c-434c-ac2d-6b73c3855127\") " pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:10:51.885743 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.885679    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:10:51.896778 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.896759    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wxsqq"
Sep 09 14:10:51.907470 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.907451    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lp4m6"
Sep 09 14:10:51.915960 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.915944    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lzzk8"
Sep 09 14:10:51.923532 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.923511    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-74qrd"
Sep 09 14:10:51.931162 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.931145    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq"
Sep 09 14:10:51.938704 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.938682    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ww47d"
Sep 09 14:10:51.946351 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.946335    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ldbss"
Sep 09 14:10:51.953909 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:51.953893    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fbv7p"
Sep 09 14:10:52.204972 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:52.204883    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret\") pod \"global-pull-secret-syncer-22vlz\" (UID: \"07b89a46-bf5c-4842-976f-ff7830f1c2ae\") " pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:52.205120 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:52.205012    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:52.205120 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:52.205076    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret podName:07b89a46-bf5c-4842-976f-ff7830f1c2ae nodeName:}" failed. No retries permitted until 2026-09-09 14:10:53.205058902 +0000 UTC m=+4.009041887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret") pod "global-pull-secret-syncer-22vlz" (UID: "07b89a46-bf5c-4842-976f-ff7830f1c2ae") : object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:52.305853 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:52.305822    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs\") pod \"network-metrics-daemon-hgx77\" (UID: \"464b2caf-067c-434c-ac2d-6b73c3855127\") " pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:10:52.306027 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:52.305989    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:52.306090 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:52.306057    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs podName:464b2caf-067c-434c-ac2d-6b73c3855127 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:53.306042316 +0000 UTC m=+4.110025296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs") pod "network-metrics-daemon-hgx77" (UID: "464b2caf-067c-434c-ac2d-6b73c3855127") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:52.406902 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:52.406870    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5lmd\" (UniqueName: \"kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd\") pod \"network-check-target-bnc5m\" (UID: \"6869fb67-38e1-4f8c-851b-71063a6c4942\") " pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:10:52.407050 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:52.407031    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 14:10:52.407100 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:52.407060    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 14:10:52.407100 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:52.407074    2553 projected.go:196] Error preparing data for projected volume kube-api-access-z5lmd for pod openshift-network-diagnostics/network-check-target-bnc5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:52.407167 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:52.407123    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd podName:6869fb67-38e1-4f8c-851b-71063a6c4942 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:53.40710978 +0000 UTC m=+4.211092775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5lmd" (UniqueName: "kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd") pod "network-check-target-bnc5m" (UID: "6869fb67-38e1-4f8c-851b-71063a6c4942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:52.620393 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:52.620301    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 14:05:51 +0000 UTC" deadline="2028-04-17 02:23:23.807843248 +0000 UTC"
Sep 09 14:10:52.620393 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:52.620346    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14052h12m31.187502258s"
Sep 09 14:10:52.668380 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:52.668202    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9455b7b_bf7b_4b9b_bb97_0e744b913a6e.slice/crio-002bb92ebadfc257843abef9ea40544310b72c718def91670edd5a175ddcbc38 WatchSource:0}: Error finding container 002bb92ebadfc257843abef9ea40544310b72c718def91670edd5a175ddcbc38: Status 404 returned error can't find the container with id 002bb92ebadfc257843abef9ea40544310b72c718def91670edd5a175ddcbc38
Sep 09 14:10:52.669316 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:52.669220    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c9ef420_d914_4112_bd40_416873951a81.slice/crio-313dead8dbae4f7f98b1553c595a9cf78b6693e7ad3eea8f70584d5e62d0eaa3 WatchSource:0}: Error finding container 313dead8dbae4f7f98b1553c595a9cf78b6693e7ad3eea8f70584d5e62d0eaa3: Status 404 returned error can't find the container with id 313dead8dbae4f7f98b1553c595a9cf78b6693e7ad3eea8f70584d5e62d0eaa3
Sep 09 14:10:52.672998 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:52.672974    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86fae8d0_b7af_4df3_98d0_ebb2719ecdbd.slice/crio-ba3bae05e47d4a8ab5f5bc94ab4dfe4deaeff036e3d260c3e382ea0b4f00df1d WatchSource:0}: Error finding container ba3bae05e47d4a8ab5f5bc94ab4dfe4deaeff036e3d260c3e382ea0b4f00df1d: Status 404 returned error can't find the container with id ba3bae05e47d4a8ab5f5bc94ab4dfe4deaeff036e3d260c3e382ea0b4f00df1d
Sep 09 14:10:52.673542 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:52.673489    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0256961f_5a7f_4e42_b718_e430e65924fd.slice/crio-81177bc3a559b7c0ea077b74b4595b8ec8c5516fe58a93fa3b08481357ea146d WatchSource:0}: Error finding container 81177bc3a559b7c0ea077b74b4595b8ec8c5516fe58a93fa3b08481357ea146d: Status 404 returned error can't find the container with id 81177bc3a559b7c0ea077b74b4595b8ec8c5516fe58a93fa3b08481357ea146d
Sep 09 14:10:52.694737 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:52.694715    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f28d3ef_366f_4ea4_9f4d_faf5cb7b22a7.slice/crio-59180f0ee98b527da75b32fa9b3c3a7c99e0018101d5680169bb9c41cfb64230 WatchSource:0}: Error finding container 59180f0ee98b527da75b32fa9b3c3a7c99e0018101d5680169bb9c41cfb64230: Status 404 returned error can't find the container with id 59180f0ee98b527da75b32fa9b3c3a7c99e0018101d5680169bb9c41cfb64230
Sep 09 14:10:52.695482 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:52.695446    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24c63b1d_604c_4cda_843e_34aab2a36e9d.slice/crio-df553b1ddf19ff5171461d9fa68f2b452061509db607dc09cc57b0f79cddc530 WatchSource:0}: Error finding container df553b1ddf19ff5171461d9fa68f2b452061509db607dc09cc57b0f79cddc530: Status 404 returned error can't find the container with id df553b1ddf19ff5171461d9fa68f2b452061509db607dc09cc57b0f79cddc530
Sep 09 14:10:52.696264 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:52.696106    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7073d92b_77ab_46c2_98bd_ac827126c826.slice/crio-db6aa5010766a6de8c09c11e0a47899f6cb5590c8ee38cb815b838c64fa9fad1 WatchSource:0}: Error finding container db6aa5010766a6de8c09c11e0a47899f6cb5590c8ee38cb815b838c64fa9fad1: Status 404 returned error can't find the container with id db6aa5010766a6de8c09c11e0a47899f6cb5590c8ee38cb815b838c64fa9fad1
Sep 09 14:10:52.696972 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:52.696861    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeee570d_dcbc_4f6f_93eb_4ce439013d04.slice/crio-78d0d003a6588ac7cff77607b4ae3743861456b0374333fb2b1aca23265a4d7f WatchSource:0}: Error finding container 78d0d003a6588ac7cff77607b4ae3743861456b0374333fb2b1aca23265a4d7f: Status 404 returned error can't find the container with id 78d0d003a6588ac7cff77607b4ae3743861456b0374333fb2b1aca23265a4d7f
Sep 09 14:10:52.698314 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:10:52.698258    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a8db16_3b65_48f6_8939_7317af3c9764.slice/crio-ce5d070ae9d971cfcd46ef8e062f727ba1145815e6a2653016e8fd3dbb5072c9 WatchSource:0}: Error finding container ce5d070ae9d971cfcd46ef8e062f727ba1145815e6a2653016e8fd3dbb5072c9: Status 404 returned error can't find the container with id ce5d070ae9d971cfcd46ef8e062f727ba1145815e6a2653016e8fd3dbb5072c9
Sep 09 14:10:53.212645 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.212573    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret\") pod \"global-pull-secret-syncer-22vlz\" (UID: \"07b89a46-bf5c-4842-976f-ff7830f1c2ae\") " pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:53.212804 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:53.212695    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:53.212804 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:53.212770    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret podName:07b89a46-bf5c-4842-976f-ff7830f1c2ae nodeName:}" failed. No retries permitted until 2026-09-09 14:10:55.212753964 +0000 UTC m=+6.016736953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret") pod "global-pull-secret-syncer-22vlz" (UID: "07b89a46-bf5c-4842-976f-ff7830f1c2ae") : object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:53.313590 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.313076    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs\") pod \"network-metrics-daemon-hgx77\" (UID: \"464b2caf-067c-434c-ac2d-6b73c3855127\") " pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:10:53.313590 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:53.313193    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:53.313590 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:53.313258    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs podName:464b2caf-067c-434c-ac2d-6b73c3855127 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:55.313240623 +0000 UTC m=+6.117223610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs") pod "network-metrics-daemon-hgx77" (UID: "464b2caf-067c-434c-ac2d-6b73c3855127") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:53.414039 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.413969    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5lmd\" (UniqueName: \"kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd\") pod \"network-check-target-bnc5m\" (UID: \"6869fb67-38e1-4f8c-851b-71063a6c4942\") " pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:10:53.414215 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:53.414147    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 14:10:53.414215 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:53.414171    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 14:10:53.414215 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:53.414185    2553 projected.go:196] Error preparing data for projected volume kube-api-access-z5lmd for pod openshift-network-diagnostics/network-check-target-bnc5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:53.414367 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:53.414276    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd podName:6869fb67-38e1-4f8c-851b-71063a6c4942 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:55.414257391 +0000 UTC m=+6.218240375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5lmd" (UniqueName: "kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd") pod "network-check-target-bnc5m" (UID: "6869fb67-38e1-4f8c-851b-71063a6c4942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:53.621478 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.621349    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 14:05:51 +0000 UTC" deadline="2028-05-15 17:53:36.627433179 +0000 UTC"
Sep 09 14:10:53.621478 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.621433    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14739h42m43.006005203s"
Sep 09 14:10:53.649950 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.649923    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:10:53.650098 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:53.650052    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:10:53.650475 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.650455    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:10:53.650585 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:53.650547    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:10:53.650651 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.650619    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:53.650703 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:53.650687    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:10:53.666240 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.666212    2553 generic.go:356] "Generic (PLEG): container finished" podID="a90c67abb42ed00b6d40f8d2b6ad9bee" containerID="baa5c7420bfe1e151b566ee30a94d58cc604da55190cfeec12b27b5da431c6ee" exitCode=0
Sep 09 14:10:53.666465 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.666433    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal" event={"ID":"a90c67abb42ed00b6d40f8d2b6ad9bee","Type":"ContainerDied","Data":"baa5c7420bfe1e151b566ee30a94d58cc604da55190cfeec12b27b5da431c6ee"}
Sep 09 14:10:53.670698 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.670425    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fbv7p" event={"ID":"15a8db16-3b65-48f6-8939-7317af3c9764","Type":"ContainerStarted","Data":"ce5d070ae9d971cfcd46ef8e062f727ba1145815e6a2653016e8fd3dbb5072c9"}
Sep 09 14:10:53.678696 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.678669    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ldbss" event={"ID":"0256961f-5a7f-4e42-b718-e430e65924fd","Type":"ContainerStarted","Data":"81177bc3a559b7c0ea077b74b4595b8ec8c5516fe58a93fa3b08481357ea146d"}
Sep 09 14:10:53.695705 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.695679    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wxsqq" event={"ID":"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd","Type":"ContainerStarted","Data":"ba3bae05e47d4a8ab5f5bc94ab4dfe4deaeff036e3d260c3e382ea0b4f00df1d"}
Sep 09 14:10:53.700099 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.700038    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lzzk8" event={"ID":"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e","Type":"ContainerStarted","Data":"002bb92ebadfc257843abef9ea40544310b72c718def91670edd5a175ddcbc38"}
Sep 09 14:10:53.712713 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.712654    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-74qrd" event={"ID":"feee570d-dcbc-4f6f-93eb-4ce439013d04","Type":"ContainerStarted","Data":"78d0d003a6588ac7cff77607b4ae3743861456b0374333fb2b1aca23265a4d7f"}
Sep 09 14:10:53.716207 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.716152    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ww47d" event={"ID":"7073d92b-77ab-46c2-98bd-ac827126c826","Type":"ContainerStarted","Data":"db6aa5010766a6de8c09c11e0a47899f6cb5590c8ee38cb815b838c64fa9fad1"}
Sep 09 14:10:53.726536 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.726512    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq" event={"ID":"24c63b1d-604c-4cda-843e-34aab2a36e9d","Type":"ContainerStarted","Data":"df553b1ddf19ff5171461d9fa68f2b452061509db607dc09cc57b0f79cddc530"}
Sep 09 14:10:53.732478 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.732456    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lp4m6" event={"ID":"4f28d3ef-366f-4ea4-9f4d-faf5cb7b22a7","Type":"ContainerStarted","Data":"59180f0ee98b527da75b32fa9b3c3a7c99e0018101d5680169bb9c41cfb64230"}
Sep 09 14:10:53.738250 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.738222    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp" event={"ID":"7c9ef420-d914-4112-bd40-416873951a81","Type":"ContainerStarted","Data":"313dead8dbae4f7f98b1553c595a9cf78b6693e7ad3eea8f70584d5e62d0eaa3"}
Sep 09 14:10:53.749443 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:53.749410    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-209.ec2.internal" event={"ID":"41fcb2aaf86bde291d1277e410f2d123","Type":"ContainerStarted","Data":"133a1db28be833f266da2ec2b19a6a512433b5746b83a946511dcd781dcde7f3"}
Sep 09 14:10:54.776668 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:54.776628    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal" event={"ID":"a90c67abb42ed00b6d40f8d2b6ad9bee","Type":"ContainerStarted","Data":"3496b73ddab4e97d3d280d24a12bd2a00fe8c084aa034776773b5e2c924679c4"}
Sep 09 14:10:54.793456 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:54.793400    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-209.ec2.internal" podStartSLOduration=4.793380553 podStartE2EDuration="4.793380553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:10:54.793057357 +0000 UTC m=+5.597040363" watchObservedRunningTime="2026-09-09 14:10:54.793380553 +0000 UTC m=+5.597363558"
Sep 09 14:10:54.793844 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:54.793809    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-209.ec2.internal" podStartSLOduration=4.793780338 podStartE2EDuration="4.793780338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:10:53.765120314 +0000 UTC m=+4.569103318" watchObservedRunningTime="2026-09-09 14:10:54.793780338 +0000 UTC m=+5.597763343"
Sep 09 14:10:55.231312 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:55.231278    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret\") pod \"global-pull-secret-syncer-22vlz\" (UID: \"07b89a46-bf5c-4842-976f-ff7830f1c2ae\") " pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:55.231536 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:55.231427    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:55.231536 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:55.231488    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret podName:07b89a46-bf5c-4842-976f-ff7830f1c2ae nodeName:}" failed. No retries permitted until 2026-09-09 14:10:59.231469427 +0000 UTC m=+10.035452415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret") pod "global-pull-secret-syncer-22vlz" (UID: "07b89a46-bf5c-4842-976f-ff7830f1c2ae") : object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:55.331854 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:55.331808    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs\") pod \"network-metrics-daemon-hgx77\" (UID: \"464b2caf-067c-434c-ac2d-6b73c3855127\") " pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:10:55.332049 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:55.331945    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:55.332049 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:55.332003    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs podName:464b2caf-067c-434c-ac2d-6b73c3855127 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:59.331986079 +0000 UTC m=+10.135969065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs") pod "network-metrics-daemon-hgx77" (UID: "464b2caf-067c-434c-ac2d-6b73c3855127") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:55.432682 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:55.432649    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5lmd\" (UniqueName: \"kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd\") pod \"network-check-target-bnc5m\" (UID: \"6869fb67-38e1-4f8c-851b-71063a6c4942\") " pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:10:55.432855 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:55.432802    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 14:10:55.432855 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:55.432824    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 14:10:55.432855 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:55.432835    2553 projected.go:196] Error preparing data for projected volume kube-api-access-z5lmd for pod openshift-network-diagnostics/network-check-target-bnc5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:55.433042 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:55.432887    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd podName:6869fb67-38e1-4f8c-851b-71063a6c4942 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:59.432869761 +0000 UTC m=+10.236852759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5lmd" (UniqueName: "kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd") pod "network-check-target-bnc5m" (UID: "6869fb67-38e1-4f8c-851b-71063a6c4942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:55.642302 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:55.642238    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:10:55.642457 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:55.642375    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:10:55.642457 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:55.642429    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:10:55.642603 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:55.642499    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:10:55.642603 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:55.642541    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:55.645299 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:55.645273    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:10:57.640719 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:57.640019    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:10:57.640719 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:57.640160    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:10:57.640719 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:57.640034    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:10:57.640719 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:57.640268    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:10:57.640719 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:57.640023    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:57.640719 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:57.640347    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:10:59.265469 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:59.265430    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret\") pod \"global-pull-secret-syncer-22vlz\" (UID: \"07b89a46-bf5c-4842-976f-ff7830f1c2ae\") " pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:59.265985 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:59.265554    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:59.265985 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:59.265618    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret podName:07b89a46-bf5c-4842-976f-ff7830f1c2ae nodeName:}" failed. No retries permitted until 2026-09-09 14:11:07.265606458 +0000 UTC m=+18.069589439 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret") pod "global-pull-secret-syncer-22vlz" (UID: "07b89a46-bf5c-4842-976f-ff7830f1c2ae") : object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:59.366205 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:59.366172    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs\") pod \"network-metrics-daemon-hgx77\" (UID: \"464b2caf-067c-434c-ac2d-6b73c3855127\") " pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:10:59.366370 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:59.366330    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:59.366426 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:59.366401    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs podName:464b2caf-067c-434c-ac2d-6b73c3855127 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:07.366380611 +0000 UTC m=+18.170363648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs") pod "network-metrics-daemon-hgx77" (UID: "464b2caf-067c-434c-ac2d-6b73c3855127") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:59.467360 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:59.467328    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5lmd\" (UniqueName: \"kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd\") pod \"network-check-target-bnc5m\" (UID: \"6869fb67-38e1-4f8c-851b-71063a6c4942\") " pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:10:59.467537 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:59.467516    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 14:10:59.467666 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:59.467547    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 14:10:59.467666 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:59.467559    2553 projected.go:196] Error preparing data for projected volume kube-api-access-z5lmd for pod openshift-network-diagnostics/network-check-target-bnc5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:59.467666 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:59.467631    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd podName:6869fb67-38e1-4f8c-851b-71063a6c4942 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:07.467612755 +0000 UTC m=+18.271595756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5lmd" (UniqueName: "kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd") pod "network-check-target-bnc5m" (UID: "6869fb67-38e1-4f8c-851b-71063a6c4942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:59.640444 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:59.639937    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:10:59.640444 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:59.639959    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:10:59.640444 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:59.640055    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:10:59.640444 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:10:59.640269    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:10:59.641459 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:59.641420    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:10:59.641585 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:10:59.641520    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:11:01.640919 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:01.640732    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:01.640919 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:01.640772    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:01.640919 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:01.640729    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:01.640919 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:01.640852    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:11:01.640919 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:01.640890    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:11:01.641771 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:01.640949    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:11:03.641122 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:03.640895    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:03.641596 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:03.640910    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:03.641596 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:03.641216    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:11:03.641596 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:03.640990    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:03.641596 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:03.641314    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:11:03.641596 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:03.641399    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:11:05.640524 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:05.640421    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:05.640524 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:05.640457    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:05.640524 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:05.640425    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:05.641108 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:05.640577    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:11:05.641108 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:05.640655    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:11:05.641108 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:05.640716    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:11:07.327783 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:07.327751    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret\") pod \"global-pull-secret-syncer-22vlz\" (UID: \"07b89a46-bf5c-4842-976f-ff7830f1c2ae\") " pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:07.328295 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:07.327915    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 14:11:07.328295 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:07.327983    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret podName:07b89a46-bf5c-4842-976f-ff7830f1c2ae nodeName:}" failed. No retries permitted until 2026-09-09 14:11:23.327964023 +0000 UTC m=+34.131947022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret") pod "global-pull-secret-syncer-22vlz" (UID: "07b89a46-bf5c-4842-976f-ff7830f1c2ae") : object "kube-system"/"original-pull-secret" not registered
Sep 09 14:11:07.428730 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:07.428695    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs\") pod \"network-metrics-daemon-hgx77\" (UID: \"464b2caf-067c-434c-ac2d-6b73c3855127\") " pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:07.428893 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:07.428873    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:11:07.428974 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:07.428954    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs podName:464b2caf-067c-434c-ac2d-6b73c3855127 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:23.428933268 +0000 UTC m=+34.232916266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs") pod "network-metrics-daemon-hgx77" (UID: "464b2caf-067c-434c-ac2d-6b73c3855127") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:11:07.529340 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:07.529305    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5lmd\" (UniqueName: \"kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd\") pod \"network-check-target-bnc5m\" (UID: \"6869fb67-38e1-4f8c-851b-71063a6c4942\") " pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:07.529525 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:07.529466    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 14:11:07.529525 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:07.529486    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 14:11:07.529525 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:07.529498    2553 projected.go:196] Error preparing data for projected volume kube-api-access-z5lmd for pod openshift-network-diagnostics/network-check-target-bnc5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:11:07.529706 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:07.529558    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd podName:6869fb67-38e1-4f8c-851b-71063a6c4942 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:23.529540188 +0000 UTC m=+34.333523170 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5lmd" (UniqueName: "kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd") pod "network-check-target-bnc5m" (UID: "6869fb67-38e1-4f8c-851b-71063a6c4942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:11:07.640345 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:07.640256    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:07.640491 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:07.640256    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:07.640491 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:07.640383    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:11:07.640491 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:07.640399    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:07.640491 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:07.640463    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:11:07.640723 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:07.640536    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:11:09.640594 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:09.640553    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:09.641006 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:09.640664    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:11:09.641006 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:09.640731    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:09.641006 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:09.640815    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:11:09.641006 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:09.640831    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:09.641006 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:09.640941    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:11:10.810233 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:10.810205    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ldbss" event={"ID":"0256961f-5a7f-4e42-b718-e430e65924fd","Type":"ContainerStarted","Data":"7057eda7f40cdf93c71554e67f8709434f4bc12ba218ba9cee7a2193ce3e29e9"}
Sep 09 14:11:10.812087 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:10.812059    2553 generic.go:356] "Generic (PLEG): container finished" podID="86fae8d0-b7af-4df3-98d0-ebb2719ecdbd" containerID="876b24646cf3d2bc0b045c4fc49d40c8ca7b9054dd22662f342ca8c9696bfabd" exitCode=0
Sep 09 14:11:10.812262 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:10.812151    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wxsqq" event={"ID":"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd","Type":"ContainerDied","Data":"876b24646cf3d2bc0b045c4fc49d40c8ca7b9054dd22662f342ca8c9696bfabd"}
Sep 09 14:11:10.813927 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:10.813905    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lzzk8" event={"ID":"b9455b7b-bf7b-4b9b-bb97-0e744b913a6e","Type":"ContainerStarted","Data":"583d158215b803864d5b301651870ee77f90594faf84d092ed92217336915133"}
Sep 09 14:11:10.815741 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:10.815708    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-74qrd" event={"ID":"feee570d-dcbc-4f6f-93eb-4ce439013d04","Type":"ContainerStarted","Data":"fd2d7dd85a30c19132b5fc5e04e8e1e778d10127480a3a68600257211c21e3fc"}
Sep 09 14:11:10.817371 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:10.817344    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ww47d" event={"ID":"7073d92b-77ab-46c2-98bd-ac827126c826","Type":"ContainerStarted","Data":"edbaf30f13f4e5c4a7dc0a0b42cfcdb00ee5362433d872d10d8da7fe5c4b2fa0"}
Sep 09 14:11:10.819030 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:10.818991    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq" event={"ID":"24c63b1d-604c-4cda-843e-34aab2a36e9d","Type":"ContainerStarted","Data":"f21bbb89688c5bf28a8dfc45756dccffd210e339214f2dabdefbd7caf736c119"}
Sep 09 14:11:10.820784 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:10.820745    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lp4m6" event={"ID":"4f28d3ef-366f-4ea4-9f4d-faf5cb7b22a7","Type":"ContainerStarted","Data":"e93e42e2dd4ddb224d360ea4b0221ab7edaaeb87a8f46cd378d82a49342e8c73"}
Sep 09 14:11:10.823119 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:10.823092    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp" event={"ID":"7c9ef420-d914-4112-bd40-416873951a81","Type":"ContainerStarted","Data":"d78924141f5557d593a090efcc66e8a7d013906888b4dffaa08b437fe5acb35c"}
Sep 09 14:11:10.823199 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:10.823170    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp" event={"ID":"7c9ef420-d914-4112-bd40-416873951a81","Type":"ContainerStarted","Data":"053bf8582f1a74d20a55c86c79f3f28e414f132a811f15a9eb672fb4af9a1e6b"}
Sep 09 14:11:10.823247 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:10.823220    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp" event={"ID":"7c9ef420-d914-4112-bd40-416873951a81","Type":"ContainerStarted","Data":"49bb231d36605535b46ac4e9275591e2ee60579e0a4dd64859287419c3f4c6fb"}
Sep 09 14:11:10.827052 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:10.827018    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ldbss" podStartSLOduration=4.057205406 podStartE2EDuration="21.827006915s" totalImagesPullingTime="17.769801509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:10.826696474 +0000 UTC m=+21.630679488" watchObservedRunningTime="2026-09-09 14:11:10.827006915 +0000 UTC m=+21.630989918"
Sep 09 14:11:10.871277 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:10.871234    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lzzk8" podStartSLOduration=4.040571968 podStartE2EDuration="21.871220315s" totalImagesPullingTime="17.830648347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:10.870774439 +0000 UTC m=+21.674757439" watchObservedRunningTime="2026-09-09 14:11:10.871220315 +0000 UTC m=+21.675203317"
Sep 09 14:11:10.889159 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:10.889120    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-74qrd" podStartSLOduration=4.12726941 podStartE2EDuration="21.889106614s" totalImagesPullingTime="17.761837204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:10.888725842 +0000 UTC m=+21.692708846" watchObservedRunningTime="2026-09-09 14:11:10.889106614 +0000 UTC m=+21.693089616"
Sep 09 14:11:10.919162 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:10.919126    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lp4m6" podStartSLOduration=4.216674661 podStartE2EDuration="21.919113011s" totalImagesPullingTime="17.70243835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:10.902760042 +0000 UTC m=+21.706743044" watchObservedRunningTime="2026-09-09 14:11:10.919113011 +0000 UTC m=+21.723096013"
Sep 09 14:11:10.919260 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:10.919243    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ww47d" podStartSLOduration=4.159577318 podStartE2EDuration="21.919236833s" totalImagesPullingTime="17.759659515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:10.918823404 +0000 UTC m=+21.722806408" watchObservedRunningTime="2026-09-09 14:11:10.919236833 +0000 UTC m=+21.723219838"
Sep 09 14:11:11.641067 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:11.641038    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:11.641067 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:11.641057    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:11.641319 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:11.641155    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:11:11.641495 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:11.641479    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:11.641620 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:11.641599    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:11:11.641716 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:11.641698    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:11:11.829060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:11.829026    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp" event={"ID":"7c9ef420-d914-4112-bd40-416873951a81","Type":"ContainerStarted","Data":"b2fd6f386d23921c7fdc707526381c124116321652139fbc90fd385c235a5f8a"}
Sep 09 14:11:11.829544 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:11.829113    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp" event={"ID":"7c9ef420-d914-4112-bd40-416873951a81","Type":"ContainerStarted","Data":"c88257c38722efa6a2de7211f4f06a79a5e18f1b683902119233fc6cbcced2f1"}
Sep 09 14:11:11.829544 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:11.829165    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp" event={"ID":"7c9ef420-d914-4112-bd40-416873951a81","Type":"ContainerStarted","Data":"bf1c35650fc0c1ca129f00826860c685e417e182ef26549b431259771901b1ee"}
Sep 09 14:11:12.454717 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:12.454506    2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 14:11:12.566913 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:12.566842    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lp4m6"
Sep 09 14:11:12.567517 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:12.567490    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lp4m6"
Sep 09 14:11:12.640610 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:12.640516    2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T14:11:12.454714753Z","UUID":"fe0a0cc7-66ce-4199-a7a4-aa978139109f","Handler":null,"Name":"","Endpoint":""}
Sep 09 14:11:12.641830 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:12.641815    2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 14:11:12.641908 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:12.641843    2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 14:11:12.833733 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:12.833648    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq" event={"ID":"24c63b1d-604c-4cda-843e-34aab2a36e9d","Type":"ContainerStarted","Data":"02710ab0a5d8e1009d9d75c41f4c22778b10068a23d46dce69396121c1c44c4f"}
Sep 09 14:11:12.835265 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:12.835237    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fbv7p" event={"ID":"15a8db16-3b65-48f6-8939-7317af3c9764","Type":"ContainerStarted","Data":"bde0c1c05994ba7660e939eb778f3ba4f11462bf6633e87da944b76ece31e4ae"}
Sep 09 14:11:12.851762 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:12.851723    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fbv7p" podStartSLOduration=6.090269812 podStartE2EDuration="23.851708417s" totalImagesPullingTime="17.761438605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:12.851551711 +0000 UTC m=+23.655534721" watchObservedRunningTime="2026-09-09 14:11:12.851708417 +0000 UTC m=+23.655691425"
Sep 09 14:11:13.641048 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:13.641014    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:13.641048 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:13.641039    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:13.641281 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:13.641127    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:13.641281 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:13.641139    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:11:13.641281 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:13.641210    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:11:13.641281 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:13.641269    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:11:13.841230 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:13.841181    2553 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 14:11:13.841230 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:13.841187    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp" event={"ID":"7c9ef420-d914-4112-bd40-416873951a81","Type":"ContainerStarted","Data":"9918a278bbef15eac09dbca4b909204e29ab1ba6fd3ea66dd535adc28a9d434c"}
Sep 09 14:11:15.641289 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:15.640480    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:15.641289 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:15.640480    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:15.641289 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:15.640871    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:11:15.641289 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:15.640928    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:11:15.641289 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:15.640497    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:15.641289 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:15.641047    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:11:15.847641 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:15.847524    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq" event={"ID":"24c63b1d-604c-4cda-843e-34aab2a36e9d","Type":"ContainerStarted","Data":"adb1f8fdcb5df9f9cbfe00d525a72323556341fe32624569a966d3b44afc90e5"}
Sep 09 14:11:15.851297 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:15.851266    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp" event={"ID":"7c9ef420-d914-4112-bd40-416873951a81","Type":"ContainerStarted","Data":"0edb368f46e19a8f86a3dd3872ae18ec1b883399c1af2911ef76d1321fb3d3c9"}
Sep 09 14:11:15.851834 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:15.851807    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:11:15.855866 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:15.855846    2553 generic.go:356] "Generic (PLEG): container finished" podID="86fae8d0-b7af-4df3-98d0-ebb2719ecdbd" containerID="d5fde98fb582b702cbe6307170cc260c10d35ce46163ae7c053e2f9db6125439" exitCode=0
Sep 09 14:11:15.855947 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:15.855875    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wxsqq" event={"ID":"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd","Type":"ContainerDied","Data":"d5fde98fb582b702cbe6307170cc260c10d35ce46163ae7c053e2f9db6125439"}
Sep 09 14:11:15.868838 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:15.868816    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:11:15.869892 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:15.869860    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pz8sq" podStartSLOduration=4.47473523 podStartE2EDuration="26.86984909s" totalImagesPullingTime="22.39511386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:15.869633078 +0000 UTC m=+26.673616081" watchObservedRunningTime="2026-09-09 14:11:15.86984909 +0000 UTC m=+26.673832113"
Sep 09 14:11:15.899468 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:15.899430    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp" podStartSLOduration=9.011856401 podStartE2EDuration="26.899418281s" totalImagesPullingTime="17.88756188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:15.897867471 +0000 UTC m=+26.701850473" watchObservedRunningTime="2026-09-09 14:11:15.899418281 +0000 UTC m=+26.703401284"
Sep 09 14:11:16.859280 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:16.859200    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:11:16.859280 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:16.859259    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:11:16.878007 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:16.877976    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:11:17.459068 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:17.459040    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lp4m6"
Sep 09 14:11:17.459249 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:17.459156    2553 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 14:11:17.459609 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:17.459591    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lp4m6"
Sep 09 14:11:17.640758 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:17.640608    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:17.640955 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:17.640619    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:17.640955 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:17.640825    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:11:17.640955 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:17.640671    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:17.641136 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:17.640904    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:11:17.641136 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:17.640980    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:11:17.753211 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:17.753105    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bnc5m"]
Sep 09 14:11:17.756101 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:17.756072    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-22vlz"]
Sep 09 14:11:17.756658 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:17.756627    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hgx77"]
Sep 09 14:11:17.862987 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:17.862956    2553 generic.go:356] "Generic (PLEG): container finished" podID="86fae8d0-b7af-4df3-98d0-ebb2719ecdbd" containerID="a402e5af74a720099dadcb353ff3c4618cf0083361a91b95c5d13511179498eb" exitCode=0
Sep 09 14:11:17.863486 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:17.863067    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wxsqq" event={"ID":"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd","Type":"ContainerDied","Data":"a402e5af74a720099dadcb353ff3c4618cf0083361a91b95c5d13511179498eb"}
Sep 09 14:11:17.863486 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:17.863111    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:17.863486 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:17.863115    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:17.863486 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:17.863146    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:17.863486 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:17.863238    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:11:17.863486 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:17.863318    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:11:17.863771 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:17.863647    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:11:19.642897 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:19.642867    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:19.643284 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:19.642958    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:19.643284 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:19.642961    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:11:19.643284 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:19.643006    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:19.643284 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:19.643092    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:11:19.643284 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:19.643180    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:11:19.870795 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:19.870762    2553 generic.go:356] "Generic (PLEG): container finished" podID="86fae8d0-b7af-4df3-98d0-ebb2719ecdbd" containerID="ef129acc958f3da02a2c631b86ff732cb1e647968a76fbf1df4a2c5e54be3636" exitCode=0
Sep 09 14:11:19.870948 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:19.870808    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wxsqq" event={"ID":"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd","Type":"ContainerDied","Data":"ef129acc958f3da02a2c631b86ff732cb1e647968a76fbf1df4a2c5e54be3636"}
Sep 09 14:11:21.640191 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:21.640162    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:21.640191 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:21.640200    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:21.640715 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:21.640293    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hgx77" podUID="464b2caf-067c-434c-ac2d-6b73c3855127"
Sep 09 14:11:21.640715 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:21.640349    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnc5m" podUID="6869fb67-38e1-4f8c-851b-71063a6c4942"
Sep 09 14:11:21.640715 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:21.640387    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:21.640715 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:21.640485    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22vlz" podUID="07b89a46-bf5c-4842-976f-ff7830f1c2ae"
Sep 09 14:11:23.347818 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.347723    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret\") pod \"global-pull-secret-syncer-22vlz\" (UID: \"07b89a46-bf5c-4842-976f-ff7830f1c2ae\") " pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:23.348232 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:23.347907    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 14:11:23.348232 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:23.347972    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret podName:07b89a46-bf5c-4842-976f-ff7830f1c2ae nodeName:}" failed. No retries permitted until 2026-09-09 14:11:55.34795627 +0000 UTC m=+66.151939264 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret") pod "global-pull-secret-syncer-22vlz" (UID: "07b89a46-bf5c-4842-976f-ff7830f1c2ae") : object "kube-system"/"original-pull-secret" not registered
Sep 09 14:11:23.448828 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.448790    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs\") pod \"network-metrics-daemon-hgx77\" (UID: \"464b2caf-067c-434c-ac2d-6b73c3855127\") " pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:23.448985 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:23.448909    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:11:23.448985 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:23.448970    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs podName:464b2caf-067c-434c-ac2d-6b73c3855127 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:55.448955653 +0000 UTC m=+66.252938634 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs") pod "network-metrics-daemon-hgx77" (UID: "464b2caf-067c-434c-ac2d-6b73c3855127") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:11:23.497523 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.497492    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-209.ec2.internal" event="NodeReady"
Sep 09 14:11:23.497695 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.497660    2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 14:11:23.535078 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.535049    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"]
Sep 09 14:11:23.538152 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.538130    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.540080 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.540061    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v89ml\""
Sep 09 14:11:23.540396 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.540372    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 14:11:23.540482 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.540421    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 14:11:23.540533 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.540370    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 14:11:23.544161 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.544140    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5n2ks"]
Sep 09 14:11:23.546749 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.545890    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 14:11:23.546749 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.546140    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:23.547530 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.547502    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8frzt"]
Sep 09 14:11:23.548213 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.548193    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tfl8h\""
Sep 09 14:11:23.548849 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.548828    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 14:11:23.549274 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.548828    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 14:11:23.549274 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.549181    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5lmd\" (UniqueName: \"kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd\") pod \"network-check-target-bnc5m\" (UID: \"6869fb67-38e1-4f8c-851b-71063a6c4942\") " pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:23.549376 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:23.549319    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 14:11:23.549376 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:23.549336    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 14:11:23.549376 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:23.549348    2553 projected.go:196] Error preparing data for projected volume kube-api-access-z5lmd for pod openshift-network-diagnostics/network-check-target-bnc5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:11:23.549907 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.549886    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8frzt"
Sep 09 14:11:23.551592 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:23.550107    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd podName:6869fb67-38e1-4f8c-851b-71063a6c4942 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:55.549383094 +0000 UTC m=+66.353366075 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5lmd" (UniqueName: "kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd") pod "network-check-target-bnc5m" (UID: "6869fb67-38e1-4f8c-851b-71063a6c4942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:11:23.553973 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.553947    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"]
Sep 09 14:11:23.554318 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.554239    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 14:11:23.554318 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.554305    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 14:11:23.554318 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.554314    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 14:11:23.554582 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.554443    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hbr5s\""
Sep 09 14:11:23.557509 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.557392    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5n2ks"]
Sep 09 14:11:23.561375 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.561325    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8frzt"]
Sep 09 14:11:23.640627 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.640370    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:23.640627 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.640381    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:23.640891 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.640866    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:23.642738 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.642721    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-72t49\""
Sep 09 14:11:23.643022 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.643007    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 14:11:23.643062 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.643045    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 14:11:23.643123 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.643045    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 14:11:23.643348 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.643229    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 14:11:23.643348 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.643332    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f5zw2\""
Sep 09 14:11:23.649547 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.649527    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2095df4f-d54b-4960-849c-3c43b4413516-registry-certificates\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.649690 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.649603    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:23.649690 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.649638    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2095df4f-d54b-4960-849c-3c43b4413516-image-registry-private-configuration\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.649690 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.649666    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-bound-sa-token\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.649861 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.649690    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-config-volume\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:23.649861 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.649730    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2095df4f-d54b-4960-849c-3c43b4413516-trusted-ca\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.649861 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.649769    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2095df4f-d54b-4960-849c-3c43b4413516-installation-pull-secrets\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.649861 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.649809    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2095df4f-d54b-4960-849c-3c43b4413516-ca-trust-extracted\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.649861 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.649843    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.650050 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.649900    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps54l\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-kube-api-access-ps54l\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.650050 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.649938    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvmvb\" (UniqueName: \"kubernetes.io/projected/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-kube-api-access-pvmvb\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:23.650050 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.649961    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f9fbd6c-2e65-4700-a07c-2bf711bfab95-cert\") pod \"ingress-canary-8frzt\" (UID: \"6f9fbd6c-2e65-4700-a07c-2bf711bfab95\") " pod="openshift-ingress-canary/ingress-canary-8frzt"
Sep 09 14:11:23.650050 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.649988    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-tmp-dir\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:23.650050 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.650003    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc6dc\" (UniqueName: \"kubernetes.io/projected/6f9fbd6c-2e65-4700-a07c-2bf711bfab95-kube-api-access-mc6dc\") pod \"ingress-canary-8frzt\" (UID: \"6f9fbd6c-2e65-4700-a07c-2bf711bfab95\") " pod="openshift-ingress-canary/ingress-canary-8frzt"
Sep 09 14:11:23.739824 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.739771    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-m5l72"]
Sep 09 14:11:23.741604 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.741582    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-m5l72"
Sep 09 14:11:23.744445 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.744423    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cdrvw\""
Sep 09 14:11:23.745011 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.744993    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 09 14:11:23.745118 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.745025    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 09 14:11:23.750830 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.750807    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:23.750912 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.750851    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2095df4f-d54b-4960-849c-3c43b4413516-image-registry-private-configuration\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.750912 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.750879    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-bound-sa-token\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.750912 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:23.750896    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 14:11:23.750912 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.750901    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-config-volume\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:23.751103 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.750939    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2095df4f-d54b-4960-849c-3c43b4413516-trusted-ca\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.751103 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:23.750958    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls podName:66ef8b31-2920-406a-84e8-ae1bb4cafa6b nodeName:}" failed. No retries permitted until 2026-09-09 14:11:24.250940998 +0000 UTC m=+35.054923994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls") pod "dns-default-5n2ks" (UID: "66ef8b31-2920-406a-84e8-ae1bb4cafa6b") : secret "dns-default-metrics-tls" not found
Sep 09 14:11:23.751103 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.750999    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2095df4f-d54b-4960-849c-3c43b4413516-installation-pull-secrets\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.751263 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.751175    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2095df4f-d54b-4960-849c-3c43b4413516-ca-trust-extracted\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.751263 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.751215    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.751263 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.751242    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps54l\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-kube-api-access-ps54l\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.751400 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.751275    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvmvb\" (UniqueName: \"kubernetes.io/projected/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-kube-api-access-pvmvb\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:23.751400 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.751305    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f9fbd6c-2e65-4700-a07c-2bf711bfab95-cert\") pod \"ingress-canary-8frzt\" (UID: \"6f9fbd6c-2e65-4700-a07c-2bf711bfab95\") " pod="openshift-ingress-canary/ingress-canary-8frzt"
Sep 09 14:11:23.751400 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.751333    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-tmp-dir\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:23.751400 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.751353    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc6dc\" (UniqueName: \"kubernetes.io/projected/6f9fbd6c-2e65-4700-a07c-2bf711bfab95-kube-api-access-mc6dc\") pod \"ingress-canary-8frzt\" (UID: \"6f9fbd6c-2e65-4700-a07c-2bf711bfab95\") " pod="openshift-ingress-canary/ingress-canary-8frzt"
Sep 09 14:11:23.751616 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.751398    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2095df4f-d54b-4960-849c-3c43b4413516-registry-certificates\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.751616 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.751495    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-config-volume\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:23.752063 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:23.751839    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 14:11:23.752063 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:23.751858    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz: secret "image-registry-tls" not found
Sep 09 14:11:23.752063 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.751872    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2095df4f-d54b-4960-849c-3c43b4413516-ca-trust-extracted\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.752063 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:23.751901    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls podName:2095df4f-d54b-4960-849c-3c43b4413516 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:24.251885687 +0000 UTC m=+35.055868668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls") pod "image-registry-7f4bbd9dd6-lhgzz" (UID: "2095df4f-d54b-4960-849c-3c43b4413516") : secret "image-registry-tls" not found
Sep 09 14:11:23.752063 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.751964    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2095df4f-d54b-4960-849c-3c43b4413516-registry-certificates\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.752356 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.752098    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2095df4f-d54b-4960-849c-3c43b4413516-trusted-ca\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.752407 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.752361    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-tmp-dir\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:23.755890 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.755865    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2095df4f-d54b-4960-849c-3c43b4413516-installation-pull-secrets\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.755986 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.755890    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2095df4f-d54b-4960-849c-3c43b4413516-image-registry-private-configuration\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.756087 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.756065    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f9fbd6c-2e65-4700-a07c-2bf711bfab95-cert\") pod \"ingress-canary-8frzt\" (UID: \"6f9fbd6c-2e65-4700-a07c-2bf711bfab95\") " pod="openshift-ingress-canary/ingress-canary-8frzt"
Sep 09 14:11:23.756623 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.756583    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-m5l72"]
Sep 09 14:11:23.776634 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.776609    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvmvb\" (UniqueName: \"kubernetes.io/projected/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-kube-api-access-pvmvb\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:23.778236 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.778211    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-bound-sa-token\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.778526 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.778503    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc6dc\" (UniqueName: \"kubernetes.io/projected/6f9fbd6c-2e65-4700-a07c-2bf711bfab95-kube-api-access-mc6dc\") pod \"ingress-canary-8frzt\" (UID: \"6f9fbd6c-2e65-4700-a07c-2bf711bfab95\") " pod="openshift-ingress-canary/ingress-canary-8frzt"
Sep 09 14:11:23.778640 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.778624    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps54l\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-kube-api-access-ps54l\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:23.852779 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.852750    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-nginx-conf\") pod \"networking-console-plugin-79977f9844-m5l72\" (UID: \"7528c2f1-cc40-4f51-8c38-5b5e26a41df1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m5l72"
Sep 09 14:11:23.852905 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.852839    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m5l72\" (UID: \"7528c2f1-cc40-4f51-8c38-5b5e26a41df1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m5l72"
Sep 09 14:11:23.868206 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.868183    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8frzt"
Sep 09 14:11:23.953594 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.953552    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-nginx-conf\") pod \"networking-console-plugin-79977f9844-m5l72\" (UID: \"7528c2f1-cc40-4f51-8c38-5b5e26a41df1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m5l72"
Sep 09 14:11:23.953747 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.953705    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m5l72\" (UID: \"7528c2f1-cc40-4f51-8c38-5b5e26a41df1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m5l72"
Sep 09 14:11:23.953855 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:23.953840    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 14:11:23.953923 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:23.953904    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert podName:7528c2f1-cc40-4f51-8c38-5b5e26a41df1 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:24.453890946 +0000 UTC m=+35.257873928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-m5l72" (UID: "7528c2f1-cc40-4f51-8c38-5b5e26a41df1") : secret "networking-console-plugin-cert" not found
Sep 09 14:11:23.954277 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:23.954256    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-nginx-conf\") pod \"networking-console-plugin-79977f9844-m5l72\" (UID: \"7528c2f1-cc40-4f51-8c38-5b5e26a41df1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m5l72"
Sep 09 14:11:24.256701 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.256625    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:24.256896 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.256698    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:24.256896 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:24.256791    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 14:11:24.256896 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:24.256812    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz: secret "image-registry-tls" not found
Sep 09 14:11:24.256896 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:24.256823    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 14:11:24.256896 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:24.256877    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls podName:66ef8b31-2920-406a-84e8-ae1bb4cafa6b nodeName:}" failed. No retries permitted until 2026-09-09 14:11:25.256860239 +0000 UTC m=+36.060843240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls") pod "dns-default-5n2ks" (UID: "66ef8b31-2920-406a-84e8-ae1bb4cafa6b") : secret "dns-default-metrics-tls" not found
Sep 09 14:11:24.256896 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:24.256896    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls podName:2095df4f-d54b-4960-849c-3c43b4413516 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:25.256888005 +0000 UTC m=+36.060870999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls") pod "image-registry-7f4bbd9dd6-lhgzz" (UID: "2095df4f-d54b-4960-849c-3c43b4413516") : secret "image-registry-tls" not found
Sep 09 14:11:24.264385 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.264361    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l4clj"]
Sep 09 14:11:24.266753 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.266734    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:24.268992 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.268971    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 14:11:24.269104 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.269003    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rghsj\""
Sep 09 14:11:24.269104 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.269092    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 14:11:24.269433 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.269312    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 14:11:24.270143 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.269941    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 14:11:24.280435 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.280415    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l4clj"]
Sep 09 14:11:24.357839 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.357803    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/19db262e-77ea-42bd-9c60-5589d939149c-data-volume\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:24.358178 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.357865    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/19db262e-77ea-42bd-9c60-5589d939149c-crio-socket\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:24.358178 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.357961    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:24.358178 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.358082    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/19db262e-77ea-42bd-9c60-5589d939149c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:24.358178 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.358112    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klqcn\" (UniqueName: \"kubernetes.io/projected/19db262e-77ea-42bd-9c60-5589d939149c-kube-api-access-klqcn\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:24.458664 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.458637    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:24.458756 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.458692    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m5l72\" (UID: \"7528c2f1-cc40-4f51-8c38-5b5e26a41df1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m5l72"
Sep 09 14:11:24.458756 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.458725    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/19db262e-77ea-42bd-9c60-5589d939149c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:24.458838 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.458755    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klqcn\" (UniqueName: \"kubernetes.io/projected/19db262e-77ea-42bd-9c60-5589d939149c-kube-api-access-klqcn\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:24.458838 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.458800    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/19db262e-77ea-42bd-9c60-5589d939149c-data-volume\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:24.458838 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:24.458804    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:24.458838 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.458835    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/19db262e-77ea-42bd-9c60-5589d939149c-crio-socket\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:24.459016 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:24.458862    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 14:11:24.459016 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:24.458869    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls podName:19db262e-77ea-42bd-9c60-5589d939149c nodeName:}" failed. No retries permitted until 2026-09-09 14:11:24.958848816 +0000 UTC m=+35.762831800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4clj" (UID: "19db262e-77ea-42bd-9c60-5589d939149c") : secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:24.459016 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:24.458932    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert podName:7528c2f1-cc40-4f51-8c38-5b5e26a41df1 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:25.458913038 +0000 UTC m=+36.262896025 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-m5l72" (UID: "7528c2f1-cc40-4f51-8c38-5b5e26a41df1") : secret "networking-console-plugin-cert" not found
Sep 09 14:11:24.459016 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:24.458867    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 14:11:24.459016 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:24.458973    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/19db262e-77ea-42bd-9c60-5589d939149c-kube-rbac-proxy-cm podName:19db262e-77ea-42bd-9c60-5589d939149c nodeName:}" failed. No retries permitted until 2026-09-09 14:11:24.95896407 +0000 UTC m=+35.762947056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/19db262e-77ea-42bd-9c60-5589d939149c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l4clj" (UID: "19db262e-77ea-42bd-9c60-5589d939149c") : configmap "kube-rbac-proxy" not found
Sep 09 14:11:24.459016 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.459005    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/19db262e-77ea-42bd-9c60-5589d939149c-crio-socket\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:24.459254 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.459112    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/19db262e-77ea-42bd-9c60-5589d939149c-data-volume\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:24.466310 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.466286    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klqcn\" (UniqueName: \"kubernetes.io/projected/19db262e-77ea-42bd-9c60-5589d939149c-kube-api-access-klqcn\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:24.596367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.596255    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8frzt"]
Sep 09 14:11:24.601026 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:11:24.601001    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9fbd6c_2e65_4700_a07c_2bf711bfab95.slice/crio-2a37fcb05a1cc47ef5c852724b5caef21a99437c56f6ad232bb24c3d215f14c7 WatchSource:0}: Error finding container 2a37fcb05a1cc47ef5c852724b5caef21a99437c56f6ad232bb24c3d215f14c7: Status 404 returned error can't find the container with id 2a37fcb05a1cc47ef5c852724b5caef21a99437c56f6ad232bb24c3d215f14c7
Sep 09 14:11:24.885350 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.885266    2553 generic.go:356] "Generic (PLEG): container finished" podID="86fae8d0-b7af-4df3-98d0-ebb2719ecdbd" containerID="c4a7451a006e03e98d69903528e05ef2a56c6413432a2cd96e2beeea41524bdb" exitCode=0
Sep 09 14:11:24.885501 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.885348    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wxsqq" event={"ID":"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd","Type":"ContainerDied","Data":"c4a7451a006e03e98d69903528e05ef2a56c6413432a2cd96e2beeea41524bdb"}
Sep 09 14:11:24.886484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.886463    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8frzt" event={"ID":"6f9fbd6c-2e65-4700-a07c-2bf711bfab95","Type":"ContainerStarted","Data":"2a37fcb05a1cc47ef5c852724b5caef21a99437c56f6ad232bb24c3d215f14c7"}
Sep 09 14:11:24.962780 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.962758    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/19db262e-77ea-42bd-9c60-5589d939149c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:24.962886 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:24.962840    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:24.962936 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:24.962895    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 14:11:24.962980 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:24.962939    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:24.962980 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:24.962969    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/19db262e-77ea-42bd-9c60-5589d939149c-kube-rbac-proxy-cm podName:19db262e-77ea-42bd-9c60-5589d939149c nodeName:}" failed. No retries permitted until 2026-09-09 14:11:25.962944215 +0000 UTC m=+36.766927213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/19db262e-77ea-42bd-9c60-5589d939149c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l4clj" (UID: "19db262e-77ea-42bd-9c60-5589d939149c") : configmap "kube-rbac-proxy" not found
Sep 09 14:11:24.963051 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:24.963000    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls podName:19db262e-77ea-42bd-9c60-5589d939149c nodeName:}" failed. No retries permitted until 2026-09-09 14:11:25.962979946 +0000 UTC m=+36.766962928 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4clj" (UID: "19db262e-77ea-42bd-9c60-5589d939149c") : secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:25.264657 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:25.264626    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:25.264838 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:25.264689    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:25.264838 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:25.264784    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 14:11:25.264838 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:25.264786    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 14:11:25.264992 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:25.264856    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls podName:66ef8b31-2920-406a-84e8-ae1bb4cafa6b nodeName:}" failed. No retries permitted until 2026-09-09 14:11:27.264836069 +0000 UTC m=+38.068819050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls") pod "dns-default-5n2ks" (UID: "66ef8b31-2920-406a-84e8-ae1bb4cafa6b") : secret "dns-default-metrics-tls" not found
Sep 09 14:11:25.264992 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:25.264795    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz: secret "image-registry-tls" not found
Sep 09 14:11:25.264992 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:25.264915    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls podName:2095df4f-d54b-4960-849c-3c43b4413516 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:27.26490399 +0000 UTC m=+38.068886971 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls") pod "image-registry-7f4bbd9dd6-lhgzz" (UID: "2095df4f-d54b-4960-849c-3c43b4413516") : secret "image-registry-tls" not found
Sep 09 14:11:25.466598 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:25.466552    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m5l72\" (UID: \"7528c2f1-cc40-4f51-8c38-5b5e26a41df1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m5l72"
Sep 09 14:11:25.467547 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:25.466733    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 14:11:25.467547 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:25.466815    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert podName:7528c2f1-cc40-4f51-8c38-5b5e26a41df1 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:27.466794093 +0000 UTC m=+38.270777079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-m5l72" (UID: "7528c2f1-cc40-4f51-8c38-5b5e26a41df1") : secret "networking-console-plugin-cert" not found
Sep 09 14:11:25.892120 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:25.892090    2553 generic.go:356] "Generic (PLEG): container finished" podID="86fae8d0-b7af-4df3-98d0-ebb2719ecdbd" containerID="9aee4ed8f4de696520bb9bfe138cc61f209d9c72e0b053f0a940d7e0dfd71cc7" exitCode=0
Sep 09 14:11:25.892265 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:25.892151    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wxsqq" event={"ID":"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd","Type":"ContainerDied","Data":"9aee4ed8f4de696520bb9bfe138cc61f209d9c72e0b053f0a940d7e0dfd71cc7"}
Sep 09 14:11:25.972095 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:25.971904    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:25.972220 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:25.972049    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:25.972220 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:25.972179    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/19db262e-77ea-42bd-9c60-5589d939149c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:25.972326 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:25.972223    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls podName:19db262e-77ea-42bd-9c60-5589d939149c nodeName:}" failed. No retries permitted until 2026-09-09 14:11:27.972204603 +0000 UTC m=+38.776187586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4clj" (UID: "19db262e-77ea-42bd-9c60-5589d939149c") : secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:25.972815 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:25.972758    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/19db262e-77ea-42bd-9c60-5589d939149c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:26.125047 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.125014    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-xwnqr"]
Sep 09 14:11:26.134319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.134298    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-xwnqr"
Sep 09 14:11:26.135067 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.135037    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-xwnqr"]
Sep 09 14:11:26.136525 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.136507    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 09 14:11:26.136633 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.136527    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 09 14:11:26.136696 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.136647    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gg4fj\""
Sep 09 14:11:26.136745 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.136727    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 09 14:11:26.137223 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.137204    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 09 14:11:26.274901 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.274866    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dc892b6c-5be5-45a7-a5b2-64883cc4cd46-signing-cabundle\") pod \"service-ca-75d99c484-xwnqr\" (UID: \"dc892b6c-5be5-45a7-a5b2-64883cc4cd46\") " pod="openshift-service-ca/service-ca-75d99c484-xwnqr"
Sep 09 14:11:26.275070 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.274915    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dc892b6c-5be5-45a7-a5b2-64883cc4cd46-signing-key\") pod \"service-ca-75d99c484-xwnqr\" (UID: \"dc892b6c-5be5-45a7-a5b2-64883cc4cd46\") " pod="openshift-service-ca/service-ca-75d99c484-xwnqr"
Sep 09 14:11:26.275070 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.275002    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl8d5\" (UniqueName: \"kubernetes.io/projected/dc892b6c-5be5-45a7-a5b2-64883cc4cd46-kube-api-access-sl8d5\") pod \"service-ca-75d99c484-xwnqr\" (UID: \"dc892b6c-5be5-45a7-a5b2-64883cc4cd46\") " pod="openshift-service-ca/service-ca-75d99c484-xwnqr"
Sep 09 14:11:26.376469 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.376428    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dc892b6c-5be5-45a7-a5b2-64883cc4cd46-signing-cabundle\") pod \"service-ca-75d99c484-xwnqr\" (UID: \"dc892b6c-5be5-45a7-a5b2-64883cc4cd46\") " pod="openshift-service-ca/service-ca-75d99c484-xwnqr"
Sep 09 14:11:26.376692 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.376486    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dc892b6c-5be5-45a7-a5b2-64883cc4cd46-signing-key\") pod \"service-ca-75d99c484-xwnqr\" (UID: \"dc892b6c-5be5-45a7-a5b2-64883cc4cd46\") " pod="openshift-service-ca/service-ca-75d99c484-xwnqr"
Sep 09 14:11:26.376692 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.376519    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl8d5\" (UniqueName: \"kubernetes.io/projected/dc892b6c-5be5-45a7-a5b2-64883cc4cd46-kube-api-access-sl8d5\") pod \"service-ca-75d99c484-xwnqr\" (UID: \"dc892b6c-5be5-45a7-a5b2-64883cc4cd46\") " pod="openshift-service-ca/service-ca-75d99c484-xwnqr"
Sep 09 14:11:26.377232 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.377205    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dc892b6c-5be5-45a7-a5b2-64883cc4cd46-signing-cabundle\") pod \"service-ca-75d99c484-xwnqr\" (UID: \"dc892b6c-5be5-45a7-a5b2-64883cc4cd46\") " pod="openshift-service-ca/service-ca-75d99c484-xwnqr"
Sep 09 14:11:26.379901 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.379879    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dc892b6c-5be5-45a7-a5b2-64883cc4cd46-signing-key\") pod \"service-ca-75d99c484-xwnqr\" (UID: \"dc892b6c-5be5-45a7-a5b2-64883cc4cd46\") " pod="openshift-service-ca/service-ca-75d99c484-xwnqr"
Sep 09 14:11:26.384218 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.384189    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl8d5\" (UniqueName: \"kubernetes.io/projected/dc892b6c-5be5-45a7-a5b2-64883cc4cd46-kube-api-access-sl8d5\") pod \"service-ca-75d99c484-xwnqr\" (UID: \"dc892b6c-5be5-45a7-a5b2-64883cc4cd46\") " pod="openshift-service-ca/service-ca-75d99c484-xwnqr"
Sep 09 14:11:26.446038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.446008    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-xwnqr"
Sep 09 14:11:26.626174 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.626147    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ldbss_0256961f-5a7f-4e42-b718-e430e65924fd/dns-node-resolver/0.log"
Sep 09 14:11:26.898242 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.898169    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wxsqq" event={"ID":"86fae8d0-b7af-4df3-98d0-ebb2719ecdbd","Type":"ContainerStarted","Data":"ad1ae01ab6436d43deb156b530a6557b5ef55695328e19e4decd62516b248550"}
Sep 09 14:11:26.921395 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:26.921346    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wxsqq" podStartSLOduration=8.675275116 podStartE2EDuration="37.921326491s" totalImagesPullingTime="29.246051375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:26.919063434 +0000 UTC m=+37.723046437" watchObservedRunningTime="2026-09-09 14:11:26.921326491 +0000 UTC m=+37.725309493"
Sep 09 14:11:27.169157 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:27.169134    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-xwnqr"]
Sep 09 14:11:27.173589 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:11:27.173539    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc892b6c_5be5_45a7_a5b2_64883cc4cd46.slice/crio-cb83df4a1f871a021bff68306cb2bb6d74cf3c76046b43831b7b5e132ca57ef6 WatchSource:0}: Error finding container cb83df4a1f871a021bff68306cb2bb6d74cf3c76046b43831b7b5e132ca57ef6: Status 404 returned error can't find the container with id cb83df4a1f871a021bff68306cb2bb6d74cf3c76046b43831b7b5e132ca57ef6
Sep 09 14:11:27.283721 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:27.283680    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:27.283865 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:27.283763    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:27.283915 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:27.283862    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 14:11:27.283915 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:27.283866    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 14:11:27.283915 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:27.283891    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz: secret "image-registry-tls" not found
Sep 09 14:11:27.284088 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:27.283920    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls podName:66ef8b31-2920-406a-84e8-ae1bb4cafa6b nodeName:}" failed. No retries permitted until 2026-09-09 14:11:31.283905908 +0000 UTC m=+42.087888908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls") pod "dns-default-5n2ks" (UID: "66ef8b31-2920-406a-84e8-ae1bb4cafa6b") : secret "dns-default-metrics-tls" not found
Sep 09 14:11:27.284088 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:27.283947    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls podName:2095df4f-d54b-4960-849c-3c43b4413516 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:31.283927847 +0000 UTC m=+42.087910828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls") pod "image-registry-7f4bbd9dd6-lhgzz" (UID: "2095df4f-d54b-4960-849c-3c43b4413516") : secret "image-registry-tls" not found
Sep 09 14:11:27.485613 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:27.485583    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m5l72\" (UID: \"7528c2f1-cc40-4f51-8c38-5b5e26a41df1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m5l72"
Sep 09 14:11:27.485772 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:27.485718    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 14:11:27.485817 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:27.485777    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert podName:7528c2f1-cc40-4f51-8c38-5b5e26a41df1 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:31.485760003 +0000 UTC m=+42.289742991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-m5l72" (UID: "7528c2f1-cc40-4f51-8c38-5b5e26a41df1") : secret "networking-console-plugin-cert" not found
Sep 09 14:11:27.826009 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:27.825747    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ww47d_7073d92b-77ab-46c2-98bd-ac827126c826/node-ca/0.log"
Sep 09 14:11:27.902980 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:27.902911    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-xwnqr" event={"ID":"dc892b6c-5be5-45a7-a5b2-64883cc4cd46","Type":"ContainerStarted","Data":"cb83df4a1f871a021bff68306cb2bb6d74cf3c76046b43831b7b5e132ca57ef6"}
Sep 09 14:11:27.904708 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:27.904676    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8frzt" event={"ID":"6f9fbd6c-2e65-4700-a07c-2bf711bfab95","Type":"ContainerStarted","Data":"05d0d46169bbf6dd8ef4bc9113d30163cd44c40fc3976112721e7fcde13de6ad"}
Sep 09 14:11:27.921592 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:27.921528    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8frzt" podStartSLOduration=2.460209624 podStartE2EDuration="4.921509071s" totalImagesPullingTime="2.461299447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:27.920370178 +0000 UTC m=+38.724353183" watchObservedRunningTime="2026-09-09 14:11:27.921509071 +0000 UTC m=+38.725492078"
Sep 09 14:11:27.990252 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:27.990224    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:27.990374 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:27.990298    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls podName:19db262e-77ea-42bd-9c60-5589d939149c nodeName:}" failed. No retries permitted until 2026-09-09 14:11:31.990277565 +0000 UTC m=+42.794260553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4clj" (UID: "19db262e-77ea-42bd-9c60-5589d939149c") : secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:27.990439 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:27.990067    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:28.226769 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:28.226741    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8frzt_6f9fbd6c-2e65-4700-a07c-2bf711bfab95/serve-healthcheck-canary/0.log"
Sep 09 14:11:29.911035 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:29.910989    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-xwnqr" event={"ID":"dc892b6c-5be5-45a7-a5b2-64883cc4cd46","Type":"ContainerStarted","Data":"5ef60c4663430a1eaf70a7b094c5b4c407aeb50215f7b98f48a3dfd485dd37dc"}
Sep 09 14:11:29.928922 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:29.928837    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-xwnqr" podStartSLOduration=1.438324493 podStartE2EDuration="3.928823272s" totalImagesPullingTime="2.490498779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:29.928591089 +0000 UTC m=+40.732574092" watchObservedRunningTime="2026-09-09 14:11:29.928823272 +0000 UTC m=+40.732806274"
Sep 09 14:11:31.315560 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:31.315524    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:31.315972 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:31.315613    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:31.315972 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:31.315709    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 14:11:31.315972 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:31.315721    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz: secret "image-registry-tls" not found
Sep 09 14:11:31.315972 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:31.315708    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 14:11:31.315972 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:31.315765    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls podName:2095df4f-d54b-4960-849c-3c43b4413516 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:39.315752283 +0000 UTC m=+50.119735280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls") pod "image-registry-7f4bbd9dd6-lhgzz" (UID: "2095df4f-d54b-4960-849c-3c43b4413516") : secret "image-registry-tls" not found
Sep 09 14:11:31.315972 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:31.315864    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls podName:66ef8b31-2920-406a-84e8-ae1bb4cafa6b nodeName:}" failed. No retries permitted until 2026-09-09 14:11:39.315844962 +0000 UTC m=+50.119827944 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls") pod "dns-default-5n2ks" (UID: "66ef8b31-2920-406a-84e8-ae1bb4cafa6b") : secret "dns-default-metrics-tls" not found
Sep 09 14:11:31.517458 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:31.517423    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m5l72\" (UID: \"7528c2f1-cc40-4f51-8c38-5b5e26a41df1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m5l72"
Sep 09 14:11:31.517624 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:31.517530    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 14:11:31.517624 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:31.517595    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert podName:7528c2f1-cc40-4f51-8c38-5b5e26a41df1 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:39.517582999 +0000 UTC m=+50.321565980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-m5l72" (UID: "7528c2f1-cc40-4f51-8c38-5b5e26a41df1") : secret "networking-console-plugin-cert" not found
Sep 09 14:11:32.020710 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:32.020679    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:32.020875 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:32.020831    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:32.020917 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:11:32.020895    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls podName:19db262e-77ea-42bd-9c60-5589d939149c nodeName:}" failed. No retries permitted until 2026-09-09 14:11:40.020876011 +0000 UTC m=+50.824858998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4clj" (UID: "19db262e-77ea-42bd-9c60-5589d939149c") : secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:39.377907 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.377874    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:39.378306 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.377945    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:39.380910 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.380887    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66ef8b31-2920-406a-84e8-ae1bb4cafa6b-metrics-tls\") pod \"dns-default-5n2ks\" (UID: \"66ef8b31-2920-406a-84e8-ae1bb4cafa6b\") " pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:39.381117 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.381093    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls\") pod \"image-registry-7f4bbd9dd6-lhgzz\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") " pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:39.448873 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.448843    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:39.461061 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.461035    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:39.579711 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.579681    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m5l72\" (UID: \"7528c2f1-cc40-4f51-8c38-5b5e26a41df1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m5l72"
Sep 09 14:11:39.581901 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.581880    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7528c2f1-cc40-4f51-8c38-5b5e26a41df1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m5l72\" (UID: \"7528c2f1-cc40-4f51-8c38-5b5e26a41df1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m5l72"
Sep 09 14:11:39.651691 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.651637    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-m5l72"
Sep 09 14:11:39.751941 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.751911    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"]
Sep 09 14:11:39.756126 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:11:39.756093    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2095df4f_d54b_4960_849c_3c43b4413516.slice/crio-4469f7129827b13ee517fe4ea8bc48af16c76f3ac3973a02e94ec2ee4f3f2337 WatchSource:0}: Error finding container 4469f7129827b13ee517fe4ea8bc48af16c76f3ac3973a02e94ec2ee4f3f2337: Status 404 returned error can't find the container with id 4469f7129827b13ee517fe4ea8bc48af16c76f3ac3973a02e94ec2ee4f3f2337
Sep 09 14:11:39.779489 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.779469    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5n2ks"]
Sep 09 14:11:39.782196 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:11:39.782173    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ef8b31_2920_406a_84e8_ae1bb4cafa6b.slice/crio-dd672533cae0eb77fcf1fd4b039dbc8662201400b9bd6bcbe08e5ecfc57a00a2 WatchSource:0}: Error finding container dd672533cae0eb77fcf1fd4b039dbc8662201400b9bd6bcbe08e5ecfc57a00a2: Status 404 returned error can't find the container with id dd672533cae0eb77fcf1fd4b039dbc8662201400b9bd6bcbe08e5ecfc57a00a2
Sep 09 14:11:39.936349 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.936283    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz" event={"ID":"2095df4f-d54b-4960-849c-3c43b4413516","Type":"ContainerStarted","Data":"da58f288ab4afbc729869ff50f5dd192173750246b349bdfe7e32b3dfd356246"}
Sep 09 14:11:39.936349 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.936337    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz" event={"ID":"2095df4f-d54b-4960-849c-3c43b4413516","Type":"ContainerStarted","Data":"4469f7129827b13ee517fe4ea8bc48af16c76f3ac3973a02e94ec2ee4f3f2337"}
Sep 09 14:11:39.936526 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.936359    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:11:39.937551 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.937530    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5n2ks" event={"ID":"66ef8b31-2920-406a-84e8-ae1bb4cafa6b","Type":"ContainerStarted","Data":"dd672533cae0eb77fcf1fd4b039dbc8662201400b9bd6bcbe08e5ecfc57a00a2"}
Sep 09 14:11:39.947610 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.947587    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-m5l72"]
Sep 09 14:11:39.950119 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:11:39.950098    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7528c2f1_cc40_4f51_8c38_5b5e26a41df1.slice/crio-896f1675370e87d8c8b0f36dfd1183a3f489bff2bfc2cacaa2f4c9d0d219f1e6 WatchSource:0}: Error finding container 896f1675370e87d8c8b0f36dfd1183a3f489bff2bfc2cacaa2f4c9d0d219f1e6: Status 404 returned error can't find the container with id 896f1675370e87d8c8b0f36dfd1183a3f489bff2bfc2cacaa2f4c9d0d219f1e6
Sep 09 14:11:39.954493 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:39.954456    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz" podStartSLOduration=24.954443375 podStartE2EDuration="24.954443375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:39.954056551 +0000 UTC m=+50.758039554" watchObservedRunningTime="2026-09-09 14:11:39.954443375 +0000 UTC m=+50.758426377"
Sep 09 14:11:40.083752 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:40.083722    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:40.085880 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:40.085844    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/19db262e-77ea-42bd-9c60-5589d939149c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4clj\" (UID: \"19db262e-77ea-42bd-9c60-5589d939149c\") " pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:40.177365 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:40.177334    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l4clj"
Sep 09 14:11:40.472555 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:40.472425    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l4clj"]
Sep 09 14:11:40.480056 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:11:40.480020    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19db262e_77ea_42bd_9c60_5589d939149c.slice/crio-e0e9dc216275a5cca7901f40a799e33101dd70deb04f22d6f90229e62079c517 WatchSource:0}: Error finding container e0e9dc216275a5cca7901f40a799e33101dd70deb04f22d6f90229e62079c517: Status 404 returned error can't find the container with id e0e9dc216275a5cca7901f40a799e33101dd70deb04f22d6f90229e62079c517
Sep 09 14:11:40.942208 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:40.942172    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l4clj" event={"ID":"19db262e-77ea-42bd-9c60-5589d939149c","Type":"ContainerStarted","Data":"ccfdca23637a3ab1999d6b33f35459f3cb337c3e1ddbd1678af3113a93cf6218"}
Sep 09 14:11:40.942379 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:40.942243    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l4clj" event={"ID":"19db262e-77ea-42bd-9c60-5589d939149c","Type":"ContainerStarted","Data":"e0e9dc216275a5cca7901f40a799e33101dd70deb04f22d6f90229e62079c517"}
Sep 09 14:11:40.944426 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:40.944063    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-m5l72" event={"ID":"7528c2f1-cc40-4f51-8c38-5b5e26a41df1","Type":"ContainerStarted","Data":"896f1675370e87d8c8b0f36dfd1183a3f489bff2bfc2cacaa2f4c9d0d219f1e6"}
Sep 09 14:11:42.952097 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:42.952059    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-m5l72" event={"ID":"7528c2f1-cc40-4f51-8c38-5b5e26a41df1","Type":"ContainerStarted","Data":"f6605c120287b0458412134e086d773a4c315eb3223f8bb891aabe9353651815"}
Sep 09 14:11:42.954236 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:42.954204    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5n2ks" event={"ID":"66ef8b31-2920-406a-84e8-ae1bb4cafa6b","Type":"ContainerStarted","Data":"3a32f556b35d750f55bb15841031c61d051da238f26b8ef10ffab1a3e17a0f0f"}
Sep 09 14:11:42.954366 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:42.954266    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:42.954366 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:42.954293    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5n2ks" event={"ID":"66ef8b31-2920-406a-84e8-ae1bb4cafa6b","Type":"ContainerStarted","Data":"da91052bb4cee975bc733feb9daf8eba5e4fd875ceeb8ba0605ac0c613cdd701"}
Sep 09 14:11:42.956190 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:42.956161    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l4clj" event={"ID":"19db262e-77ea-42bd-9c60-5589d939149c","Type":"ContainerStarted","Data":"9ae7759bae391549ae9dfb692fe2b79e1415d85daf1cd98e58603e0aadaa4335"}
Sep 09 14:11:42.967471 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:42.967414    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-m5l72" podStartSLOduration=18.010272528 podStartE2EDuration="19.967398118s" totalImagesPullingTime="1.95712559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:42.967097282 +0000 UTC m=+53.771080281" watchObservedRunningTime="2026-09-09 14:11:42.967398118 +0000 UTC m=+53.771381103"
Sep 09 14:11:42.987254 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:42.987207    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5n2ks" podStartSLOduration=17.855806698 podStartE2EDuration="19.98718874s" totalImagesPullingTime="2.131382042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:42.986767489 +0000 UTC m=+53.790750508" watchObservedRunningTime="2026-09-09 14:11:42.98718874 +0000 UTC m=+53.791171746"
Sep 09 14:11:43.961022 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:43.960983    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l4clj" event={"ID":"19db262e-77ea-42bd-9c60-5589d939149c","Type":"ContainerStarted","Data":"24c32638e81c33cdfda0a004250244dd0133a3f6390ae7633c0cd2f52b6377c7"}
Sep 09 14:11:43.982530 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:43.982475    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l4clj" podStartSLOduration=16.999516776 podStartE2EDuration="19.982456342s" totalImagesPullingTime="2.982939566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:11:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:43.982453712 +0000 UTC m=+54.786436727" watchObservedRunningTime="2026-09-09 14:11:43.982456342 +0000 UTC m=+54.786439342"
Sep 09 14:11:47.994106 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:47.994070    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b"]
Sep 09 14:11:48.027796 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.027760    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"]
Sep 09 14:11:48.027930 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.027884    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b"
Sep 09 14:11:48.030152 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.030126    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 09 14:11:48.030551 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.030529    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 09 14:11:48.030551 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.030544    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 09 14:11:48.031030 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.031012    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 09 14:11:48.041641 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.041614    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b"]
Sep 09 14:11:48.041741 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.041663    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"]
Sep 09 14:11:48.041781 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.041738    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.044072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.044052    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 09 14:11:48.044171 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.044128    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 09 14:11:48.044171 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.044164    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 09 14:11:48.044258 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.044228    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 09 14:11:48.059278 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.059254    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"]
Sep 09 14:11:48.099852 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.099831    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"]
Sep 09 14:11:48.123675 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.123654    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"]
Sep 09 14:11:48.123760 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.123737    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.142466 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.142447    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5db480a-aac8-4395-a320-c6da94afa44d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.142540 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.142492    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b5db480a-aac8-4395-a320-c6da94afa44d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.142540 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.142512    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0255f788-af82-49ce-a739-913764d8361a-tmp\") pod \"klusterlet-addon-workmgr-7f967f7c88-zmw5b\" (UID: \"0255f788-af82-49ce-a739-913764d8361a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b"
Sep 09 14:11:48.142629 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.142575    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5db480a-aac8-4395-a320-c6da94afa44d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.142667 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.142633    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b5db480a-aac8-4395-a320-c6da94afa44d-hub\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.142701 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.142675    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jld8\" (UniqueName: \"kubernetes.io/projected/b5db480a-aac8-4395-a320-c6da94afa44d-kube-api-access-4jld8\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.142701 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.142695    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0255f788-af82-49ce-a739-913764d8361a-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f967f7c88-zmw5b\" (UID: \"0255f788-af82-49ce-a739-913764d8361a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b"
Sep 09 14:11:48.142762 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.142711    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh4qj\" (UniqueName: \"kubernetes.io/projected/0255f788-af82-49ce-a739-913764d8361a-kube-api-access-dh4qj\") pod \"klusterlet-addon-workmgr-7f967f7c88-zmw5b\" (UID: \"0255f788-af82-49ce-a739-913764d8361a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b"
Sep 09 14:11:48.142762 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.142724    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b5db480a-aac8-4395-a320-c6da94afa44d-ca\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.243086 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243061    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0255f788-af82-49ce-a739-913764d8361a-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f967f7c88-zmw5b\" (UID: \"0255f788-af82-49ce-a739-913764d8361a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b"
Sep 09 14:11:48.243181 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243090    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh4qj\" (UniqueName: \"kubernetes.io/projected/0255f788-af82-49ce-a739-913764d8361a-kube-api-access-dh4qj\") pod \"klusterlet-addon-workmgr-7f967f7c88-zmw5b\" (UID: \"0255f788-af82-49ce-a739-913764d8361a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b"
Sep 09 14:11:48.243181 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243107    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db783625-a7df-4aba-ad3a-3674d91f7807-installation-pull-secrets\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.243181 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243122    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b5db480a-aac8-4395-a320-c6da94afa44d-ca\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.243181 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243142    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db783625-a7df-4aba-ad3a-3674d91f7807-trusted-ca\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.243396 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243256    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5db480a-aac8-4395-a320-c6da94afa44d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.243396 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243307    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db783625-a7df-4aba-ad3a-3674d91f7807-ca-trust-extracted\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.243396 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243340    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g26w9\" (UniqueName: \"kubernetes.io/projected/db783625-a7df-4aba-ad3a-3674d91f7807-kube-api-access-g26w9\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.243396 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243374    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b5db480a-aac8-4395-a320-c6da94afa44d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.243627 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243429    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0255f788-af82-49ce-a739-913764d8361a-tmp\") pod \"klusterlet-addon-workmgr-7f967f7c88-zmw5b\" (UID: \"0255f788-af82-49ce-a739-913764d8361a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b"
Sep 09 14:11:48.243627 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243476    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5db480a-aac8-4395-a320-c6da94afa44d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.243627 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243512    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db783625-a7df-4aba-ad3a-3674d91f7807-registry-tls\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.243627 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243543    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/db783625-a7df-4aba-ad3a-3674d91f7807-image-registry-private-configuration\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.243627 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243587    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db783625-a7df-4aba-ad3a-3674d91f7807-bound-sa-token\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.243907 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243661    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b5db480a-aac8-4395-a320-c6da94afa44d-hub\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.243907 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243687    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db783625-a7df-4aba-ad3a-3674d91f7807-registry-certificates\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.243907 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243717    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jld8\" (UniqueName: \"kubernetes.io/projected/b5db480a-aac8-4395-a320-c6da94afa44d-kube-api-access-4jld8\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.243907 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.243826    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0255f788-af82-49ce-a739-913764d8361a-tmp\") pod \"klusterlet-addon-workmgr-7f967f7c88-zmw5b\" (UID: \"0255f788-af82-49ce-a739-913764d8361a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b"
Sep 09 14:11:48.244227 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.244170    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5db480a-aac8-4395-a320-c6da94afa44d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.245798 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.245777    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0255f788-af82-49ce-a739-913764d8361a-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f967f7c88-zmw5b\" (UID: \"0255f788-af82-49ce-a739-913764d8361a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b"
Sep 09 14:11:48.245989 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.245969    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5db480a-aac8-4395-a320-c6da94afa44d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.246041 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.246023    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b5db480a-aac8-4395-a320-c6da94afa44d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.246243 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.246227    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b5db480a-aac8-4395-a320-c6da94afa44d-ca\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.246325 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.246308    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b5db480a-aac8-4395-a320-c6da94afa44d-hub\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.251160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.251137    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh4qj\" (UniqueName: \"kubernetes.io/projected/0255f788-af82-49ce-a739-913764d8361a-kube-api-access-dh4qj\") pod \"klusterlet-addon-workmgr-7f967f7c88-zmw5b\" (UID: \"0255f788-af82-49ce-a739-913764d8361a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b"
Sep 09 14:11:48.251366 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.251231    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jld8\" (UniqueName: \"kubernetes.io/projected/b5db480a-aac8-4395-a320-c6da94afa44d-kube-api-access-4jld8\") pod \"cluster-proxy-proxy-agent-844997c658-sv7jl\" (UID: \"b5db480a-aac8-4395-a320-c6da94afa44d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.339272 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.339251    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b"
Sep 09 14:11:48.344508 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.344488    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db783625-a7df-4aba-ad3a-3674d91f7807-registry-certificates\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.344576 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.344522    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db783625-a7df-4aba-ad3a-3674d91f7807-installation-pull-secrets\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.344576 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.344545    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db783625-a7df-4aba-ad3a-3674d91f7807-trusted-ca\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.344643 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.344606    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db783625-a7df-4aba-ad3a-3674d91f7807-ca-trust-extracted\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.344696 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.344635    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g26w9\" (UniqueName: \"kubernetes.io/projected/db783625-a7df-4aba-ad3a-3674d91f7807-kube-api-access-g26w9\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.344754 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.344740    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db783625-a7df-4aba-ad3a-3674d91f7807-registry-tls\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.344806 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.344779    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/db783625-a7df-4aba-ad3a-3674d91f7807-image-registry-private-configuration\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.344859 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.344811    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db783625-a7df-4aba-ad3a-3674d91f7807-bound-sa-token\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.345084 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.345061    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db783625-a7df-4aba-ad3a-3674d91f7807-ca-trust-extracted\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.345499 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.345480    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db783625-a7df-4aba-ad3a-3674d91f7807-registry-certificates\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.345850 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.345824    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db783625-a7df-4aba-ad3a-3674d91f7807-trusted-ca\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.346846 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.346827    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db783625-a7df-4aba-ad3a-3674d91f7807-registry-tls\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.346905 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.346849    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db783625-a7df-4aba-ad3a-3674d91f7807-installation-pull-secrets\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.347137 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.347117    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/db783625-a7df-4aba-ad3a-3674d91f7807-image-registry-private-configuration\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.353481 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.353456    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db783625-a7df-4aba-ad3a-3674d91f7807-bound-sa-token\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.354013 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.353995    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g26w9\" (UniqueName: \"kubernetes.io/projected/db783625-a7df-4aba-ad3a-3674d91f7807-kube-api-access-g26w9\") pod \"image-registry-5c5b5f6b4c-5fmdx\" (UID: \"db783625-a7df-4aba-ad3a-3674d91f7807\") " pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.362804 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.362776    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"
Sep 09 14:11:48.432279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.432104    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.627526 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.627386    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b"]
Sep 09 14:11:48.629760 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:11:48.629738    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0255f788_af82_49ce_a739_913764d8361a.slice/crio-b80aa6375ee9e00c0e9b50915903f86a0bfd6f8eb6473eacf7488444df9ceee1 WatchSource:0}: Error finding container b80aa6375ee9e00c0e9b50915903f86a0bfd6f8eb6473eacf7488444df9ceee1: Status 404 returned error can't find the container with id b80aa6375ee9e00c0e9b50915903f86a0bfd6f8eb6473eacf7488444df9ceee1
Sep 09 14:11:48.656058 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.656030    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl"]
Sep 09 14:11:48.660142 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:11:48.660115    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5db480a_aac8_4395_a320_c6da94afa44d.slice/crio-33948774823b9d535665f21fbb8862fcc2cb272782e5ab19a4713679c3e5e5ba WatchSource:0}: Error finding container 33948774823b9d535665f21fbb8862fcc2cb272782e5ab19a4713679c3e5e5ba: Status 404 returned error can't find the container with id 33948774823b9d535665f21fbb8862fcc2cb272782e5ab19a4713679c3e5e5ba
Sep 09 14:11:48.721468 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.721444    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"]
Sep 09 14:11:48.723697 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:11:48.723678    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb783625_a7df_4aba_ad3a_3674d91f7807.slice/crio-90821efbfaeb59d4769a9d87308b975678eb44036b8c3037098c8b486ecdb52b WatchSource:0}: Error finding container 90821efbfaeb59d4769a9d87308b975678eb44036b8c3037098c8b486ecdb52b: Status 404 returned error can't find the container with id 90821efbfaeb59d4769a9d87308b975678eb44036b8c3037098c8b486ecdb52b
Sep 09 14:11:48.881517 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.881496    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-72sxp"
Sep 09 14:11:48.983143 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.983106    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx" event={"ID":"db783625-a7df-4aba-ad3a-3674d91f7807","Type":"ContainerStarted","Data":"4d35338d359cf7ac5555b8c4f884a9c08acedeb6d52cd25783efd5a8623b7d3f"}
Sep 09 14:11:48.983307 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.983199    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx" event={"ID":"db783625-a7df-4aba-ad3a-3674d91f7807","Type":"ContainerStarted","Data":"90821efbfaeb59d4769a9d87308b975678eb44036b8c3037098c8b486ecdb52b"}
Sep 09 14:11:48.983307 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.983228    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:11:48.984313 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.984285    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b" event={"ID":"0255f788-af82-49ce-a739-913764d8361a","Type":"ContainerStarted","Data":"b80aa6375ee9e00c0e9b50915903f86a0bfd6f8eb6473eacf7488444df9ceee1"}
Sep 09 14:11:48.985463 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:48.985440    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl" event={"ID":"b5db480a-aac8-4395-a320-c6da94afa44d","Type":"ContainerStarted","Data":"33948774823b9d535665f21fbb8862fcc2cb272782e5ab19a4713679c3e5e5ba"}
Sep 09 14:11:49.001954 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:49.001905    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx" podStartSLOduration=1.001887693 podStartE2EDuration="1.001887693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:49.000725386 +0000 UTC m=+59.804708391" watchObservedRunningTime="2026-09-09 14:11:49.001887693 +0000 UTC m=+59.805870698"
Sep 09 14:11:52.963317 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:52.963286    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5n2ks"
Sep 09 14:11:55.012887 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.012834    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b" event={"ID":"0255f788-af82-49ce-a739-913764d8361a","Type":"ContainerStarted","Data":"76361c042514e52b0d06f991751693d2c3c80ed04f5e5c7a91cead7f773d2b17"}
Sep 09 14:11:55.013331 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.012897    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b"
Sep 09 14:11:55.014835 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.014812    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b"
Sep 09 14:11:55.015159 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.015141    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl" event={"ID":"b5db480a-aac8-4395-a320-c6da94afa44d","Type":"ContainerStarted","Data":"b2f9e68e17bb3bf71e2e59966ea6a834738452d24bf110cc595ad05f6d92c480"}
Sep 09 14:11:55.015215 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.015173    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl" event={"ID":"b5db480a-aac8-4395-a320-c6da94afa44d","Type":"ContainerStarted","Data":"639d3c8050707e340f70fbc6fcc9947fb7ccb601777f49ab1dd0db9379a60f84"}
Sep 09 14:11:55.015215 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.015188    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl" event={"ID":"b5db480a-aac8-4395-a320-c6da94afa44d","Type":"ContainerStarted","Data":"1b817914a85a7c7f1e6454abf0a31720d1cd635a5cbd08584cc0a84fe24d62f1"}
Sep 09 14:11:55.029250 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.029110    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f967f7c88-zmw5b" podStartSLOduration=2.574735122 podStartE2EDuration="8.029094974s" totalImagesPullingTime="5.454359852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:55.029011752 +0000 UTC m=+65.832994755" watchObservedRunningTime="2026-09-09 14:11:55.029094974 +0000 UTC m=+65.833077977"
Sep 09 14:11:55.055378 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.055340    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844997c658-sv7jl" podStartSLOduration=2.6324950129999998 podStartE2EDuration="8.055328054s" totalImagesPullingTime="5.422833041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:55.05406288 +0000 UTC m=+65.858045883" watchObservedRunningTime="2026-09-09 14:11:55.055328054 +0000 UTC m=+65.859311054"
Sep 09 14:11:55.410429 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.410332    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret\") pod \"global-pull-secret-syncer-22vlz\" (UID: \"07b89a46-bf5c-4842-976f-ff7830f1c2ae\") " pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:55.414336 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.414309    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 14:11:55.423012 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.422985    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07b89a46-bf5c-4842-976f-ff7830f1c2ae-original-pull-secret\") pod \"global-pull-secret-syncer-22vlz\" (UID: \"07b89a46-bf5c-4842-976f-ff7830f1c2ae\") " pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:55.460640 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.460608    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22vlz"
Sep 09 14:11:55.511428 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.511391    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs\") pod \"network-metrics-daemon-hgx77\" (UID: \"464b2caf-067c-434c-ac2d-6b73c3855127\") " pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:55.514103 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.514077    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 14:11:55.523880 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.523851    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464b2caf-067c-434c-ac2d-6b73c3855127-metrics-certs\") pod \"network-metrics-daemon-hgx77\" (UID: \"464b2caf-067c-434c-ac2d-6b73c3855127\") " pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:55.612718 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.612686    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5lmd\" (UniqueName: \"kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd\") pod \"network-check-target-bnc5m\" (UID: \"6869fb67-38e1-4f8c-851b-71063a6c4942\") " pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:55.615329 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.615310    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 14:11:55.625748 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.625725    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 14:11:55.636233 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.636210    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5lmd\" (UniqueName: \"kubernetes.io/projected/6869fb67-38e1-4f8c-851b-71063a6c4942-kube-api-access-z5lmd\") pod \"network-check-target-bnc5m\" (UID: \"6869fb67-38e1-4f8c-851b-71063a6c4942\") " pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:55.752395 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.752364    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-22vlz"]
Sep 09 14:11:55.754891 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:11:55.754866    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b89a46_bf5c_4842_976f_ff7830f1c2ae.slice/crio-e90252c01a63ddd29d5843cf4ade044b7eb8677db651b04b0d103dc0c43fe136 WatchSource:0}: Error finding container e90252c01a63ddd29d5843cf4ade044b7eb8677db651b04b0d103dc0c43fe136: Status 404 returned error can't find the container with id e90252c01a63ddd29d5843cf4ade044b7eb8677db651b04b0d103dc0c43fe136
Sep 09 14:11:55.756421 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.756354    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-72t49\""
Sep 09 14:11:55.763263 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.763243    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:11:55.767961 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.767943    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f5zw2\""
Sep 09 14:11:55.776921 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:55.776906    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hgx77"
Sep 09 14:11:56.019310 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:56.019228    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-22vlz" event={"ID":"07b89a46-bf5c-4842-976f-ff7830f1c2ae","Type":"ContainerStarted","Data":"e90252c01a63ddd29d5843cf4ade044b7eb8677db651b04b0d103dc0c43fe136"}
Sep 09 14:11:56.058753 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:56.058725    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bnc5m"]
Sep 09 14:11:56.061351 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:11:56.061327    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6869fb67_38e1_4f8c_851b_71063a6c4942.slice/crio-74e6543cc933152bc1885e547e70bafaedc173e19d93968a8e437eac3688d93f WatchSource:0}: Error finding container 74e6543cc933152bc1885e547e70bafaedc173e19d93968a8e437eac3688d93f: Status 404 returned error can't find the container with id 74e6543cc933152bc1885e547e70bafaedc173e19d93968a8e437eac3688d93f
Sep 09 14:11:56.082078 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:56.082052    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hgx77"]
Sep 09 14:11:56.084296 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:11:56.084276    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod464b2caf_067c_434c_ac2d_6b73c3855127.slice/crio-924b494aa0a9308892b4f919c82cde052b986b6fbe0ccff711312a0c2d362de7 WatchSource:0}: Error finding container 924b494aa0a9308892b4f919c82cde052b986b6fbe0ccff711312a0c2d362de7: Status 404 returned error can't find the container with id 924b494aa0a9308892b4f919c82cde052b986b6fbe0ccff711312a0c2d362de7
Sep 09 14:11:57.026071 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:57.026021    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bnc5m" event={"ID":"6869fb67-38e1-4f8c-851b-71063a6c4942","Type":"ContainerStarted","Data":"74e6543cc933152bc1885e547e70bafaedc173e19d93968a8e437eac3688d93f"}
Sep 09 14:11:57.028236 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:57.027921    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hgx77" event={"ID":"464b2caf-067c-434c-ac2d-6b73c3855127","Type":"ContainerStarted","Data":"924b494aa0a9308892b4f919c82cde052b986b6fbe0ccff711312a0c2d362de7"}
Sep 09 14:11:58.036539 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:58.036453    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hgx77" event={"ID":"464b2caf-067c-434c-ac2d-6b73c3855127","Type":"ContainerStarted","Data":"98c6abdc342996b6634d97313cfea9182c7397493e05bd7a59a596195b5e3043"}
Sep 09 14:11:58.036539 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:58.036520    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hgx77" event={"ID":"464b2caf-067c-434c-ac2d-6b73c3855127","Type":"ContainerStarted","Data":"ab62f2b6675c21e7357b301c351dbff8dc2fbce116796f3be4920bf362f997cb"}
Sep 09 14:11:58.057116 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:58.057062    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hgx77" podStartSLOduration=67.376058247 podStartE2EDuration="1m9.057041333s" totalImagesPullingTime="1.680983086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:58.055824504 +0000 UTC m=+68.859807510" watchObservedRunningTime="2026-09-09 14:11:58.057041333 +0000 UTC m=+68.861024339"
Sep 09 14:11:58.066603 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:58.066545    2553 patch_prober.go:28] interesting pod/image-registry-7f4bbd9dd6-lhgzz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 14:11:58.066702 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:11:58.066618    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz" podUID="2095df4f-d54b-4960-849c-3c43b4413516" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 14:12:00.888714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:00.888628    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c8vkw"]
Sep 09 14:12:00.890835 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:00.890813    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:00.893800 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:00.893759    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 14:12:00.893951 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:00.893933    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 14:12:00.894012 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:00.893972    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 14:12:00.894491 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:00.894471    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 14:12:00.894629 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:00.894527    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 14:12:00.894795 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:00.894778    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f2ql4\""
Sep 09 14:12:00.895074 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:00.895051    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 14:12:01.050200 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.050170    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-22vlz" event={"ID":"07b89a46-bf5c-4842-976f-ff7830f1c2ae","Type":"ContainerStarted","Data":"b38c125ac87426d06d53799bd45e9a824a91a711cb4758fe8693c196177265e5"}
Sep 09 14:12:01.051875 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.051851    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bnc5m" event={"ID":"6869fb67-38e1-4f8c-851b-71063a6c4942","Type":"ContainerStarted","Data":"ccbe5958b30c4a8543afba207d18db0c2dc9359f051c1842df280f28a60b0ec6"}
Sep 09 14:12:01.051994 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.051982    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:12:01.056124 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.056102    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-node-exporter-textfile\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.056202 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.056135    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-node-exporter-tls\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.056202 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.056165    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-root\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.056262 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.056203    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-node-exporter-accelerators-collector-config\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.056262 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.056226    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-sys\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.056324 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.056266    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-metrics-client-ca\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.056324 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.056296    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.056393 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.056320    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt5lt\" (UniqueName: \"kubernetes.io/projected/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-kube-api-access-pt5lt\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.056393 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.056387    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-node-exporter-wtmp\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.064832 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.064796    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-22vlz" podStartSLOduration=67.183783509 podStartE2EDuration="1m12.064783264s" totalImagesPullingTime="4.880999755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:12:01.06396198 +0000 UTC m=+71.867944983" watchObservedRunningTime="2026-09-09 14:12:01.064783264 +0000 UTC m=+71.868766266"
Sep 09 14:12:01.083766 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.083726    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bnc5m" podStartSLOduration=67.512283523 podStartE2EDuration="1m12.083717242s" totalImagesPullingTime="4.571433719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:12:01.082930764 +0000 UTC m=+71.886913768" watchObservedRunningTime="2026-09-09 14:12:01.083717242 +0000 UTC m=+71.887700246"
Sep 09 14:12:01.157106 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.157043    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-node-exporter-wtmp\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.157106 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.157093    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-node-exporter-textfile\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.157266 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.157108    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-node-exporter-tls\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.157266 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.157128    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-root\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.157266 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.157231    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-node-exporter-wtmp\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.157412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.157266    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-root\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.157412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.157295    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-node-exporter-accelerators-collector-config\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.157412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.157337    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-sys\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.157412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.157364    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-metrics-client-ca\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.157412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.157399    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.157663 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.157401    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-sys\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.157663 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.157469    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-node-exporter-textfile\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.157663 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.157511    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt5lt\" (UniqueName: \"kubernetes.io/projected/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-kube-api-access-pt5lt\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.157897 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.157875    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-node-exporter-accelerators-collector-config\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.158021 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.157997    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-metrics-client-ca\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.159662 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.159643    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-node-exporter-tls\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.159975 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.159955    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.164992 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.164967    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt5lt\" (UniqueName: \"kubernetes.io/projected/388f24a1-da1a-4e04-96a2-9e4d9df31b2f-kube-api-access-pt5lt\") pod \"node-exporter-c8vkw\" (UID: \"388f24a1-da1a-4e04-96a2-9e4d9df31b2f\") " pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.200974 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:01.200955    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c8vkw"
Sep 09 14:12:01.213192 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:12:01.213171    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388f24a1_da1a_4e04_96a2_9e4d9df31b2f.slice/crio-4faa8dc8a715726f0412723d0a5c9fbfaca3cc9a11ab560c88ae0549afd49dba WatchSource:0}: Error finding container 4faa8dc8a715726f0412723d0a5c9fbfaca3cc9a11ab560c88ae0549afd49dba: Status 404 returned error can't find the container with id 4faa8dc8a715726f0412723d0a5c9fbfaca3cc9a11ab560c88ae0549afd49dba
Sep 09 14:12:02.057367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:02.057268    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c8vkw" event={"ID":"388f24a1-da1a-4e04-96a2-9e4d9df31b2f","Type":"ContainerStarted","Data":"4faa8dc8a715726f0412723d0a5c9fbfaca3cc9a11ab560c88ae0549afd49dba"}
Sep 09 14:12:03.062221 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:03.062190    2553 generic.go:356] "Generic (PLEG): container finished" podID="388f24a1-da1a-4e04-96a2-9e4d9df31b2f" containerID="ca0bf19e8628064086a15c960b4b337c5fe5e862c4d0bbf29ee0d585afece80b" exitCode=0
Sep 09 14:12:03.062698 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:03.062227    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c8vkw" event={"ID":"388f24a1-da1a-4e04-96a2-9e4d9df31b2f","Type":"ContainerDied","Data":"ca0bf19e8628064086a15c960b4b337c5fe5e862c4d0bbf29ee0d585afece80b"}
Sep 09 14:12:04.068580 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:04.068531    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c8vkw" event={"ID":"388f24a1-da1a-4e04-96a2-9e4d9df31b2f","Type":"ContainerStarted","Data":"f2f8e3b796c0c28f45dcc482e0c69668aa59402c1375fe53adeb834bfa43db7a"}
Sep 09 14:12:04.069028 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:04.068605    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c8vkw" event={"ID":"388f24a1-da1a-4e04-96a2-9e4d9df31b2f","Type":"ContainerStarted","Data":"3913a8924aa8b1cd6df029fe3c4d20392fd5912d4462525e15febac66bad0330"}
Sep 09 14:12:04.091517 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:04.091458    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c8vkw" podStartSLOduration=2.785362116 podStartE2EDuration="4.091438702s" totalImagesPullingTime="1.245293917s" totalInitContainerRuntime="60.782669ms" isStatefulPod=true podCreationTimestamp="2026-09-09 14:12:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:12:04.090210331 +0000 UTC m=+74.894193334" watchObservedRunningTime="2026-09-09 14:12:04.091438702 +0000 UTC m=+74.895421706"
Sep 09 14:12:08.064118 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:08.064078    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:12:09.997381 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:09.997347    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c5b5f6b4c-5fmdx"
Sep 09 14:12:13.078037 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.077909    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz" podUID="2095df4f-d54b-4960-849c-3c43b4413516" containerName="registry" containerID="cri-o://da58f288ab4afbc729869ff50f5dd192173750246b349bdfe7e32b3dfd356246" gracePeriod=30
Sep 09 14:12:13.312685 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.312659    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:12:13.443546 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.443522    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-bound-sa-token\") pod \"2095df4f-d54b-4960-849c-3c43b4413516\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") "
Sep 09 14:12:13.443666 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.443583    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls\") pod \"2095df4f-d54b-4960-849c-3c43b4413516\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") "
Sep 09 14:12:13.443666 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.443613    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2095df4f-d54b-4960-849c-3c43b4413516-image-registry-private-configuration\") pod \"2095df4f-d54b-4960-849c-3c43b4413516\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") "
Sep 09 14:12:13.443666 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.443631    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2095df4f-d54b-4960-849c-3c43b4413516-installation-pull-secrets\") pod \"2095df4f-d54b-4960-849c-3c43b4413516\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") "
Sep 09 14:12:13.443666 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.443650    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2095df4f-d54b-4960-849c-3c43b4413516-trusted-ca\") pod \"2095df4f-d54b-4960-849c-3c43b4413516\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") "
Sep 09 14:12:13.443666 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.443665    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps54l\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-kube-api-access-ps54l\") pod \"2095df4f-d54b-4960-849c-3c43b4413516\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") "
Sep 09 14:12:13.443885 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.443697    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2095df4f-d54b-4960-849c-3c43b4413516-registry-certificates\") pod \"2095df4f-d54b-4960-849c-3c43b4413516\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") "
Sep 09 14:12:13.443885 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.443740    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2095df4f-d54b-4960-849c-3c43b4413516-ca-trust-extracted\") pod \"2095df4f-d54b-4960-849c-3c43b4413516\" (UID: \"2095df4f-d54b-4960-849c-3c43b4413516\") "
Sep 09 14:12:13.444282 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.444225    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2095df4f-d54b-4960-849c-3c43b4413516-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2095df4f-d54b-4960-849c-3c43b4413516" (UID: "2095df4f-d54b-4960-849c-3c43b4413516"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:12:13.444397 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.444331    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2095df4f-d54b-4960-849c-3c43b4413516-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2095df4f-d54b-4960-849c-3c43b4413516" (UID: "2095df4f-d54b-4960-849c-3c43b4413516"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:12:13.446107 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.446082    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2095df4f-d54b-4960-849c-3c43b4413516-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2095df4f-d54b-4960-849c-3c43b4413516" (UID: "2095df4f-d54b-4960-849c-3c43b4413516"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:12:13.446235 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.446213    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2095df4f-d54b-4960-849c-3c43b4413516" (UID: "2095df4f-d54b-4960-849c-3c43b4413516"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:12:13.446319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.446295    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2095df4f-d54b-4960-849c-3c43b4413516" (UID: "2095df4f-d54b-4960-849c-3c43b4413516"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:12:13.446387 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.446370    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2095df4f-d54b-4960-849c-3c43b4413516-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2095df4f-d54b-4960-849c-3c43b4413516" (UID: "2095df4f-d54b-4960-849c-3c43b4413516"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:12:13.446432 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.446365    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-kube-api-access-ps54l" (OuterVolumeSpecName: "kube-api-access-ps54l") pod "2095df4f-d54b-4960-849c-3c43b4413516" (UID: "2095df4f-d54b-4960-849c-3c43b4413516"). InnerVolumeSpecName "kube-api-access-ps54l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:12:13.452383 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.452362    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2095df4f-d54b-4960-849c-3c43b4413516-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2095df4f-d54b-4960-849c-3c43b4413516" (UID: "2095df4f-d54b-4960-849c-3c43b4413516"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:12:13.544375 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.544341    2553 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2095df4f-d54b-4960-849c-3c43b4413516-installation-pull-secrets\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:12:13.544375 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.544370    2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2095df4f-d54b-4960-849c-3c43b4413516-trusted-ca\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:12:13.544533 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.544384    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps54l\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-kube-api-access-ps54l\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:12:13.544533 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.544396    2553 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2095df4f-d54b-4960-849c-3c43b4413516-registry-certificates\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:12:13.544533 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.544408    2553 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2095df4f-d54b-4960-849c-3c43b4413516-ca-trust-extracted\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:12:13.544533 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.544418    2553 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-bound-sa-token\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:12:13.544533 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.544429    2553 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2095df4f-d54b-4960-849c-3c43b4413516-registry-tls\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:12:13.544533 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:13.544442    2553 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2095df4f-d54b-4960-849c-3c43b4413516-image-registry-private-configuration\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:12:14.102546 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:14.102507    2553 generic.go:356] "Generic (PLEG): container finished" podID="2095df4f-d54b-4960-849c-3c43b4413516" containerID="da58f288ab4afbc729869ff50f5dd192173750246b349bdfe7e32b3dfd356246" exitCode=0
Sep 09 14:12:14.102909 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:14.102554    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"
Sep 09 14:12:14.102909 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:14.102596    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz" event={"ID":"2095df4f-d54b-4960-849c-3c43b4413516","Type":"ContainerDied","Data":"da58f288ab4afbc729869ff50f5dd192173750246b349bdfe7e32b3dfd356246"}
Sep 09 14:12:14.102909 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:14.102652    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz" event={"ID":"2095df4f-d54b-4960-849c-3c43b4413516","Type":"ContainerDied","Data":"4469f7129827b13ee517fe4ea8bc48af16c76f3ac3973a02e94ec2ee4f3f2337"}
Sep 09 14:12:14.102909 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:14.102672    2553 scope.go:117] "RemoveContainer" containerID="da58f288ab4afbc729869ff50f5dd192173750246b349bdfe7e32b3dfd356246"
Sep 09 14:12:14.111831 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:14.111401    2553 scope.go:117] "RemoveContainer" containerID="da58f288ab4afbc729869ff50f5dd192173750246b349bdfe7e32b3dfd356246"
Sep 09 14:12:14.112281 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:12:14.112260    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da58f288ab4afbc729869ff50f5dd192173750246b349bdfe7e32b3dfd356246\": container with ID starting with da58f288ab4afbc729869ff50f5dd192173750246b349bdfe7e32b3dfd356246 not found: ID does not exist" containerID="da58f288ab4afbc729869ff50f5dd192173750246b349bdfe7e32b3dfd356246"
Sep 09 14:12:14.112341 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:14.112289    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da58f288ab4afbc729869ff50f5dd192173750246b349bdfe7e32b3dfd356246"} err="failed to get container status \"da58f288ab4afbc729869ff50f5dd192173750246b349bdfe7e32b3dfd356246\": rpc error: code = NotFound desc = could not find container \"da58f288ab4afbc729869ff50f5dd192173750246b349bdfe7e32b3dfd356246\": container with ID starting with da58f288ab4afbc729869ff50f5dd192173750246b349bdfe7e32b3dfd356246 not found: ID does not exist"
Sep 09 14:12:14.119857 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:14.119835    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"]
Sep 09 14:12:14.125315 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:14.125298    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f4bbd9dd6-lhgzz"]
Sep 09 14:12:15.644495 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:15.644455    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2095df4f-d54b-4960-849c-3c43b4413516" path="/var/lib/kubelet/pods/2095df4f-d54b-4960-849c-3c43b4413516/volumes"
Sep 09 14:12:32.059619 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:12:32.059585    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bnc5m"
Sep 09 14:15:05.353698 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.353659    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94"]
Sep 09 14:15:05.354168 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.353899    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2095df4f-d54b-4960-849c-3c43b4413516" containerName="registry"
Sep 09 14:15:05.354168 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.353909    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2095df4f-d54b-4960-849c-3c43b4413516" containerName="registry"
Sep 09 14:15:05.354168 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.353949    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="2095df4f-d54b-4960-849c-3c43b4413516" containerName="registry"
Sep 09 14:15:05.356417 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.356399    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94"
Sep 09 14:15:05.358756 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.358734    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 14:15:05.358756 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.358734    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 14:15:05.359740 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.359721    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tpr4d\""
Sep 09 14:15:05.367230 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.367207    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94"]
Sep 09 14:15:05.405938 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.405901    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94\" (UID: \"34775ca3-716c-4a2d-8245-5a0b9fd88c7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94"
Sep 09 14:15:05.405938 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.405952    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpclm\" (UniqueName: \"kubernetes.io/projected/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-kube-api-access-kpclm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94\" (UID: \"34775ca3-716c-4a2d-8245-5a0b9fd88c7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94"
Sep 09 14:15:05.406148 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.406000    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94\" (UID: \"34775ca3-716c-4a2d-8245-5a0b9fd88c7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94"
Sep 09 14:15:05.507093 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.507044    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94\" (UID: \"34775ca3-716c-4a2d-8245-5a0b9fd88c7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94"
Sep 09 14:15:05.507239 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.507115    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpclm\" (UniqueName: \"kubernetes.io/projected/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-kube-api-access-kpclm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94\" (UID: \"34775ca3-716c-4a2d-8245-5a0b9fd88c7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94"
Sep 09 14:15:05.507239 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.507155    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94\" (UID: \"34775ca3-716c-4a2d-8245-5a0b9fd88c7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94"
Sep 09 14:15:05.507527 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.507504    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94\" (UID: \"34775ca3-716c-4a2d-8245-5a0b9fd88c7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94"
Sep 09 14:15:05.507527 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.507520    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94\" (UID: \"34775ca3-716c-4a2d-8245-5a0b9fd88c7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94"
Sep 09 14:15:05.515451 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.515416    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpclm\" (UniqueName: \"kubernetes.io/projected/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-kube-api-access-kpclm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94\" (UID: \"34775ca3-716c-4a2d-8245-5a0b9fd88c7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94"
Sep 09 14:15:05.664742 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.664655    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94"
Sep 09 14:15:05.930075 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:05.929997    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94"]
Sep 09 14:15:05.932904 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:15:05.932874    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34775ca3_716c_4a2d_8245_5a0b9fd88c7a.slice/crio-2a0e583a1f784e2bcf16b26f31decfe18e162dc66fdb7a4de0293d0f9c7520f4 WatchSource:0}: Error finding container 2a0e583a1f784e2bcf16b26f31decfe18e162dc66fdb7a4de0293d0f9c7520f4: Status 404 returned error can't find the container with id 2a0e583a1f784e2bcf16b26f31decfe18e162dc66fdb7a4de0293d0f9c7520f4
Sep 09 14:15:06.656656 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:06.656613    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94" event={"ID":"34775ca3-716c-4a2d-8245-5a0b9fd88c7a","Type":"ContainerStarted","Data":"2a0e583a1f784e2bcf16b26f31decfe18e162dc66fdb7a4de0293d0f9c7520f4"}
Sep 09 14:15:13.682418 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:13.682380    2553 generic.go:356] "Generic (PLEG): container finished" podID="34775ca3-716c-4a2d-8245-5a0b9fd88c7a" containerID="39d485af4f0af12dd30234d9d186e9a00e7829b6d99e896b27a5fc04be78f734" exitCode=0
Sep 09 14:15:13.682869 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:13.682440    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94" event={"ID":"34775ca3-716c-4a2d-8245-5a0b9fd88c7a","Type":"ContainerDied","Data":"39d485af4f0af12dd30234d9d186e9a00e7829b6d99e896b27a5fc04be78f734"}
Sep 09 14:15:16.693392 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:16.693355    2553 generic.go:356] "Generic (PLEG): container finished" podID="34775ca3-716c-4a2d-8245-5a0b9fd88c7a" containerID="510b51ca803f130691405a7c6d7eaf408fee10199a60b9f62110b5f48bac5df5" exitCode=0
Sep 09 14:15:16.693880 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:16.693443    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94" event={"ID":"34775ca3-716c-4a2d-8245-5a0b9fd88c7a","Type":"ContainerDied","Data":"510b51ca803f130691405a7c6d7eaf408fee10199a60b9f62110b5f48bac5df5"}
Sep 09 14:15:24.722378 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:24.722339    2553 generic.go:356] "Generic (PLEG): container finished" podID="34775ca3-716c-4a2d-8245-5a0b9fd88c7a" containerID="0bd2ae9195f29031c8a79d2df022668e6dff1356b992039476bed6591e7d9553" exitCode=0
Sep 09 14:15:24.722751 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:24.722423    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94" event={"ID":"34775ca3-716c-4a2d-8245-5a0b9fd88c7a","Type":"ContainerDied","Data":"0bd2ae9195f29031c8a79d2df022668e6dff1356b992039476bed6591e7d9553"}
Sep 09 14:15:25.843352 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:25.843328    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94"
Sep 09 14:15:25.966751 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:25.966719    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpclm\" (UniqueName: \"kubernetes.io/projected/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-kube-api-access-kpclm\") pod \"34775ca3-716c-4a2d-8245-5a0b9fd88c7a\" (UID: \"34775ca3-716c-4a2d-8245-5a0b9fd88c7a\") "
Sep 09 14:15:25.966905 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:25.966761    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-bundle\") pod \"34775ca3-716c-4a2d-8245-5a0b9fd88c7a\" (UID: \"34775ca3-716c-4a2d-8245-5a0b9fd88c7a\") "
Sep 09 14:15:25.966905 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:25.966815    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-util\") pod \"34775ca3-716c-4a2d-8245-5a0b9fd88c7a\" (UID: \"34775ca3-716c-4a2d-8245-5a0b9fd88c7a\") "
Sep 09 14:15:25.967156 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:25.967135    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-bundle" (OuterVolumeSpecName: "bundle") pod "34775ca3-716c-4a2d-8245-5a0b9fd88c7a" (UID: "34775ca3-716c-4a2d-8245-5a0b9fd88c7a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:15:25.971361 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:25.971327    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-kube-api-access-kpclm" (OuterVolumeSpecName: "kube-api-access-kpclm") pod "34775ca3-716c-4a2d-8245-5a0b9fd88c7a" (UID: "34775ca3-716c-4a2d-8245-5a0b9fd88c7a"). InnerVolumeSpecName "kube-api-access-kpclm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:15:25.972850 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:25.972820    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-util" (OuterVolumeSpecName: "util") pod "34775ca3-716c-4a2d-8245-5a0b9fd88c7a" (UID: "34775ca3-716c-4a2d-8245-5a0b9fd88c7a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:15:26.068180 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:26.068118    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-bundle\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:15:26.068180 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:26.068138    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-util\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:15:26.068180 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:26.068148    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpclm\" (UniqueName: \"kubernetes.io/projected/34775ca3-716c-4a2d-8245-5a0b9fd88c7a-kube-api-access-kpclm\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:15:26.730200 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:26.730173    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94"
Sep 09 14:15:26.730397 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:26.730176    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfm94" event={"ID":"34775ca3-716c-4a2d-8245-5a0b9fd88c7a","Type":"ContainerDied","Data":"2a0e583a1f784e2bcf16b26f31decfe18e162dc66fdb7a4de0293d0f9c7520f4"}
Sep 09 14:15:26.730397 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:26.730290    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a0e583a1f784e2bcf16b26f31decfe18e162dc66fdb7a4de0293d0f9c7520f4"
Sep 09 14:15:31.058404 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.058370    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vdpwf"]
Sep 09 14:15:31.058850 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.058601    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34775ca3-716c-4a2d-8245-5a0b9fd88c7a" containerName="pull"
Sep 09 14:15:31.058850 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.058612    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="34775ca3-716c-4a2d-8245-5a0b9fd88c7a" containerName="pull"
Sep 09 14:15:31.058850 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.058627    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34775ca3-716c-4a2d-8245-5a0b9fd88c7a" containerName="util"
Sep 09 14:15:31.058850 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.058632    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="34775ca3-716c-4a2d-8245-5a0b9fd88c7a" containerName="util"
Sep 09 14:15:31.058850 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.058641    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34775ca3-716c-4a2d-8245-5a0b9fd88c7a" containerName="extract"
Sep 09 14:15:31.058850 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.058646    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="34775ca3-716c-4a2d-8245-5a0b9fd88c7a" containerName="extract"
Sep 09 14:15:31.058850 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.058685    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="34775ca3-716c-4a2d-8245-5a0b9fd88c7a" containerName="extract"
Sep 09 14:15:31.065148 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.065122    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vdpwf"
Sep 09 14:15:31.067425 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.067395    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 14:15:31.068032 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.068010    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-jw7fl\""
Sep 09 14:15:31.068144 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.068039    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 14:15:31.073955 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.073937    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vdpwf"]
Sep 09 14:15:31.206100 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.206071    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fccf0af8-0396-417d-9006-6489beddc585-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vdpwf\" (UID: \"fccf0af8-0396-417d-9006-6489beddc585\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vdpwf"
Sep 09 14:15:31.206265 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.206108    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55hzw\" (UniqueName: \"kubernetes.io/projected/fccf0af8-0396-417d-9006-6489beddc585-kube-api-access-55hzw\") pod \"openshift-lws-operator-fd8ccff4c-vdpwf\" (UID: \"fccf0af8-0396-417d-9006-6489beddc585\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vdpwf"
Sep 09 14:15:31.306868 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.306836    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fccf0af8-0396-417d-9006-6489beddc585-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vdpwf\" (UID: \"fccf0af8-0396-417d-9006-6489beddc585\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vdpwf"
Sep 09 14:15:31.307012 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.306875    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55hzw\" (UniqueName: \"kubernetes.io/projected/fccf0af8-0396-417d-9006-6489beddc585-kube-api-access-55hzw\") pod \"openshift-lws-operator-fd8ccff4c-vdpwf\" (UID: \"fccf0af8-0396-417d-9006-6489beddc585\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vdpwf"
Sep 09 14:15:31.307203 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.307185    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fccf0af8-0396-417d-9006-6489beddc585-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vdpwf\" (UID: \"fccf0af8-0396-417d-9006-6489beddc585\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vdpwf"
Sep 09 14:15:31.314510 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.314458    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55hzw\" (UniqueName: \"kubernetes.io/projected/fccf0af8-0396-417d-9006-6489beddc585-kube-api-access-55hzw\") pod \"openshift-lws-operator-fd8ccff4c-vdpwf\" (UID: \"fccf0af8-0396-417d-9006-6489beddc585\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vdpwf"
Sep 09 14:15:31.374125 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.374102    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vdpwf"
Sep 09 14:15:31.643264 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:15:31.643236    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfccf0af8_0396_417d_9006_6489beddc585.slice/crio-681e15ead83247100788f83e15282556521321de9b35f98441b103a461089915 WatchSource:0}: Error finding container 681e15ead83247100788f83e15282556521321de9b35f98441b103a461089915: Status 404 returned error can't find the container with id 681e15ead83247100788f83e15282556521321de9b35f98441b103a461089915
Sep 09 14:15:31.645664 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.645637    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vdpwf"]
Sep 09 14:15:31.746926 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:31.746894    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vdpwf" event={"ID":"fccf0af8-0396-417d-9006-6489beddc585","Type":"ContainerStarted","Data":"681e15ead83247100788f83e15282556521321de9b35f98441b103a461089915"}
Sep 09 14:15:34.760185 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:34.760147    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vdpwf" event={"ID":"fccf0af8-0396-417d-9006-6489beddc585","Type":"ContainerStarted","Data":"3bfc2f3600b49c1a8a0f3f4e367a693893628359203c5d87a100bfe2ac305a0b"}
Sep 09 14:15:34.776191 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:34.776140    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vdpwf" podStartSLOduration=1.711706046 podStartE2EDuration="3.776124186s" totalImagesPullingTime="2.06441814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:15:34.775843802 +0000 UTC m=+285.579826804" watchObservedRunningTime="2026-09-09 14:15:34.776124186 +0000 UTC m=+285.580107195"
Sep 09 14:15:49.603930 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:49.603895    2553 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 14:15:54.329386 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.329354    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"]
Sep 09 14:15:54.337335 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.337309    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.341001 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.340983    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 14:15:54.341325 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.341308    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 14:15:54.341597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.341579    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6nlw9\""
Sep 09 14:15:54.341651 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.341596    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 14:15:54.341702 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.341579    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 14:15:54.348711 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.348690    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"]
Sep 09 14:15:54.363553 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.363531    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7f968c7a-a31e-4e9d-b89f-5060e272709b-manifests\") pod \"opendatahub-operator-controller-manager-686db84dc8-rl28t\" (UID: \"7f968c7a-a31e-4e9d-b89f-5060e272709b\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.363668 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.363583    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f968c7a-a31e-4e9d-b89f-5060e272709b-tmp\") pod \"opendatahub-operator-controller-manager-686db84dc8-rl28t\" (UID: \"7f968c7a-a31e-4e9d-b89f-5060e272709b\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.363668 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.363602    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spclw\" (UniqueName: \"kubernetes.io/projected/7f968c7a-a31e-4e9d-b89f-5060e272709b-kube-api-access-spclw\") pod \"opendatahub-operator-controller-manager-686db84dc8-rl28t\" (UID: \"7f968c7a-a31e-4e9d-b89f-5060e272709b\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.363774 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.363667    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f968c7a-a31e-4e9d-b89f-5060e272709b-webhook-cert\") pod \"opendatahub-operator-controller-manager-686db84dc8-rl28t\" (UID: \"7f968c7a-a31e-4e9d-b89f-5060e272709b\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.363774 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.363707    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f968c7a-a31e-4e9d-b89f-5060e272709b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-686db84dc8-rl28t\" (UID: \"7f968c7a-a31e-4e9d-b89f-5060e272709b\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.464620 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.464598    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7f968c7a-a31e-4e9d-b89f-5060e272709b-manifests\") pod \"opendatahub-operator-controller-manager-686db84dc8-rl28t\" (UID: \"7f968c7a-a31e-4e9d-b89f-5060e272709b\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.464751 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.464644    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f968c7a-a31e-4e9d-b89f-5060e272709b-tmp\") pod \"opendatahub-operator-controller-manager-686db84dc8-rl28t\" (UID: \"7f968c7a-a31e-4e9d-b89f-5060e272709b\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.464751 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.464664    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spclw\" (UniqueName: \"kubernetes.io/projected/7f968c7a-a31e-4e9d-b89f-5060e272709b-kube-api-access-spclw\") pod \"opendatahub-operator-controller-manager-686db84dc8-rl28t\" (UID: \"7f968c7a-a31e-4e9d-b89f-5060e272709b\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.464751 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.464692    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f968c7a-a31e-4e9d-b89f-5060e272709b-webhook-cert\") pod \"opendatahub-operator-controller-manager-686db84dc8-rl28t\" (UID: \"7f968c7a-a31e-4e9d-b89f-5060e272709b\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.464751 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.464711    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f968c7a-a31e-4e9d-b89f-5060e272709b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-686db84dc8-rl28t\" (UID: \"7f968c7a-a31e-4e9d-b89f-5060e272709b\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.465030 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.465007    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7f968c7a-a31e-4e9d-b89f-5060e272709b-manifests\") pod \"opendatahub-operator-controller-manager-686db84dc8-rl28t\" (UID: \"7f968c7a-a31e-4e9d-b89f-5060e272709b\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.466931 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.466910    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f968c7a-a31e-4e9d-b89f-5060e272709b-tmp\") pod \"opendatahub-operator-controller-manager-686db84dc8-rl28t\" (UID: \"7f968c7a-a31e-4e9d-b89f-5060e272709b\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.467056 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.467040    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f968c7a-a31e-4e9d-b89f-5060e272709b-webhook-cert\") pod \"opendatahub-operator-controller-manager-686db84dc8-rl28t\" (UID: \"7f968c7a-a31e-4e9d-b89f-5060e272709b\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.467175 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.467159    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f968c7a-a31e-4e9d-b89f-5060e272709b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-686db84dc8-rl28t\" (UID: \"7f968c7a-a31e-4e9d-b89f-5060e272709b\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.476394 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.476371    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spclw\" (UniqueName: \"kubernetes.io/projected/7f968c7a-a31e-4e9d-b89f-5060e272709b-kube-api-access-spclw\") pod \"opendatahub-operator-controller-manager-686db84dc8-rl28t\" (UID: \"7f968c7a-a31e-4e9d-b89f-5060e272709b\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.646457 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.646396    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:15:54.928356 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.928284    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"]
Sep 09 14:15:54.931230 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:15:54.931210    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f968c7a_a31e_4e9d_b89f_5060e272709b.slice/crio-f6755faddf034eddd17c9bbffe38376deba7813dd8058c0e25b52acc99823b44 WatchSource:0}: Error finding container f6755faddf034eddd17c9bbffe38376deba7813dd8058c0e25b52acc99823b44: Status 404 returned error can't find the container with id f6755faddf034eddd17c9bbffe38376deba7813dd8058c0e25b52acc99823b44
Sep 09 14:15:54.933224 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:54.933205    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 14:15:55.836942 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:55.836901    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t" event={"ID":"7f968c7a-a31e-4e9d-b89f-5060e272709b","Type":"ContainerStarted","Data":"f6755faddf034eddd17c9bbffe38376deba7813dd8058c0e25b52acc99823b44"}
Sep 09 14:15:58.850284 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:58.850214    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t" event={"ID":"7f968c7a-a31e-4e9d-b89f-5060e272709b","Type":"ContainerStarted","Data":"e0d7524e106811936019575967d34b8559c68e04b5593c51dc9507798dae3cb3"}
Sep 09 14:15:59.855340 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:59.855303    2553 generic.go:356] "Generic (PLEG): container finished" podID="7f968c7a-a31e-4e9d-b89f-5060e272709b" containerID="e0d7524e106811936019575967d34b8559c68e04b5593c51dc9507798dae3cb3" exitCode=0
Sep 09 14:15:59.855781 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:15:59.855402    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t" event={"ID":"7f968c7a-a31e-4e9d-b89f-5060e272709b","Type":"ContainerDied","Data":"e0d7524e106811936019575967d34b8559c68e04b5593c51dc9507798dae3cb3"}
Sep 09 14:16:00.860455 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:00.860422    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t" event={"ID":"7f968c7a-a31e-4e9d-b89f-5060e272709b","Type":"ContainerStarted","Data":"06692d0757c643f70f69f98b936d32330bec9bcd8d5717587ffb093e6f7684e3"}
Sep 09 14:16:00.860851 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:00.860531    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:16:00.882465 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:00.882401    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t" podStartSLOduration=1.9301209849999998 podStartE2EDuration="6.882389s" totalImagesPullingTime="3.917671251s" totalInitContainerRuntime="1.034596764s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:15:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:16:00.881444051 +0000 UTC m=+311.685427054" watchObservedRunningTime="2026-09-09 14:16:00.882389 +0000 UTC m=+311.686372004"
Sep 09 14:16:11.867016 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:11.866983    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-rl28t"
Sep 09 14:16:13.751241 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.751204    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn"]
Sep 09 14:16:13.753839 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.753822    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn"
Sep 09 14:16:13.756121 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.756095    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 14:16:13.756236 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.756151    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 14:16:13.756236 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.756156    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 09 14:16:13.756828 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.756801    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 14:16:13.756921 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.756872    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xhdmz\""
Sep 09 14:16:13.796799 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.796764    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn"]
Sep 09 14:16:13.801841 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.801819    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g25gz\" (UniqueName: \"kubernetes.io/projected/bb6c11bd-3304-43ed-8f01-c9cd8f701cb2-kube-api-access-g25gz\") pod \"kube-auth-proxy-6dd84d6f45-tskfn\" (UID: \"bb6c11bd-3304-43ed-8f01-c9cd8f701cb2\") " pod="openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn"
Sep 09 14:16:13.801946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.801849    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb6c11bd-3304-43ed-8f01-c9cd8f701cb2-tls-certs\") pod \"kube-auth-proxy-6dd84d6f45-tskfn\" (UID: \"bb6c11bd-3304-43ed-8f01-c9cd8f701cb2\") " pod="openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn"
Sep 09 14:16:13.801946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.801868    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb6c11bd-3304-43ed-8f01-c9cd8f701cb2-tmp\") pod \"kube-auth-proxy-6dd84d6f45-tskfn\" (UID: \"bb6c11bd-3304-43ed-8f01-c9cd8f701cb2\") " pod="openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn"
Sep 09 14:16:13.903280 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.903250    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g25gz\" (UniqueName: \"kubernetes.io/projected/bb6c11bd-3304-43ed-8f01-c9cd8f701cb2-kube-api-access-g25gz\") pod \"kube-auth-proxy-6dd84d6f45-tskfn\" (UID: \"bb6c11bd-3304-43ed-8f01-c9cd8f701cb2\") " pod="openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn"
Sep 09 14:16:13.903431 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.903284    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb6c11bd-3304-43ed-8f01-c9cd8f701cb2-tls-certs\") pod \"kube-auth-proxy-6dd84d6f45-tskfn\" (UID: \"bb6c11bd-3304-43ed-8f01-c9cd8f701cb2\") " pod="openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn"
Sep 09 14:16:13.903431 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.903304    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb6c11bd-3304-43ed-8f01-c9cd8f701cb2-tmp\") pod \"kube-auth-proxy-6dd84d6f45-tskfn\" (UID: \"bb6c11bd-3304-43ed-8f01-c9cd8f701cb2\") " pod="openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn"
Sep 09 14:16:13.905865 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.905842    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb6c11bd-3304-43ed-8f01-c9cd8f701cb2-tmp\") pod \"kube-auth-proxy-6dd84d6f45-tskfn\" (UID: \"bb6c11bd-3304-43ed-8f01-c9cd8f701cb2\") " pod="openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn"
Sep 09 14:16:13.905974 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.905948    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb6c11bd-3304-43ed-8f01-c9cd8f701cb2-tls-certs\") pod \"kube-auth-proxy-6dd84d6f45-tskfn\" (UID: \"bb6c11bd-3304-43ed-8f01-c9cd8f701cb2\") " pod="openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn"
Sep 09 14:16:13.911014 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:13.910989    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g25gz\" (UniqueName: \"kubernetes.io/projected/bb6c11bd-3304-43ed-8f01-c9cd8f701cb2-kube-api-access-g25gz\") pod \"kube-auth-proxy-6dd84d6f45-tskfn\" (UID: \"bb6c11bd-3304-43ed-8f01-c9cd8f701cb2\") " pod="openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn"
Sep 09 14:16:14.063099 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:14.063028    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn"
Sep 09 14:16:14.329831 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:14.329766    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn"]
Sep 09 14:16:14.332616 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:16:14.332587    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb6c11bd_3304_43ed_8f01_c9cd8f701cb2.slice/crio-bda4ecb9031d45520d0eb6e469c5a27fe6134faa44ca4599ac9dd009690fa8b9 WatchSource:0}: Error finding container bda4ecb9031d45520d0eb6e469c5a27fe6134faa44ca4599ac9dd009690fa8b9: Status 404 returned error can't find the container with id bda4ecb9031d45520d0eb6e469c5a27fe6134faa44ca4599ac9dd009690fa8b9
Sep 09 14:16:14.911314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:14.911261    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn" event={"ID":"bb6c11bd-3304-43ed-8f01-c9cd8f701cb2","Type":"ContainerStarted","Data":"bda4ecb9031d45520d0eb6e469c5a27fe6134faa44ca4599ac9dd009690fa8b9"}
Sep 09 14:16:15.121290 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.121172    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"]
Sep 09 14:16:15.124366 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.124339    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.127078 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.126999    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 09 14:16:15.127078 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.127012    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 14:16:15.127078 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.127046    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 09 14:16:15.127310 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.127006    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 09 14:16:15.127419 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.127341    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-n9km8\""
Sep 09 14:16:15.138695 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.138670    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"]
Sep 09 14:16:15.211323 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.211294    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.211468 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.211343    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.211468 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.211391    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.211468 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.211420    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtj5p\" (UniqueName: \"kubernetes.io/projected/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-kube-api-access-xtj5p\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.211468 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.211461    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.211717 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.211495    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.211717 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.211519    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.312535 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.311984    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.312535 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.312031    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtj5p\" (UniqueName: \"kubernetes.io/projected/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-kube-api-access-xtj5p\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.312535 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.312075    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.312535 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.312111    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.312535 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.312134    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.312535 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.312180    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.312535 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.312214    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.312976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.312683    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.315187 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.315164    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.315289 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.315221    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.315289 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.315222    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.315525 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.315506    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.320693 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.320650    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.321413 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.321391    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtj5p\" (UniqueName: \"kubernetes.io/projected/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-kube-api-access-xtj5p\") pod \"istiod-openshift-gateway-7b7995d5cd-5pv7w\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.437814 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.437775    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:15.740145 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.740108    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"]
Sep 09 14:16:15.743030 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:16:15.742994    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c9f2aba_1e1d_4684_8f1e_02a901f3aae9.slice/crio-4c066fcf2b1f1e35684343f07e8f6be0155669f3c72332213792279f4b382c51 WatchSource:0}: Error finding container 4c066fcf2b1f1e35684343f07e8f6be0155669f3c72332213792279f4b382c51: Status 404 returned error can't find the container with id 4c066fcf2b1f1e35684343f07e8f6be0155669f3c72332213792279f4b382c51
Sep 09 14:16:15.917497 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:15.917450    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w" event={"ID":"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9","Type":"ContainerStarted","Data":"4c066fcf2b1f1e35684343f07e8f6be0155669f3c72332213792279f4b382c51"}
Sep 09 14:16:17.927754 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:17.927719    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn" event={"ID":"bb6c11bd-3304-43ed-8f01-c9cd8f701cb2","Type":"ContainerStarted","Data":"b6ae9047c1a5bce57dea6c9a08dca0d0d918003439b8f3076054ac522f499bd7"}
Sep 09 14:16:17.944824 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:17.944770    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6dd84d6f45-tskfn" podStartSLOduration=1.885063495 podStartE2EDuration="4.944753295s" totalImagesPullingTime="3.0596898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:16:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:16:17.944342705 +0000 UTC m=+328.748325709" watchObservedRunningTime="2026-09-09 14:16:17.944753295 +0000 UTC m=+328.748736299"
Sep 09 14:16:19.531113 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:19.531072    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:16:19.531469 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:19.531157    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:16:19.937875 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:19.937796    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w" event={"ID":"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9","Type":"ContainerStarted","Data":"27ba2d2f712ed03d2cf7f6c5970dc9a549c13a890270332d4945b5601532f314"}
Sep 09 14:16:19.938035 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:19.937885    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:19.969826 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:19.969779    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w" podStartSLOduration=1.183869452 podStartE2EDuration="4.969766417s" totalImagesPullingTime="3.785896965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:16:19.968608002 +0000 UTC m=+330.772591003" watchObservedRunningTime="2026-09-09 14:16:19.969766417 +0000 UTC m=+330.773749419"
Sep 09 14:16:20.943231 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:20.943203    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:24.483956 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:24.483922    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dk6hd"]
Sep 09 14:16:24.487181 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:24.487161    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dk6hd"
Sep 09 14:16:24.489425 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:24.489403    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 09 14:16:24.489582 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:24.489547    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-f2tlz\""
Sep 09 14:16:24.497512 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:24.497487    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dk6hd"]
Sep 09 14:16:24.586823 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:24.586790    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1e6084f-74a6-4dde-9d52-2540ef6c85f1-cert\") pod \"odh-model-controller-7998c67dc4-dk6hd\" (UID: \"c1e6084f-74a6-4dde-9d52-2540ef6c85f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-dk6hd"
Sep 09 14:16:24.586988 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:24.586831    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mglnv\" (UniqueName: \"kubernetes.io/projected/c1e6084f-74a6-4dde-9d52-2540ef6c85f1-kube-api-access-mglnv\") pod \"odh-model-controller-7998c67dc4-dk6hd\" (UID: \"c1e6084f-74a6-4dde-9d52-2540ef6c85f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-dk6hd"
Sep 09 14:16:24.687426 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:24.687395    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1e6084f-74a6-4dde-9d52-2540ef6c85f1-cert\") pod \"odh-model-controller-7998c67dc4-dk6hd\" (UID: \"c1e6084f-74a6-4dde-9d52-2540ef6c85f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-dk6hd"
Sep 09 14:16:24.687590 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:24.687432    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mglnv\" (UniqueName: \"kubernetes.io/projected/c1e6084f-74a6-4dde-9d52-2540ef6c85f1-kube-api-access-mglnv\") pod \"odh-model-controller-7998c67dc4-dk6hd\" (UID: \"c1e6084f-74a6-4dde-9d52-2540ef6c85f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-dk6hd"
Sep 09 14:16:24.687590 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:16:24.687546    2553 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 09 14:16:24.687683 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:16:24.687666    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1e6084f-74a6-4dde-9d52-2540ef6c85f1-cert podName:c1e6084f-74a6-4dde-9d52-2540ef6c85f1 nodeName:}" failed. No retries permitted until 2026-09-09 14:16:25.187650191 +0000 UTC m=+335.991633178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c1e6084f-74a6-4dde-9d52-2540ef6c85f1-cert") pod "odh-model-controller-7998c67dc4-dk6hd" (UID: "c1e6084f-74a6-4dde-9d52-2540ef6c85f1") : secret "odh-model-controller-webhook-cert" not found
Sep 09 14:16:24.696072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:24.696046    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mglnv\" (UniqueName: \"kubernetes.io/projected/c1e6084f-74a6-4dde-9d52-2540ef6c85f1-kube-api-access-mglnv\") pod \"odh-model-controller-7998c67dc4-dk6hd\" (UID: \"c1e6084f-74a6-4dde-9d52-2540ef6c85f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-dk6hd"
Sep 09 14:16:25.191007 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:25.190947    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1e6084f-74a6-4dde-9d52-2540ef6c85f1-cert\") pod \"odh-model-controller-7998c67dc4-dk6hd\" (UID: \"c1e6084f-74a6-4dde-9d52-2540ef6c85f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-dk6hd"
Sep 09 14:16:25.193311 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:25.193287    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1e6084f-74a6-4dde-9d52-2540ef6c85f1-cert\") pod \"odh-model-controller-7998c67dc4-dk6hd\" (UID: \"c1e6084f-74a6-4dde-9d52-2540ef6c85f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-dk6hd"
Sep 09 14:16:25.399515 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:25.399477    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dk6hd"
Sep 09 14:16:25.673229 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:25.673202    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dk6hd"]
Sep 09 14:16:25.676172 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:16:25.676143    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e6084f_74a6_4dde_9d52_2540ef6c85f1.slice/crio-f5aeda78c45b025984e59ca8f3bd36fdd032131e1b02815a0b3a75ad0b639bf0 WatchSource:0}: Error finding container f5aeda78c45b025984e59ca8f3bd36fdd032131e1b02815a0b3a75ad0b639bf0: Status 404 returned error can't find the container with id f5aeda78c45b025984e59ca8f3bd36fdd032131e1b02815a0b3a75ad0b639bf0
Sep 09 14:16:25.962696 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:25.962662    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dk6hd" event={"ID":"c1e6084f-74a6-4dde-9d52-2540ef6c85f1","Type":"ContainerStarted","Data":"f5aeda78c45b025984e59ca8f3bd36fdd032131e1b02815a0b3a75ad0b639bf0"}
Sep 09 14:16:28.976689 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:28.976593    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dk6hd" event={"ID":"c1e6084f-74a6-4dde-9d52-2540ef6c85f1","Type":"ContainerStarted","Data":"84a19a7ad0e022b5ab1e6b43adbc3617e7f4bc07e906123a80b38eb5f7085b58"}
Sep 09 14:16:28.977139 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:28.976685    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-dk6hd"
Sep 09 14:16:28.994466 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:28.994418    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-dk6hd" podStartSLOduration=1.948342544 podStartE2EDuration="4.994403446s" totalImagesPullingTime="3.046060902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:16:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:16:28.993273185 +0000 UTC m=+339.797256187" watchObservedRunningTime="2026-09-09 14:16:28.994403446 +0000 UTC m=+339.798386449"
Sep 09 14:16:31.286349 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.286316    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"]
Sep 09 14:16:31.294047 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.294028    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.304444 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.304420    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"]
Sep 09 14:16:31.443595 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.443532    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdm76\" (UniqueName: \"kubernetes.io/projected/7e398827-7da0-4b1c-aeef-f87d4237a426-kube-api-access-rdm76\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.443861 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.443840    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e398827-7da0-4b1c-aeef-f87d4237a426-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.444000 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.443985    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7e398827-7da0-4b1c-aeef-f87d4237a426-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.444106 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.444091    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e398827-7da0-4b1c-aeef-f87d4237a426-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.444214 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.444202    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e398827-7da0-4b1c-aeef-f87d4237a426-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.444319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.444305    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7e398827-7da0-4b1c-aeef-f87d4237a426-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.444428 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.444416    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7e398827-7da0-4b1c-aeef-f87d4237a426-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.545730 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.545654    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e398827-7da0-4b1c-aeef-f87d4237a426-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.545730 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.545691    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7e398827-7da0-4b1c-aeef-f87d4237a426-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.545730 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.545711    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7e398827-7da0-4b1c-aeef-f87d4237a426-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.545965 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.545863    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdm76\" (UniqueName: \"kubernetes.io/projected/7e398827-7da0-4b1c-aeef-f87d4237a426-kube-api-access-rdm76\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.545965 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.545935    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e398827-7da0-4b1c-aeef-f87d4237a426-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.546067 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.545987    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7e398827-7da0-4b1c-aeef-f87d4237a426-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.546067 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.546021    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e398827-7da0-4b1c-aeef-f87d4237a426-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.546462 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.546428    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7e398827-7da0-4b1c-aeef-f87d4237a426-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.548126 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.548099    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7e398827-7da0-4b1c-aeef-f87d4237a426-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.548241 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.548149    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e398827-7da0-4b1c-aeef-f87d4237a426-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.548241 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.548158    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e398827-7da0-4b1c-aeef-f87d4237a426-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.548241 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.548220    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7e398827-7da0-4b1c-aeef-f87d4237a426-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.555305 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.555274    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdm76\" (UniqueName: \"kubernetes.io/projected/7e398827-7da0-4b1c-aeef-f87d4237a426-kube-api-access-rdm76\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.555556 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.555536    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e398827-7da0-4b1c-aeef-f87d4237a426-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s6dgs\" (UID: \"7e398827-7da0-4b1c-aeef-f87d4237a426\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.602735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.602710    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:31.926349 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.926323    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"]
Sep 09 14:16:31.928702 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:16:31.928666    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e398827_7da0_4b1c_aeef_f87d4237a426.slice/crio-e2a4bb5b6812547a26af388e24d06222843035a2e37137f15d0bebcb819d12b3 WatchSource:0}: Error finding container e2a4bb5b6812547a26af388e24d06222843035a2e37137f15d0bebcb819d12b3: Status 404 returned error can't find the container with id e2a4bb5b6812547a26af388e24d06222843035a2e37137f15d0bebcb819d12b3
Sep 09 14:16:31.931053 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.931008    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:16:31.931163 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.931090    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:16:31.990278 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:31.990256    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs" event={"ID":"7e398827-7da0-4b1c-aeef-f87d4237a426","Type":"ContainerStarted","Data":"e2a4bb5b6812547a26af388e24d06222843035a2e37137f15d0bebcb819d12b3"}
Sep 09 14:16:32.995292 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:32.995257    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs" event={"ID":"7e398827-7da0-4b1c-aeef-f87d4237a426","Type":"ContainerStarted","Data":"cd5d6d0acd212b13630035a887268102f8e0fd3834f085e7cf38b8a85eeb6969"}
Sep 09 14:16:32.995793 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:32.995333    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:33.017721 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:33.017672    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs" podStartSLOduration=2.017659014 podStartE2EDuration="2.017659014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:16:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:16:33.016707716 +0000 UTC m=+343.820690722" watchObservedRunningTime="2026-09-09 14:16:33.017659014 +0000 UTC m=+343.821642017"
Sep 09 14:16:34.001300 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.001273    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s6dgs"
Sep 09 14:16:34.094386 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.094356    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"]
Sep 09 14:16:34.094586 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.094533    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w" podUID="0c9f2aba-1e1d-4684-8f1e-02a901f3aae9" containerName="discovery" containerID="cri-o://27ba2d2f712ed03d2cf7f6c5970dc9a549c13a890270332d4945b5601532f314" gracePeriod=30
Sep 09 14:16:34.327533 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.327507    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:34.472882 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.472854    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtj5p\" (UniqueName: \"kubernetes.io/projected/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-kube-api-access-xtj5p\") pod \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") "
Sep 09 14:16:34.473062 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.472894    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-cacerts\") pod \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") "
Sep 09 14:16:34.473062 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.472920    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-token\") pod \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") "
Sep 09 14:16:34.473062 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.473009    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-local-certs\") pod \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") "
Sep 09 14:16:34.473062 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.473040    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-csr-ca-configmap\") pod \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") "
Sep 09 14:16:34.473270 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.473073    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-csr-dns-cert\") pod \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") "
Sep 09 14:16:34.473270 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.473101    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-kubeconfig\") pod \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\" (UID: \"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9\") "
Sep 09 14:16:34.473652 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.473581    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "0c9f2aba-1e1d-4684-8f1e-02a901f3aae9" (UID: "0c9f2aba-1e1d-4684-8f1e-02a901f3aae9"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:16:34.475780 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.475752    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "0c9f2aba-1e1d-4684-8f1e-02a901f3aae9" (UID: "0c9f2aba-1e1d-4684-8f1e-02a901f3aae9"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:16:34.475922 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.475898    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-kube-api-access-xtj5p" (OuterVolumeSpecName: "kube-api-access-xtj5p") pod "0c9f2aba-1e1d-4684-8f1e-02a901f3aae9" (UID: "0c9f2aba-1e1d-4684-8f1e-02a901f3aae9"). InnerVolumeSpecName "kube-api-access-xtj5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:16:34.476035 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.475962    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-local-certs" (OuterVolumeSpecName: "local-certs") pod "0c9f2aba-1e1d-4684-8f1e-02a901f3aae9" (UID: "0c9f2aba-1e1d-4684-8f1e-02a901f3aae9"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:16:34.476622 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.476265    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "0c9f2aba-1e1d-4684-8f1e-02a901f3aae9" (UID: "0c9f2aba-1e1d-4684-8f1e-02a901f3aae9"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:16:34.476622 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.476588    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-cacerts" (OuterVolumeSpecName: "cacerts") pod "0c9f2aba-1e1d-4684-8f1e-02a901f3aae9" (UID: "0c9f2aba-1e1d-4684-8f1e-02a901f3aae9"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:16:34.477278 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.477245    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c9f2aba-1e1d-4684-8f1e-02a901f3aae9" (UID: "0c9f2aba-1e1d-4684-8f1e-02a901f3aae9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:16:34.574253 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.574184    2553 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-cacerts\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:16:34.574253 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.574210    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-token\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:16:34.574253 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.574221    2553 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-local-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:16:34.574253 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.574230    2553 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-csr-ca-configmap\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:16:34.574253 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.574238    2553 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-csr-dns-cert\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:16:34.574253 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.574246    2553 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-istio-kubeconfig\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:16:34.574253 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:34.574256    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtj5p\" (UniqueName: \"kubernetes.io/projected/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9-kube-api-access-xtj5p\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:16:35.004990 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:35.004958    2553 generic.go:356] "Generic (PLEG): container finished" podID="0c9f2aba-1e1d-4684-8f1e-02a901f3aae9" containerID="27ba2d2f712ed03d2cf7f6c5970dc9a549c13a890270332d4945b5601532f314" exitCode=0
Sep 09 14:16:35.005375 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:35.005001    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"
Sep 09 14:16:35.005375 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:35.005046    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w" event={"ID":"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9","Type":"ContainerDied","Data":"27ba2d2f712ed03d2cf7f6c5970dc9a549c13a890270332d4945b5601532f314"}
Sep 09 14:16:35.005375 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:35.005098    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w" event={"ID":"0c9f2aba-1e1d-4684-8f1e-02a901f3aae9","Type":"ContainerDied","Data":"4c066fcf2b1f1e35684343f07e8f6be0155669f3c72332213792279f4b382c51"}
Sep 09 14:16:35.005375 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:35.005125    2553 scope.go:117] "RemoveContainer" containerID="27ba2d2f712ed03d2cf7f6c5970dc9a549c13a890270332d4945b5601532f314"
Sep 09 14:16:35.013406 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:35.013389    2553 scope.go:117] "RemoveContainer" containerID="27ba2d2f712ed03d2cf7f6c5970dc9a549c13a890270332d4945b5601532f314"
Sep 09 14:16:35.013701 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:16:35.013675    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27ba2d2f712ed03d2cf7f6c5970dc9a549c13a890270332d4945b5601532f314\": container with ID starting with 27ba2d2f712ed03d2cf7f6c5970dc9a549c13a890270332d4945b5601532f314 not found: ID does not exist" containerID="27ba2d2f712ed03d2cf7f6c5970dc9a549c13a890270332d4945b5601532f314"
Sep 09 14:16:35.013754 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:35.013710    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ba2d2f712ed03d2cf7f6c5970dc9a549c13a890270332d4945b5601532f314"} err="failed to get container status \"27ba2d2f712ed03d2cf7f6c5970dc9a549c13a890270332d4945b5601532f314\": rpc error: code = NotFound desc = could not find container \"27ba2d2f712ed03d2cf7f6c5970dc9a549c13a890270332d4945b5601532f314\": container with ID starting with 27ba2d2f712ed03d2cf7f6c5970dc9a549c13a890270332d4945b5601532f314 not found: ID does not exist"
Sep 09 14:16:35.027212 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:35.027191    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"]
Sep 09 14:16:35.032187 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:35.032163    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5pv7w"]
Sep 09 14:16:35.645553 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:35.645511    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c9f2aba-1e1d-4684-8f1e-02a901f3aae9" path="/var/lib/kubelet/pods/0c9f2aba-1e1d-4684-8f1e-02a901f3aae9/volumes"
Sep 09 14:16:39.983481 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:16:39.983448    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-dk6hd"
Sep 09 14:17:29.469738 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.469702    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk"]
Sep 09 14:17:29.470174 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.469976    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c9f2aba-1e1d-4684-8f1e-02a901f3aae9" containerName="discovery"
Sep 09 14:17:29.470174 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.469987    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c9f2aba-1e1d-4684-8f1e-02a901f3aae9" containerName="discovery"
Sep 09 14:17:29.470174 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.470053    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c9f2aba-1e1d-4684-8f1e-02a901f3aae9" containerName="discovery"
Sep 09 14:17:29.473343 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.473325    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk"
Sep 09 14:17:29.475742 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.475719    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 14:17:29.475957 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.475941    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 14:17:29.476519 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.476502    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tpr4d\""
Sep 09 14:17:29.482966 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.482938    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk"]
Sep 09 14:17:29.555492 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.555468    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21ae784f-4bfe-44f7-b983-12734616827e-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk\" (UID: \"21ae784f-4bfe-44f7-b983-12734616827e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk"
Sep 09 14:17:29.555616 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.555510    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddhfc\" (UniqueName: \"kubernetes.io/projected/21ae784f-4bfe-44f7-b983-12734616827e-kube-api-access-ddhfc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk\" (UID: \"21ae784f-4bfe-44f7-b983-12734616827e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk"
Sep 09 14:17:29.555616 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.555533    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21ae784f-4bfe-44f7-b983-12734616827e-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk\" (UID: \"21ae784f-4bfe-44f7-b983-12734616827e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk"
Sep 09 14:17:29.567909 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.567883    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl"]
Sep 09 14:17:29.571040 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.571024    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl"
Sep 09 14:17:29.580188 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.580167    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl"]
Sep 09 14:17:29.656319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.656294    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21ae784f-4bfe-44f7-b983-12734616827e-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk\" (UID: \"21ae784f-4bfe-44f7-b983-12734616827e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk"
Sep 09 14:17:29.656416 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.656333    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31128203-e548-4111-90ca-a5d4210c49ba-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl\" (UID: \"31128203-e548-4111-90ca-a5d4210c49ba\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl"
Sep 09 14:17:29.656416 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.656355    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddhfc\" (UniqueName: \"kubernetes.io/projected/21ae784f-4bfe-44f7-b983-12734616827e-kube-api-access-ddhfc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk\" (UID: \"21ae784f-4bfe-44f7-b983-12734616827e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk"
Sep 09 14:17:29.656416 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.656370    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31128203-e548-4111-90ca-a5d4210c49ba-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl\" (UID: \"31128203-e548-4111-90ca-a5d4210c49ba\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl"
Sep 09 14:17:29.656416 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.656406    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21ae784f-4bfe-44f7-b983-12734616827e-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk\" (UID: \"21ae784f-4bfe-44f7-b983-12734616827e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk"
Sep 09 14:17:29.656649 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.656426    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz5s6\" (UniqueName: \"kubernetes.io/projected/31128203-e548-4111-90ca-a5d4210c49ba-kube-api-access-rz5s6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl\" (UID: \"31128203-e548-4111-90ca-a5d4210c49ba\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl"
Sep 09 14:17:29.656710 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.656646    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21ae784f-4bfe-44f7-b983-12734616827e-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk\" (UID: \"21ae784f-4bfe-44f7-b983-12734616827e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk"
Sep 09 14:17:29.656779 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.656758    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21ae784f-4bfe-44f7-b983-12734616827e-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk\" (UID: \"21ae784f-4bfe-44f7-b983-12734616827e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk"
Sep 09 14:17:29.666477 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.666446    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddhfc\" (UniqueName: \"kubernetes.io/projected/21ae784f-4bfe-44f7-b983-12734616827e-kube-api-access-ddhfc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk\" (UID: \"21ae784f-4bfe-44f7-b983-12734616827e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk"
Sep 09 14:17:29.675611 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.675584    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx"]
Sep 09 14:17:29.678845 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.678831    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx"
Sep 09 14:17:29.687335 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.687309    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx"]
Sep 09 14:17:29.757717 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.757655    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31128203-e548-4111-90ca-a5d4210c49ba-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl\" (UID: \"31128203-e548-4111-90ca-a5d4210c49ba\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl"
Sep 09 14:17:29.757717 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.757687    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31128203-e548-4111-90ca-a5d4210c49ba-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl\" (UID: \"31128203-e548-4111-90ca-a5d4210c49ba\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl"
Sep 09 14:17:29.757717 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.757715    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz5s6\" (UniqueName: \"kubernetes.io/projected/31128203-e548-4111-90ca-a5d4210c49ba-kube-api-access-rz5s6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl\" (UID: \"31128203-e548-4111-90ca-a5d4210c49ba\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl"
Sep 09 14:17:29.757959 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.757737    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgq7f\" (UniqueName: \"kubernetes.io/projected/66b485a9-ef33-472d-8891-b82ea18c542c-kube-api-access-wgq7f\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx\" (UID: \"66b485a9-ef33-472d-8891-b82ea18c542c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx"
Sep 09 14:17:29.757959 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.757778    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66b485a9-ef33-472d-8891-b82ea18c542c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx\" (UID: \"66b485a9-ef33-472d-8891-b82ea18c542c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx"
Sep 09 14:17:29.757959 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.757799    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66b485a9-ef33-472d-8891-b82ea18c542c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx\" (UID: \"66b485a9-ef33-472d-8891-b82ea18c542c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx"
Sep 09 14:17:29.758121 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.757990    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31128203-e548-4111-90ca-a5d4210c49ba-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl\" (UID: \"31128203-e548-4111-90ca-a5d4210c49ba\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl"
Sep 09 14:17:29.758121 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.758068    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31128203-e548-4111-90ca-a5d4210c49ba-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl\" (UID: \"31128203-e548-4111-90ca-a5d4210c49ba\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl"
Sep 09 14:17:29.772103 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.772080    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz5s6\" (UniqueName: \"kubernetes.io/projected/31128203-e548-4111-90ca-a5d4210c49ba-kube-api-access-rz5s6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl\" (UID: \"31128203-e548-4111-90ca-a5d4210c49ba\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl"
Sep 09 14:17:29.776918 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.776896    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp"]
Sep 09 14:17:29.780257 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.780243    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp"
Sep 09 14:17:29.787751 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.787729    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk"
Sep 09 14:17:29.789695 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.789675    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp"]
Sep 09 14:17:29.858272 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.858244    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66b485a9-ef33-472d-8891-b82ea18c542c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx\" (UID: \"66b485a9-ef33-472d-8891-b82ea18c542c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx"
Sep 09 14:17:29.858407 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.858278    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a57fb5-e167-4b4e-acf0-24ace14736fd-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp\" (UID: \"47a57fb5-e167-4b4e-acf0-24ace14736fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp"
Sep 09 14:17:29.858407 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.858305    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66b485a9-ef33-472d-8891-b82ea18c542c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx\" (UID: \"66b485a9-ef33-472d-8891-b82ea18c542c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx"
Sep 09 14:17:29.858407 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.858370    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jnbt\" (UniqueName: \"kubernetes.io/projected/47a57fb5-e167-4b4e-acf0-24ace14736fd-kube-api-access-6jnbt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp\" (UID: \"47a57fb5-e167-4b4e-acf0-24ace14736fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp"
Sep 09 14:17:29.858586 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.858412    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a57fb5-e167-4b4e-acf0-24ace14736fd-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp\" (UID: \"47a57fb5-e167-4b4e-acf0-24ace14736fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp"
Sep 09 14:17:29.858586 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.858452    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgq7f\" (UniqueName: \"kubernetes.io/projected/66b485a9-ef33-472d-8891-b82ea18c542c-kube-api-access-wgq7f\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx\" (UID: \"66b485a9-ef33-472d-8891-b82ea18c542c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx"
Sep 09 14:17:29.858720 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.858619    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66b485a9-ef33-472d-8891-b82ea18c542c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx\" (UID: \"66b485a9-ef33-472d-8891-b82ea18c542c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx"
Sep 09 14:17:29.858720 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.858671    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66b485a9-ef33-472d-8891-b82ea18c542c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx\" (UID: \"66b485a9-ef33-472d-8891-b82ea18c542c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx"
Sep 09 14:17:29.867009 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.866984    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgq7f\" (UniqueName: \"kubernetes.io/projected/66b485a9-ef33-472d-8891-b82ea18c542c-kube-api-access-wgq7f\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx\" (UID: \"66b485a9-ef33-472d-8891-b82ea18c542c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx"
Sep 09 14:17:29.879385 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.879364    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl"
Sep 09 14:17:29.958927 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.958902    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jnbt\" (UniqueName: \"kubernetes.io/projected/47a57fb5-e167-4b4e-acf0-24ace14736fd-kube-api-access-6jnbt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp\" (UID: \"47a57fb5-e167-4b4e-acf0-24ace14736fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp"
Sep 09 14:17:29.959056 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.958938    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a57fb5-e167-4b4e-acf0-24ace14736fd-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp\" (UID: \"47a57fb5-e167-4b4e-acf0-24ace14736fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp"
Sep 09 14:17:29.959056 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.958981    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a57fb5-e167-4b4e-acf0-24ace14736fd-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp\" (UID: \"47a57fb5-e167-4b4e-acf0-24ace14736fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp"
Sep 09 14:17:29.959293 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.959274    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a57fb5-e167-4b4e-acf0-24ace14736fd-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp\" (UID: \"47a57fb5-e167-4b4e-acf0-24ace14736fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp"
Sep 09 14:17:29.959355 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.959318    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a57fb5-e167-4b4e-acf0-24ace14736fd-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp\" (UID: \"47a57fb5-e167-4b4e-acf0-24ace14736fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp"
Sep 09 14:17:29.967319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.967300    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jnbt\" (UniqueName: \"kubernetes.io/projected/47a57fb5-e167-4b4e-acf0-24ace14736fd-kube-api-access-6jnbt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp\" (UID: \"47a57fb5-e167-4b4e-acf0-24ace14736fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp"
Sep 09 14:17:29.988157 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:29.988136    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx"
Sep 09 14:17:30.064707 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:30.064678    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk"]
Sep 09 14:17:30.066715 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:17:30.066688    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21ae784f_4bfe_44f7_b983_12734616827e.slice/crio-56f166736407ead6c84680fd425e141171a9955498a0431102ee57aca7c36bcc WatchSource:0}: Error finding container 56f166736407ead6c84680fd425e141171a9955498a0431102ee57aca7c36bcc: Status 404 returned error can't find the container with id 56f166736407ead6c84680fd425e141171a9955498a0431102ee57aca7c36bcc
Sep 09 14:17:30.088328 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:30.088306    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp"
Sep 09 14:17:30.150260 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:30.150232    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl"]
Sep 09 14:17:30.151464 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:17:30.151434    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31128203_e548_4111_90ca_a5d4210c49ba.slice/crio-bfe3bc2d5f35b8aa49ee830c549e62990acd884bfbdbbb23f56004e9a89b6250 WatchSource:0}: Error finding container bfe3bc2d5f35b8aa49ee830c549e62990acd884bfbdbbb23f56004e9a89b6250: Status 404 returned error can't find the container with id bfe3bc2d5f35b8aa49ee830c549e62990acd884bfbdbbb23f56004e9a89b6250
Sep 09 14:17:30.217734 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:30.217707    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl" event={"ID":"31128203-e548-4111-90ca-a5d4210c49ba","Type":"ContainerStarted","Data":"bfe3bc2d5f35b8aa49ee830c549e62990acd884bfbdbbb23f56004e9a89b6250"}
Sep 09 14:17:30.219102 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:30.219081    2553 generic.go:356] "Generic (PLEG): container finished" podID="21ae784f-4bfe-44f7-b983-12734616827e" containerID="6c34410ff047abde1ba99498d326f038402cf39be1e0fbdf77ae458588e1f726" exitCode=0
Sep 09 14:17:30.219188 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:30.219118    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk" event={"ID":"21ae784f-4bfe-44f7-b983-12734616827e","Type":"ContainerDied","Data":"6c34410ff047abde1ba99498d326f038402cf39be1e0fbdf77ae458588e1f726"}
Sep 09 14:17:30.219188 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:30.219147    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk" event={"ID":"21ae784f-4bfe-44f7-b983-12734616827e","Type":"ContainerStarted","Data":"56f166736407ead6c84680fd425e141171a9955498a0431102ee57aca7c36bcc"}
Sep 09 14:17:30.256635 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:30.256533    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx"]
Sep 09 14:17:30.258373 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:17:30.258351    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b485a9_ef33_472d_8891_b82ea18c542c.slice/crio-05ee8c47495510819954b3b1ded78e7551cbf71f1c905919c4e283c75551a648 WatchSource:0}: Error finding container 05ee8c47495510819954b3b1ded78e7551cbf71f1c905919c4e283c75551a648: Status 404 returned error can't find the container with id 05ee8c47495510819954b3b1ded78e7551cbf71f1c905919c4e283c75551a648
Sep 09 14:17:30.360585 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:30.360536    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp"]
Sep 09 14:17:30.404366 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:17:30.404336    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a57fb5_e167_4b4e_acf0_24ace14736fd.slice/crio-8cd8c3d671639117c1520c948cdc4304d8cf849eeaac8cdd66d1ba0bf75ca2d4 WatchSource:0}: Error finding container 8cd8c3d671639117c1520c948cdc4304d8cf849eeaac8cdd66d1ba0bf75ca2d4: Status 404 returned error can't find the container with id 8cd8c3d671639117c1520c948cdc4304d8cf849eeaac8cdd66d1ba0bf75ca2d4
Sep 09 14:17:31.225398 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:31.225363    2553 generic.go:356] "Generic (PLEG): container finished" podID="31128203-e548-4111-90ca-a5d4210c49ba" containerID="41b0919cef18f4e231009cc9b050f3548ee9033d026574d5387d46e8f93d3aec" exitCode=0
Sep 09 14:17:31.225843 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:31.225457    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl" event={"ID":"31128203-e548-4111-90ca-a5d4210c49ba","Type":"ContainerDied","Data":"41b0919cef18f4e231009cc9b050f3548ee9033d026574d5387d46e8f93d3aec"}
Sep 09 14:17:31.232112 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:31.232086    2553 generic.go:356] "Generic (PLEG): container finished" podID="66b485a9-ef33-472d-8891-b82ea18c542c" containerID="fa5dd6f4260a74d23b4a5fc028fb2d547ab4c2f7339ae27cfe7f54157c420232" exitCode=0
Sep 09 14:17:31.232198 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:31.232172    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx" event={"ID":"66b485a9-ef33-472d-8891-b82ea18c542c","Type":"ContainerDied","Data":"fa5dd6f4260a74d23b4a5fc028fb2d547ab4c2f7339ae27cfe7f54157c420232"}
Sep 09 14:17:31.232273 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:31.232252    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx" event={"ID":"66b485a9-ef33-472d-8891-b82ea18c542c","Type":"ContainerStarted","Data":"05ee8c47495510819954b3b1ded78e7551cbf71f1c905919c4e283c75551a648"}
Sep 09 14:17:31.234452 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:31.234429    2553 generic.go:356] "Generic (PLEG): container finished" podID="21ae784f-4bfe-44f7-b983-12734616827e" containerID="d7773cdf23abae834d7d62c9e8331003b43d88d5e75a4a65c759f453c78892bd" exitCode=0
Sep 09 14:17:31.234527 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:31.234508    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk" event={"ID":"21ae784f-4bfe-44f7-b983-12734616827e","Type":"ContainerDied","Data":"d7773cdf23abae834d7d62c9e8331003b43d88d5e75a4a65c759f453c78892bd"}
Sep 09 14:17:31.236264 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:31.236243    2553 generic.go:356] "Generic (PLEG): container finished" podID="47a57fb5-e167-4b4e-acf0-24ace14736fd" containerID="effe278c8debe37d4f7042d5b76ff375d72f1dde662077904a7706eb1a1f6855" exitCode=0
Sep 09 14:17:31.236342 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:31.236300    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp" event={"ID":"47a57fb5-e167-4b4e-acf0-24ace14736fd","Type":"ContainerDied","Data":"effe278c8debe37d4f7042d5b76ff375d72f1dde662077904a7706eb1a1f6855"}
Sep 09 14:17:31.236403 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:31.236342    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp" event={"ID":"47a57fb5-e167-4b4e-acf0-24ace14736fd","Type":"ContainerStarted","Data":"8cd8c3d671639117c1520c948cdc4304d8cf849eeaac8cdd66d1ba0bf75ca2d4"}
Sep 09 14:17:32.242114 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:32.242082    2553 generic.go:356] "Generic (PLEG): container finished" podID="21ae784f-4bfe-44f7-b983-12734616827e" containerID="1b64d331f03f31327fbdd0e328c2d387e2e630eda562b44f216bdd61a6ddc0b2" exitCode=0
Sep 09 14:17:32.242490 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:32.242171    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk" event={"ID":"21ae784f-4bfe-44f7-b983-12734616827e","Type":"ContainerDied","Data":"1b64d331f03f31327fbdd0e328c2d387e2e630eda562b44f216bdd61a6ddc0b2"}
Sep 09 14:17:33.249110 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:33.249029    2553 generic.go:356] "Generic (PLEG): container finished" podID="66b485a9-ef33-472d-8891-b82ea18c542c" containerID="f4ebb73ad589cecb438131279b7066595c6ca9f720250866e18485a01d74d177" exitCode=0
Sep 09 14:17:33.249484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:33.249114    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx" event={"ID":"66b485a9-ef33-472d-8891-b82ea18c542c","Type":"ContainerDied","Data":"f4ebb73ad589cecb438131279b7066595c6ca9f720250866e18485a01d74d177"}
Sep 09 14:17:33.251076 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:33.251053    2553 generic.go:356] "Generic (PLEG): container finished" podID="31128203-e548-4111-90ca-a5d4210c49ba" containerID="bf7e3378c0e7aa65cb39807a9e0b4e8c4d83b12b23c80d6321ab519233582d6e" exitCode=0
Sep 09 14:17:33.251161 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:33.251142    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl" event={"ID":"31128203-e548-4111-90ca-a5d4210c49ba","Type":"ContainerDied","Data":"bf7e3378c0e7aa65cb39807a9e0b4e8c4d83b12b23c80d6321ab519233582d6e"}
Sep 09 14:17:33.374384 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:33.374355    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk"
Sep 09 14:17:33.488913 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:33.488887    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21ae784f-4bfe-44f7-b983-12734616827e-bundle\") pod \"21ae784f-4bfe-44f7-b983-12734616827e\" (UID: \"21ae784f-4bfe-44f7-b983-12734616827e\") "
Sep 09 14:17:33.489029 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:33.488951    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddhfc\" (UniqueName: \"kubernetes.io/projected/21ae784f-4bfe-44f7-b983-12734616827e-kube-api-access-ddhfc\") pod \"21ae784f-4bfe-44f7-b983-12734616827e\" (UID: \"21ae784f-4bfe-44f7-b983-12734616827e\") "
Sep 09 14:17:33.489029 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:33.488992    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21ae784f-4bfe-44f7-b983-12734616827e-util\") pod \"21ae784f-4bfe-44f7-b983-12734616827e\" (UID: \"21ae784f-4bfe-44f7-b983-12734616827e\") "
Sep 09 14:17:33.489398 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:33.489374    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ae784f-4bfe-44f7-b983-12734616827e-bundle" (OuterVolumeSpecName: "bundle") pod "21ae784f-4bfe-44f7-b983-12734616827e" (UID: "21ae784f-4bfe-44f7-b983-12734616827e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:17:33.491008 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:33.490981    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21ae784f-4bfe-44f7-b983-12734616827e-kube-api-access-ddhfc" (OuterVolumeSpecName: "kube-api-access-ddhfc") pod "21ae784f-4bfe-44f7-b983-12734616827e" (UID: "21ae784f-4bfe-44f7-b983-12734616827e"). InnerVolumeSpecName "kube-api-access-ddhfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:17:33.494311 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:33.494290    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ae784f-4bfe-44f7-b983-12734616827e-util" (OuterVolumeSpecName: "util") pod "21ae784f-4bfe-44f7-b983-12734616827e" (UID: "21ae784f-4bfe-44f7-b983-12734616827e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:17:33.589749 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:33.589726    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddhfc\" (UniqueName: \"kubernetes.io/projected/21ae784f-4bfe-44f7-b983-12734616827e-kube-api-access-ddhfc\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:17:33.589749 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:33.589749    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21ae784f-4bfe-44f7-b983-12734616827e-util\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:17:33.589865 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:33.589760    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21ae784f-4bfe-44f7-b983-12734616827e-bundle\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:17:34.262203 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:34.262175    2553 generic.go:356] "Generic (PLEG): container finished" podID="31128203-e548-4111-90ca-a5d4210c49ba" containerID="88fbf675279fbe79a330ef3d47dab4c6c766eade1b8e9b997ff7bbfe7562b259" exitCode=0
Sep 09 14:17:34.262584 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:34.262274    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl" event={"ID":"31128203-e548-4111-90ca-a5d4210c49ba","Type":"ContainerDied","Data":"88fbf675279fbe79a330ef3d47dab4c6c766eade1b8e9b997ff7bbfe7562b259"}
Sep 09 14:17:34.264409 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:34.264384    2553 generic.go:356] "Generic (PLEG): container finished" podID="66b485a9-ef33-472d-8891-b82ea18c542c" containerID="e3ec5c46e0707a6dc5efc0efa4b696365019a82facc4c161da72b38f9b53f7a4" exitCode=0
Sep 09 14:17:34.264487 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:34.264459    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx" event={"ID":"66b485a9-ef33-472d-8891-b82ea18c542c","Type":"ContainerDied","Data":"e3ec5c46e0707a6dc5efc0efa4b696365019a82facc4c161da72b38f9b53f7a4"}
Sep 09 14:17:34.266350 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:34.266332    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk"
Sep 09 14:17:34.266444 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:34.266332    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72znvk" event={"ID":"21ae784f-4bfe-44f7-b983-12734616827e","Type":"ContainerDied","Data":"56f166736407ead6c84680fd425e141171a9955498a0431102ee57aca7c36bcc"}
Sep 09 14:17:34.266496 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:34.266449    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56f166736407ead6c84680fd425e141171a9955498a0431102ee57aca7c36bcc"
Sep 09 14:17:34.268316 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:34.268294    2553 generic.go:356] "Generic (PLEG): container finished" podID="47a57fb5-e167-4b4e-acf0-24ace14736fd" containerID="fab0bcb95d40cdb51aa1f167b62c7e7e93bf1564b25e84911757a397583e680c" exitCode=0
Sep 09 14:17:34.268404 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:34.268366    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp" event={"ID":"47a57fb5-e167-4b4e-acf0-24ace14736fd","Type":"ContainerDied","Data":"fab0bcb95d40cdb51aa1f167b62c7e7e93bf1564b25e84911757a397583e680c"}
Sep 09 14:17:35.274553 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.274514    2553 generic.go:356] "Generic (PLEG): container finished" podID="47a57fb5-e167-4b4e-acf0-24ace14736fd" containerID="d1402751dbd3d68d1b908f6641c7d7de9f354f3dc634d9c87eabd82971c65ef0" exitCode=0
Sep 09 14:17:35.274938 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.274603    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp" event={"ID":"47a57fb5-e167-4b4e-acf0-24ace14736fd","Type":"ContainerDied","Data":"d1402751dbd3d68d1b908f6641c7d7de9f354f3dc634d9c87eabd82971c65ef0"}
Sep 09 14:17:35.402343 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.402318    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx"
Sep 09 14:17:35.430666 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.430639    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl"
Sep 09 14:17:35.505410 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.505382    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgq7f\" (UniqueName: \"kubernetes.io/projected/66b485a9-ef33-472d-8891-b82ea18c542c-kube-api-access-wgq7f\") pod \"66b485a9-ef33-472d-8891-b82ea18c542c\" (UID: \"66b485a9-ef33-472d-8891-b82ea18c542c\") "
Sep 09 14:17:35.505582 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.505437    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rz5s6\" (UniqueName: \"kubernetes.io/projected/31128203-e548-4111-90ca-a5d4210c49ba-kube-api-access-rz5s6\") pod \"31128203-e548-4111-90ca-a5d4210c49ba\" (UID: \"31128203-e548-4111-90ca-a5d4210c49ba\") "
Sep 09 14:17:35.505582 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.505463    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31128203-e548-4111-90ca-a5d4210c49ba-util\") pod \"31128203-e548-4111-90ca-a5d4210c49ba\" (UID: \"31128203-e548-4111-90ca-a5d4210c49ba\") "
Sep 09 14:17:35.505582 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.505488    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66b485a9-ef33-472d-8891-b82ea18c542c-bundle\") pod \"66b485a9-ef33-472d-8891-b82ea18c542c\" (UID: \"66b485a9-ef33-472d-8891-b82ea18c542c\") "
Sep 09 14:17:35.505582 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.505514    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31128203-e548-4111-90ca-a5d4210c49ba-bundle\") pod \"31128203-e548-4111-90ca-a5d4210c49ba\" (UID: \"31128203-e548-4111-90ca-a5d4210c49ba\") "
Sep 09 14:17:35.505582 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.505539    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66b485a9-ef33-472d-8891-b82ea18c542c-util\") pod \"66b485a9-ef33-472d-8891-b82ea18c542c\" (UID: \"66b485a9-ef33-472d-8891-b82ea18c542c\") "
Sep 09 14:17:35.506007 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.505979    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66b485a9-ef33-472d-8891-b82ea18c542c-bundle" (OuterVolumeSpecName: "bundle") pod "66b485a9-ef33-472d-8891-b82ea18c542c" (UID: "66b485a9-ef33-472d-8891-b82ea18c542c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:17:35.506899 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.506871    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31128203-e548-4111-90ca-a5d4210c49ba-bundle" (OuterVolumeSpecName: "bundle") pod "31128203-e548-4111-90ca-a5d4210c49ba" (UID: "31128203-e548-4111-90ca-a5d4210c49ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:17:35.507735 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.507701    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31128203-e548-4111-90ca-a5d4210c49ba-kube-api-access-rz5s6" (OuterVolumeSpecName: "kube-api-access-rz5s6") pod "31128203-e548-4111-90ca-a5d4210c49ba" (UID: "31128203-e548-4111-90ca-a5d4210c49ba"). InnerVolumeSpecName "kube-api-access-rz5s6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:17:35.507967 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.507948    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66b485a9-ef33-472d-8891-b82ea18c542c-kube-api-access-wgq7f" (OuterVolumeSpecName: "kube-api-access-wgq7f") pod "66b485a9-ef33-472d-8891-b82ea18c542c" (UID: "66b485a9-ef33-472d-8891-b82ea18c542c"). InnerVolumeSpecName "kube-api-access-wgq7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:17:35.513988 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.513961    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31128203-e548-4111-90ca-a5d4210c49ba-util" (OuterVolumeSpecName: "util") pod "31128203-e548-4111-90ca-a5d4210c49ba" (UID: "31128203-e548-4111-90ca-a5d4210c49ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:17:35.514700 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.514678    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66b485a9-ef33-472d-8891-b82ea18c542c-util" (OuterVolumeSpecName: "util") pod "66b485a9-ef33-472d-8891-b82ea18c542c" (UID: "66b485a9-ef33-472d-8891-b82ea18c542c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:17:35.606709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.606650    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66b485a9-ef33-472d-8891-b82ea18c542c-util\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:17:35.606709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.606676    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgq7f\" (UniqueName: \"kubernetes.io/projected/66b485a9-ef33-472d-8891-b82ea18c542c-kube-api-access-wgq7f\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:17:35.606709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.606687    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz5s6\" (UniqueName: \"kubernetes.io/projected/31128203-e548-4111-90ca-a5d4210c49ba-kube-api-access-rz5s6\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:17:35.606709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.606696    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31128203-e548-4111-90ca-a5d4210c49ba-util\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:17:35.606709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.606704    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66b485a9-ef33-472d-8891-b82ea18c542c-bundle\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:17:35.606709 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:35.606712    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31128203-e548-4111-90ca-a5d4210c49ba-bundle\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:17:36.280296 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:36.280268    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl"
Sep 09 14:17:36.280296 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:36.280280    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cl28cl" event={"ID":"31128203-e548-4111-90ca-a5d4210c49ba","Type":"ContainerDied","Data":"bfe3bc2d5f35b8aa49ee830c549e62990acd884bfbdbbb23f56004e9a89b6250"}
Sep 09 14:17:36.280753 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:36.280326    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bfe3bc2d5f35b8aa49ee830c549e62990acd884bfbdbbb23f56004e9a89b6250"
Sep 09 14:17:36.282449 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:36.282419    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx" event={"ID":"66b485a9-ef33-472d-8891-b82ea18c542c","Type":"ContainerDied","Data":"05ee8c47495510819954b3b1ded78e7551cbf71f1c905919c4e283c75551a648"}
Sep 09 14:17:36.282449 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:36.282444    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6spcwx"
Sep 09 14:17:36.282636 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:36.282466    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05ee8c47495510819954b3b1ded78e7551cbf71f1c905919c4e283c75551a648"
Sep 09 14:17:36.403988 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:36.403962    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp"
Sep 09 14:17:36.512861 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:36.512834    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a57fb5-e167-4b4e-acf0-24ace14736fd-util\") pod \"47a57fb5-e167-4b4e-acf0-24ace14736fd\" (UID: \"47a57fb5-e167-4b4e-acf0-24ace14736fd\") "
Sep 09 14:17:36.512861 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:36.512866    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a57fb5-e167-4b4e-acf0-24ace14736fd-bundle\") pod \"47a57fb5-e167-4b4e-acf0-24ace14736fd\" (UID: \"47a57fb5-e167-4b4e-acf0-24ace14736fd\") "
Sep 09 14:17:36.513030 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:36.512922    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jnbt\" (UniqueName: \"kubernetes.io/projected/47a57fb5-e167-4b4e-acf0-24ace14736fd-kube-api-access-6jnbt\") pod \"47a57fb5-e167-4b4e-acf0-24ace14736fd\" (UID: \"47a57fb5-e167-4b4e-acf0-24ace14736fd\") "
Sep 09 14:17:36.513526 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:36.513488    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47a57fb5-e167-4b4e-acf0-24ace14736fd-bundle" (OuterVolumeSpecName: "bundle") pod "47a57fb5-e167-4b4e-acf0-24ace14736fd" (UID: "47a57fb5-e167-4b4e-acf0-24ace14736fd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:17:36.514946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:36.514917    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47a57fb5-e167-4b4e-acf0-24ace14736fd-kube-api-access-6jnbt" (OuterVolumeSpecName: "kube-api-access-6jnbt") pod "47a57fb5-e167-4b4e-acf0-24ace14736fd" (UID: "47a57fb5-e167-4b4e-acf0-24ace14736fd"). InnerVolumeSpecName "kube-api-access-6jnbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:17:36.517427 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:36.517405    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47a57fb5-e167-4b4e-acf0-24ace14736fd-util" (OuterVolumeSpecName: "util") pod "47a57fb5-e167-4b4e-acf0-24ace14736fd" (UID: "47a57fb5-e167-4b4e-acf0-24ace14736fd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:17:36.614091 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:36.614035    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jnbt\" (UniqueName: \"kubernetes.io/projected/47a57fb5-e167-4b4e-acf0-24ace14736fd-kube-api-access-6jnbt\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:17:36.614091 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:36.614057    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a57fb5-e167-4b4e-acf0-24ace14736fd-util\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:17:36.614091 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:36.614066    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a57fb5-e167-4b4e-acf0-24ace14736fd-bundle\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:17:37.289134 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:37.289099    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp" event={"ID":"47a57fb5-e167-4b4e-acf0-24ace14736fd","Type":"ContainerDied","Data":"8cd8c3d671639117c1520c948cdc4304d8cf849eeaac8cdd66d1ba0bf75ca2d4"}
Sep 09 14:17:37.289134 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:37.289122    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apwtxp"
Sep 09 14:17:37.289541 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:37.289153    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cd8c3d671639117c1520c948cdc4304d8cf849eeaac8cdd66d1ba0bf75ca2d4"
Sep 09 14:17:41.929678 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929644    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-kjsx2"]
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929892    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21ae784f-4bfe-44f7-b983-12734616827e" containerName="extract"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929903    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="21ae784f-4bfe-44f7-b983-12734616827e" containerName="extract"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929911    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a57fb5-e167-4b4e-acf0-24ace14736fd" containerName="extract"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929918    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a57fb5-e167-4b4e-acf0-24ace14736fd" containerName="extract"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929926    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a57fb5-e167-4b4e-acf0-24ace14736fd" containerName="util"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929931    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a57fb5-e167-4b4e-acf0-24ace14736fd" containerName="util"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929939    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31128203-e548-4111-90ca-a5d4210c49ba" containerName="extract"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929944    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="31128203-e548-4111-90ca-a5d4210c49ba" containerName="extract"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929951    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31128203-e548-4111-90ca-a5d4210c49ba" containerName="util"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929956    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="31128203-e548-4111-90ca-a5d4210c49ba" containerName="util"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929962    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21ae784f-4bfe-44f7-b983-12734616827e" containerName="pull"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929968    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="21ae784f-4bfe-44f7-b983-12734616827e" containerName="pull"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929975    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21ae784f-4bfe-44f7-b983-12734616827e" containerName="util"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929980    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="21ae784f-4bfe-44f7-b983-12734616827e" containerName="util"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929985    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66b485a9-ef33-472d-8891-b82ea18c542c" containerName="util"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929990    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="66b485a9-ef33-472d-8891-b82ea18c542c" containerName="util"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.929996    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66b485a9-ef33-472d-8891-b82ea18c542c" containerName="pull"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.930000    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="66b485a9-ef33-472d-8891-b82ea18c542c" containerName="pull"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.930005    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66b485a9-ef33-472d-8891-b82ea18c542c" containerName="extract"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.930010    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="66b485a9-ef33-472d-8891-b82ea18c542c" containerName="extract"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.930016    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a57fb5-e167-4b4e-acf0-24ace14736fd" containerName="pull"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.930020    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a57fb5-e167-4b4e-acf0-24ace14736fd" containerName="pull"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.930031    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31128203-e548-4111-90ca-a5d4210c49ba" containerName="pull"
Sep 09 14:17:41.930060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.930035    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="31128203-e548-4111-90ca-a5d4210c49ba" containerName="pull"
Sep 09 14:17:41.930870 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.930081    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="21ae784f-4bfe-44f7-b983-12734616827e" containerName="extract"
Sep 09 14:17:41.930870 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.930089    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="66b485a9-ef33-472d-8891-b82ea18c542c" containerName="extract"
Sep 09 14:17:41.930870 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.930096    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="47a57fb5-e167-4b4e-acf0-24ace14736fd" containerName="extract"
Sep 09 14:17:41.930870 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.930101    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="31128203-e548-4111-90ca-a5d4210c49ba" containerName="extract"
Sep 09 14:17:41.933586 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.933556    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-kjsx2"
Sep 09 14:17:41.935795 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.935774    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 14:17:41.935914 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.935837    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 14:17:41.936533 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.936517    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2w5g2\""
Sep 09 14:17:41.942800 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:41.942779    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-kjsx2"]
Sep 09 14:17:42.058320 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:42.058282    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58mls\" (UniqueName: \"kubernetes.io/projected/0e48fba4-a267-409b-9e44-a06f9154b27c-kube-api-access-58mls\") pod \"authorino-operator-76b478bd78-kjsx2\" (UID: \"0e48fba4-a267-409b-9e44-a06f9154b27c\") " pod="kuadrant-system/authorino-operator-76b478bd78-kjsx2"
Sep 09 14:17:42.158927 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:42.158898    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58mls\" (UniqueName: \"kubernetes.io/projected/0e48fba4-a267-409b-9e44-a06f9154b27c-kube-api-access-58mls\") pod \"authorino-operator-76b478bd78-kjsx2\" (UID: \"0e48fba4-a267-409b-9e44-a06f9154b27c\") " pod="kuadrant-system/authorino-operator-76b478bd78-kjsx2"
Sep 09 14:17:42.172516 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:42.172493    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58mls\" (UniqueName: \"kubernetes.io/projected/0e48fba4-a267-409b-9e44-a06f9154b27c-kube-api-access-58mls\") pod \"authorino-operator-76b478bd78-kjsx2\" (UID: \"0e48fba4-a267-409b-9e44-a06f9154b27c\") " pod="kuadrant-system/authorino-operator-76b478bd78-kjsx2"
Sep 09 14:17:42.243421 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:42.243396    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-kjsx2"
Sep 09 14:17:42.519602 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:42.519517    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-kjsx2"]
Sep 09 14:17:42.521783 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:17:42.521746    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e48fba4_a267_409b_9e44_a06f9154b27c.slice/crio-d5ea2a7cd8a087b834015db8d2b1207611a67b6181b0ed703b37d8939dabac28 WatchSource:0}: Error finding container d5ea2a7cd8a087b834015db8d2b1207611a67b6181b0ed703b37d8939dabac28: Status 404 returned error can't find the container with id d5ea2a7cd8a087b834015db8d2b1207611a67b6181b0ed703b37d8939dabac28
Sep 09 14:17:43.317251 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:43.317199    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-kjsx2" event={"ID":"0e48fba4-a267-409b-9e44-a06f9154b27c","Type":"ContainerStarted","Data":"d5ea2a7cd8a087b834015db8d2b1207611a67b6181b0ed703b37d8939dabac28"}
Sep 09 14:17:44.232664 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:44.232625    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"]
Sep 09 14:17:44.241026 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:44.240996    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"
Sep 09 14:17:44.244069 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:44.244043    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mrhl6\""
Sep 09 14:17:44.245694 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:44.245671    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"]
Sep 09 14:17:44.376763 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:44.376734    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdg6d\" (UniqueName: \"kubernetes.io/projected/86336ab6-e55e-444b-8097-540d12ab8df5-kube-api-access-kdg6d\") pod \"limitador-operator-controller-manager-74495c69f8-q8zzr\" (UID: \"86336ab6-e55e-444b-8097-540d12ab8df5\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"
Sep 09 14:17:44.477902 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:44.477865    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdg6d\" (UniqueName: \"kubernetes.io/projected/86336ab6-e55e-444b-8097-540d12ab8df5-kube-api-access-kdg6d\") pod \"limitador-operator-controller-manager-74495c69f8-q8zzr\" (UID: \"86336ab6-e55e-444b-8097-540d12ab8df5\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"
Sep 09 14:17:44.488113 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:44.488022    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdg6d\" (UniqueName: \"kubernetes.io/projected/86336ab6-e55e-444b-8097-540d12ab8df5-kube-api-access-kdg6d\") pod \"limitador-operator-controller-manager-74495c69f8-q8zzr\" (UID: \"86336ab6-e55e-444b-8097-540d12ab8df5\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"
Sep 09 14:17:44.554728 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:44.554698    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"
Sep 09 14:17:45.122280 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:45.122257    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"]
Sep 09 14:17:45.124775 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:17:45.124744    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86336ab6_e55e_444b_8097_540d12ab8df5.slice/crio-e0e28e3c6aa53b42058398ca04247a20aa8c89919f361cfc61c9640490b069ba WatchSource:0}: Error finding container e0e28e3c6aa53b42058398ca04247a20aa8c89919f361cfc61c9640490b069ba: Status 404 returned error can't find the container with id e0e28e3c6aa53b42058398ca04247a20aa8c89919f361cfc61c9640490b069ba
Sep 09 14:17:45.328712 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:45.328675    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr" event={"ID":"86336ab6-e55e-444b-8097-540d12ab8df5","Type":"ContainerStarted","Data":"e0e28e3c6aa53b42058398ca04247a20aa8c89919f361cfc61c9640490b069ba"}
Sep 09 14:17:45.330201 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:45.330178    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-kjsx2" event={"ID":"0e48fba4-a267-409b-9e44-a06f9154b27c","Type":"ContainerStarted","Data":"7cc8113f3492b462dbf18314bd063b442c5626f7595341f49941b0850ff9cb4b"}
Sep 09 14:17:45.330384 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:45.330294    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-kjsx2"
Sep 09 14:17:45.350044 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:45.349995    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-kjsx2" podStartSLOduration=1.956581297 podStartE2EDuration="4.349980471s" totalImagesPullingTime="2.393399174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:17:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:17:45.348453452 +0000 UTC m=+416.152436456" watchObservedRunningTime="2026-09-09 14:17:45.349980471 +0000 UTC m=+416.153963474"
Sep 09 14:17:47.339834 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:47.339800    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr" event={"ID":"86336ab6-e55e-444b-8097-540d12ab8df5","Type":"ContainerStarted","Data":"e907221a5f6c15fbd5811fb45b2ccd7f1810b23ce6659273a9d10ca379000135"}
Sep 09 14:17:47.340199 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:47.339863    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"
Sep 09 14:17:47.358412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:47.358358    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr" podStartSLOduration=1.831989694 podStartE2EDuration="3.358341895s" totalImagesPullingTime="1.526352201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:17:47.358078451 +0000 UTC m=+418.162061652" watchObservedRunningTime="2026-09-09 14:17:47.358341895 +0000 UTC m=+418.162324897"
Sep 09 14:17:50.368011 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:50.367971    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mtq74"]
Sep 09 14:17:50.371428 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:50.371404    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mtq74"
Sep 09 14:17:50.374002 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:50.373981    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 09 14:17:50.374102 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:50.374037    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-dsfcw\""
Sep 09 14:17:50.385610 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:50.385589    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mtq74"]
Sep 09 14:17:50.425711 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:50.425683    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rjkb\" (UniqueName: \"kubernetes.io/projected/8d5a5f4d-6fc6-4d9c-95c7-0c1087a67855-kube-api-access-9rjkb\") pod \"dns-operator-controller-manager-7b84cd7c9c-mtq74\" (UID: \"8d5a5f4d-6fc6-4d9c-95c7-0c1087a67855\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mtq74"
Sep 09 14:17:50.526026 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:50.525995    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rjkb\" (UniqueName: \"kubernetes.io/projected/8d5a5f4d-6fc6-4d9c-95c7-0c1087a67855-kube-api-access-9rjkb\") pod \"dns-operator-controller-manager-7b84cd7c9c-mtq74\" (UID: \"8d5a5f4d-6fc6-4d9c-95c7-0c1087a67855\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mtq74"
Sep 09 14:17:50.535042 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:50.535015    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rjkb\" (UniqueName: \"kubernetes.io/projected/8d5a5f4d-6fc6-4d9c-95c7-0c1087a67855-kube-api-access-9rjkb\") pod \"dns-operator-controller-manager-7b84cd7c9c-mtq74\" (UID: \"8d5a5f4d-6fc6-4d9c-95c7-0c1087a67855\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mtq74"
Sep 09 14:17:50.681622 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:50.681528    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mtq74"
Sep 09 14:17:50.955967 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:50.955943    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mtq74"]
Sep 09 14:17:50.957917 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:17:50.957891    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5a5f4d_6fc6_4d9c_95c7_0c1087a67855.slice/crio-cca16252bc65880775dc4267162642c09cd74a13f133a95ef73566be9c922404 WatchSource:0}: Error finding container cca16252bc65880775dc4267162642c09cd74a13f133a95ef73566be9c922404: Status 404 returned error can't find the container with id cca16252bc65880775dc4267162642c09cd74a13f133a95ef73566be9c922404
Sep 09 14:17:51.362255 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:51.362172    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mtq74" event={"ID":"8d5a5f4d-6fc6-4d9c-95c7-0c1087a67855","Type":"ContainerStarted","Data":"cca16252bc65880775dc4267162642c09cd74a13f133a95ef73566be9c922404"}
Sep 09 14:17:53.373292 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:53.373247    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mtq74" event={"ID":"8d5a5f4d-6fc6-4d9c-95c7-0c1087a67855","Type":"ContainerStarted","Data":"8d472a3e37e553b668a2545f28a6256ce124e0ded15d6fae5e349a3b0eb8ee0c"}
Sep 09 14:17:53.373675 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:53.373370    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mtq74"
Sep 09 14:17:53.391176 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:53.391134    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mtq74" podStartSLOduration=1.703375173 podStartE2EDuration="3.391099184s" totalImagesPullingTime="1.687724011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:17:53.38983609 +0000 UTC m=+424.193819095" watchObservedRunningTime="2026-09-09 14:17:53.391099184 +0000 UTC m=+424.195082186"
Sep 09 14:17:56.336522 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:56.336486    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-kjsx2"
Sep 09 14:17:58.348737 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:17:58.348705    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"
Sep 09 14:18:04.380455 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:04.380422    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mtq74"
Sep 09 14:18:10.103371 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.103334    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"]
Sep 09 14:18:10.103927 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.103617    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr" podUID="86336ab6-e55e-444b-8097-540d12ab8df5" containerName="manager" containerID="cri-o://e907221a5f6c15fbd5811fb45b2ccd7f1810b23ce6659273a9d10ca379000135" gracePeriod=2
Sep 09 14:18:10.117029 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.116967    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"]
Sep 09 14:18:10.120545 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:18:10.120512    2553 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"86336ab6-e55e-444b-8097-540d12ab8df5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-q8zzr\": pods \"limitador-operator-controller-manager-74495c69f8-q8zzr\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"
Sep 09 14:18:10.132745 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.132720    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-k4kt5"]
Sep 09 14:18:10.133129 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.133114    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86336ab6-e55e-444b-8097-540d12ab8df5" containerName="manager"
Sep 09 14:18:10.133171 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.133133    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="86336ab6-e55e-444b-8097-540d12ab8df5" containerName="manager"
Sep 09 14:18:10.133228 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.133218    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="86336ab6-e55e-444b-8097-540d12ab8df5" containerName="manager"
Sep 09 14:18:10.136410 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.136392    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k4kt5"
Sep 09 14:18:10.138483 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:18:10.138454    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q8zzr\" is forbidden: User \"system:node:ip-10-0-142-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-209.ec2.internal' and this object" podUID="86336ab6-e55e-444b-8097-540d12ab8df5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"
Sep 09 14:18:10.146064 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.146040    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-k4kt5"]
Sep 09 14:18:10.276193 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.276145    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc7wb\" (UniqueName: \"kubernetes.io/projected/b89e443d-ac50-4d31-99c5-c5e9edeb6fa8-kube-api-access-nc7wb\") pod \"limitador-operator-controller-manager-74495c69f8-k4kt5\" (UID: \"b89e443d-ac50-4d31-99c5-c5e9edeb6fa8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k4kt5"
Sep 09 14:18:10.332408 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.332386    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"
Sep 09 14:18:10.334655 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:18:10.334627    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q8zzr\" is forbidden: User \"system:node:ip-10-0-142-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-209.ec2.internal' and this object" podUID="86336ab6-e55e-444b-8097-540d12ab8df5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"
Sep 09 14:18:10.377010 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.376960    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc7wb\" (UniqueName: \"kubernetes.io/projected/b89e443d-ac50-4d31-99c5-c5e9edeb6fa8-kube-api-access-nc7wb\") pod \"limitador-operator-controller-manager-74495c69f8-k4kt5\" (UID: \"b89e443d-ac50-4d31-99c5-c5e9edeb6fa8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k4kt5"
Sep 09 14:18:10.385136 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.385114    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc7wb\" (UniqueName: \"kubernetes.io/projected/b89e443d-ac50-4d31-99c5-c5e9edeb6fa8-kube-api-access-nc7wb\") pod \"limitador-operator-controller-manager-74495c69f8-k4kt5\" (UID: \"b89e443d-ac50-4d31-99c5-c5e9edeb6fa8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k4kt5"
Sep 09 14:18:10.450088 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.450059    2553 generic.go:356] "Generic (PLEG): container finished" podID="86336ab6-e55e-444b-8097-540d12ab8df5" containerID="e907221a5f6c15fbd5811fb45b2ccd7f1810b23ce6659273a9d10ca379000135" exitCode=0
Sep 09 14:18:10.450191 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.450108    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"
Sep 09 14:18:10.450191 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.450156    2553 scope.go:117] "RemoveContainer" containerID="e907221a5f6c15fbd5811fb45b2ccd7f1810b23ce6659273a9d10ca379000135"
Sep 09 14:18:10.452218 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:18:10.452197    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q8zzr\" is forbidden: User \"system:node:ip-10-0-142-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-209.ec2.internal' and this object" podUID="86336ab6-e55e-444b-8097-540d12ab8df5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"
Sep 09 14:18:10.457649 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.457632    2553 scope.go:117] "RemoveContainer" containerID="e907221a5f6c15fbd5811fb45b2ccd7f1810b23ce6659273a9d10ca379000135"
Sep 09 14:18:10.457914 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:18:10.457893    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e907221a5f6c15fbd5811fb45b2ccd7f1810b23ce6659273a9d10ca379000135\": container with ID starting with e907221a5f6c15fbd5811fb45b2ccd7f1810b23ce6659273a9d10ca379000135 not found: ID does not exist" containerID="e907221a5f6c15fbd5811fb45b2ccd7f1810b23ce6659273a9d10ca379000135"
Sep 09 14:18:10.457960 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.457926    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e907221a5f6c15fbd5811fb45b2ccd7f1810b23ce6659273a9d10ca379000135"} err="failed to get container status \"e907221a5f6c15fbd5811fb45b2ccd7f1810b23ce6659273a9d10ca379000135\": rpc error: code = NotFound desc = could not find container \"e907221a5f6c15fbd5811fb45b2ccd7f1810b23ce6659273a9d10ca379000135\": container with ID starting with e907221a5f6c15fbd5811fb45b2ccd7f1810b23ce6659273a9d10ca379000135 not found: ID does not exist"
Sep 09 14:18:10.478188 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.478167    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdg6d\" (UniqueName: \"kubernetes.io/projected/86336ab6-e55e-444b-8097-540d12ab8df5-kube-api-access-kdg6d\") pod \"86336ab6-e55e-444b-8097-540d12ab8df5\" (UID: \"86336ab6-e55e-444b-8097-540d12ab8df5\") "
Sep 09 14:18:10.480117 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.480098    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86336ab6-e55e-444b-8097-540d12ab8df5-kube-api-access-kdg6d" (OuterVolumeSpecName: "kube-api-access-kdg6d") pod "86336ab6-e55e-444b-8097-540d12ab8df5" (UID: "86336ab6-e55e-444b-8097-540d12ab8df5"). InnerVolumeSpecName "kube-api-access-kdg6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:18:10.487167 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.487151    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k4kt5"
Sep 09 14:18:10.579269 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.579238    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdg6d\" (UniqueName: \"kubernetes.io/projected/86336ab6-e55e-444b-8097-540d12ab8df5-kube-api-access-kdg6d\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:18:10.754928 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:10.754900    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-k4kt5"]
Sep 09 14:18:10.756914 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:18:10.756888    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb89e443d_ac50_4d31_99c5_c5e9edeb6fa8.slice/crio-d2bb5a3805c25883c087088b92fd7824005426a5f8d379b7670fe022d917c8bb WatchSource:0}: Error finding container d2bb5a3805c25883c087088b92fd7824005426a5f8d379b7670fe022d917c8bb: Status 404 returned error can't find the container with id d2bb5a3805c25883c087088b92fd7824005426a5f8d379b7670fe022d917c8bb
Sep 09 14:18:10.763548 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:18:10.763519    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q8zzr\" is forbidden: User \"system:node:ip-10-0-142-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-209.ec2.internal' and this object" podUID="86336ab6-e55e-444b-8097-540d12ab8df5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"
Sep 09 14:18:11.457342 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:11.457301    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k4kt5" event={"ID":"b89e443d-ac50-4d31-99c5-c5e9edeb6fa8","Type":"ContainerStarted","Data":"9e507ca27f388d13543ae0b2720e0502b5592c0feddf288a1ebffc8d32ef19f8"}
Sep 09 14:18:11.457763 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:11.457361    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k4kt5" event={"ID":"b89e443d-ac50-4d31-99c5-c5e9edeb6fa8","Type":"ContainerStarted","Data":"d2bb5a3805c25883c087088b92fd7824005426a5f8d379b7670fe022d917c8bb"}
Sep 09 14:18:11.457763 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:11.457401    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k4kt5"
Sep 09 14:18:11.490308 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:11.490259    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k4kt5" podStartSLOduration=1.490244516 podStartE2EDuration="1.490244516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:18:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:18:11.489149432 +0000 UTC m=+442.293132447" watchObservedRunningTime="2026-09-09 14:18:11.490244516 +0000 UTC m=+442.294227518"
Sep 09 14:18:11.491621 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:18:11.491593    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q8zzr\" is forbidden: User \"system:node:ip-10-0-142-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-209.ec2.internal' and this object" podUID="86336ab6-e55e-444b-8097-540d12ab8df5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q8zzr"
Sep 09 14:18:11.645654 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:11.645626    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86336ab6-e55e-444b-8097-540d12ab8df5" path="/var/lib/kubelet/pods/86336ab6-e55e-444b-8097-540d12ab8df5/volumes"
Sep 09 14:18:22.465352 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:22.465278    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-k4kt5"
Sep 09 14:18:55.493327 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:55.493285    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:18:55.496728 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:55.496705    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"
Sep 09 14:18:55.498799 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:55.498778    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cf4nw\""
Sep 09 14:18:55.498966 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:55.498953    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 14:18:55.506744 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:55.506716    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:18:55.537464 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:55.537386    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:18:55.588325 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:55.588303    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d0d0473b-1e2a-468b-a1a7-e135322e1c21-config-file\") pod \"limitador-limitador-84994f7ffc-gnvxp\" (UID: \"d0d0473b-1e2a-468b-a1a7-e135322e1c21\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"
Sep 09 14:18:55.588416 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:55.588337    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crmx9\" (UniqueName: \"kubernetes.io/projected/d0d0473b-1e2a-468b-a1a7-e135322e1c21-kube-api-access-crmx9\") pod \"limitador-limitador-84994f7ffc-gnvxp\" (UID: \"d0d0473b-1e2a-468b-a1a7-e135322e1c21\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"
Sep 09 14:18:55.688838 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:55.688809    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d0d0473b-1e2a-468b-a1a7-e135322e1c21-config-file\") pod \"limitador-limitador-84994f7ffc-gnvxp\" (UID: \"d0d0473b-1e2a-468b-a1a7-e135322e1c21\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"
Sep 09 14:18:55.688964 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:55.688849    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crmx9\" (UniqueName: \"kubernetes.io/projected/d0d0473b-1e2a-468b-a1a7-e135322e1c21-kube-api-access-crmx9\") pod \"limitador-limitador-84994f7ffc-gnvxp\" (UID: \"d0d0473b-1e2a-468b-a1a7-e135322e1c21\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"
Sep 09 14:18:55.689464 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:55.689445    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d0d0473b-1e2a-468b-a1a7-e135322e1c21-config-file\") pod \"limitador-limitador-84994f7ffc-gnvxp\" (UID: \"d0d0473b-1e2a-468b-a1a7-e135322e1c21\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"
Sep 09 14:18:55.697463 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:55.697439    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crmx9\" (UniqueName: \"kubernetes.io/projected/d0d0473b-1e2a-468b-a1a7-e135322e1c21-kube-api-access-crmx9\") pod \"limitador-limitador-84994f7ffc-gnvxp\" (UID: \"d0d0473b-1e2a-468b-a1a7-e135322e1c21\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"
Sep 09 14:18:55.807801 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:55.807709    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"
Sep 09 14:18:56.081020 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:56.080919    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:18:56.083888 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:18:56.083858    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d0473b_1e2a_468b_a1a7_e135322e1c21.slice/crio-702addfad939abd1608a771ce6a1950411ec6dad2aa45cabdc7706f158ebda80 WatchSource:0}: Error finding container 702addfad939abd1608a771ce6a1950411ec6dad2aa45cabdc7706f158ebda80: Status 404 returned error can't find the container with id 702addfad939abd1608a771ce6a1950411ec6dad2aa45cabdc7706f158ebda80
Sep 09 14:18:56.663207 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:56.663166    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-gnvxp" event={"ID":"d0d0473b-1e2a-468b-a1a7-e135322e1c21","Type":"ContainerStarted","Data":"702addfad939abd1608a771ce6a1950411ec6dad2aa45cabdc7706f158ebda80"}
Sep 09 14:18:57.668315 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:57.668277    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-gnvxp" event={"ID":"d0d0473b-1e2a-468b-a1a7-e135322e1c21","Type":"ContainerStarted","Data":"f1dfd84eaaa1fc7fe60630edca1760abd895fd75a17facf0fc6b743c2ada1302"}
Sep 09 14:18:57.668690 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:57.668409    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"
Sep 09 14:18:57.683936 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:18:57.683893    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-gnvxp" podStartSLOduration=1.833391029 podStartE2EDuration="2.68387908s" totalImagesPullingTime="850.488051ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:18:57.68251822 +0000 UTC m=+488.486501236" watchObservedRunningTime="2026-09-09 14:18:57.68387908 +0000 UTC m=+488.487862083"
Sep 09 14:19:08.673960 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:19:08.673927    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"
Sep 09 14:20:05.421397 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:05.421357    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:20:21.789299 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:21.789258    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:20:28.688071 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.688032    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"]
Sep 09 14:20:28.691261 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.691231    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.694231 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.694203    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 09 14:20:28.694231 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.694217    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-scw2n\""
Sep 09 14:20:28.694231 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.694203    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 14:20:28.694481 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.694203    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 14:20:28.702928 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.702905    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"]
Sep 09 14:20:28.791969 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.791945    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8ce69fd-467f-4df4-a38c-0005975a7628-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.792104 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.791980    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8ce69fd-467f-4df4-a38c-0005975a7628-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.792104 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.792011    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28k54\" (UniqueName: \"kubernetes.io/projected/b8ce69fd-467f-4df4-a38c-0005975a7628-kube-api-access-28k54\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.792104 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.792064    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8ce69fd-467f-4df4-a38c-0005975a7628-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.792104 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.792093    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8ce69fd-467f-4df4-a38c-0005975a7628-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.792234 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.792113    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8ce69fd-467f-4df4-a38c-0005975a7628-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.893273 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.893231    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28k54\" (UniqueName: \"kubernetes.io/projected/b8ce69fd-467f-4df4-a38c-0005975a7628-kube-api-access-28k54\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.893408 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.893278    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8ce69fd-467f-4df4-a38c-0005975a7628-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.893408 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.893306    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8ce69fd-467f-4df4-a38c-0005975a7628-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.893408 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.893325    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8ce69fd-467f-4df4-a38c-0005975a7628-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.893408 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.893351    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8ce69fd-467f-4df4-a38c-0005975a7628-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.893408 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.893373    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8ce69fd-467f-4df4-a38c-0005975a7628-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.893783 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.893762    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8ce69fd-467f-4df4-a38c-0005975a7628-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.893853 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.893795    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8ce69fd-467f-4df4-a38c-0005975a7628-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.893853 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.893829    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8ce69fd-467f-4df4-a38c-0005975a7628-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.895581 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.895541    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8ce69fd-467f-4df4-a38c-0005975a7628-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.895795 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.895775    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8ce69fd-467f-4df4-a38c-0005975a7628-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:28.900667 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:28.900646    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28k54\" (UniqueName: \"kubernetes.io/projected/b8ce69fd-467f-4df4-a38c-0005975a7628-kube-api-access-28k54\") pod \"e2e-distinct-simulated-kserve-59975d69f9-44xsc\" (UID: \"b8ce69fd-467f-4df4-a38c-0005975a7628\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:29.002699 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:29.002674    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:29.274276 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:29.274253    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"]
Sep 09 14:20:29.276704 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:20:29.276675    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ce69fd_467f_4df4_a38c_0005975a7628.slice/crio-09194a60a0817bf96751f92450e5d089708e2c69ed3dc1f364f8a0f4155300b5 WatchSource:0}: Error finding container 09194a60a0817bf96751f92450e5d089708e2c69ed3dc1f364f8a0f4155300b5: Status 404 returned error can't find the container with id 09194a60a0817bf96751f92450e5d089708e2c69ed3dc1f364f8a0f4155300b5
Sep 09 14:20:29.387827 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:29.387796    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:20:30.075983 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:30.075946    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc" event={"ID":"b8ce69fd-467f-4df4-a38c-0005975a7628","Type":"ContainerStarted","Data":"09194a60a0817bf96751f92450e5d089708e2c69ed3dc1f364f8a0f4155300b5"}
Sep 09 14:20:31.082197 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:31.082162    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc" event={"ID":"b8ce69fd-467f-4df4-a38c-0005975a7628","Type":"ContainerStarted","Data":"ef9340e36fc72dc553df9fa68c7c7eb79ba215d550e442faed6eed91ecce7bae"}
Sep 09 14:20:31.098060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:31.098012    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc" podStartSLOduration=2.064871373 podStartE2EDuration="3.097998762s" totalImagesPullingTime="1.033127389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:20:31.097003894 +0000 UTC m=+581.900986930" watchObservedRunningTime="2026-09-09 14:20:31.097998762 +0000 UTC m=+581.901981765"
Sep 09 14:20:39.003487 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.003444    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:39.003981 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.003509    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:39.015846 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.015822    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:39.134211 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.134186    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-44xsc"
Sep 09 14:20:39.697318 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.697279    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"]
Sep 09 14:20:39.700636 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.700615    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.702865 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.702844    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 09 14:20:39.709899 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.709874    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"]
Sep 09 14:20:39.780094 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.780059    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.780251 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.780110    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.780251 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.780139    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqdks\" (UniqueName: \"kubernetes.io/projected/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-kube-api-access-mqdks\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.780251 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.780164    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.780251 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.780211    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.780396 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.780267    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.881332 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.881291    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.881469 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.881347    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.881469 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.881372    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.881469 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.881408    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.881469 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.881434    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.881714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.881691    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.881775 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.881714    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqdks\" (UniqueName: \"kubernetes.io/projected/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-kube-api-access-mqdks\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.881775 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.881750    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.881877 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.881784    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.883774 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.883751    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.883981 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.883962    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:39.889450 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:39.889425    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqdks\" (UniqueName: \"kubernetes.io/projected/7bd5bf3c-10e7-4e9d-a155-76384ad6cb10-kube-api-access-mqdks\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp\" (UID: \"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:40.012037 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:40.011965    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:40.285166 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:40.284949    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"]
Sep 09 14:20:40.287747 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:20:40.287706    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd5bf3c_10e7_4e9d_a155_76384ad6cb10.slice/crio-25810fe02a9ac3282f1761c5263260937875dde8c12b62dd7e3e85744f26fa76 WatchSource:0}: Error finding container 25810fe02a9ac3282f1761c5263260937875dde8c12b62dd7e3e85744f26fa76: Status 404 returned error can't find the container with id 25810fe02a9ac3282f1761c5263260937875dde8c12b62dd7e3e85744f26fa76
Sep 09 14:20:40.739344 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:40.739305    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:20:41.134319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:41.134283    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp" event={"ID":"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10","Type":"ContainerStarted","Data":"3a65434409e615764263a17abea5ac305bc5d43f1063929107d3ca9af2a0a4c1"}
Sep 09 14:20:41.134779 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:41.134340    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp" event={"ID":"7bd5bf3c-10e7-4e9d-a155-76384ad6cb10","Type":"ContainerStarted","Data":"25810fe02a9ac3282f1761c5263260937875dde8c12b62dd7e3e85744f26fa76"}
Sep 09 14:20:41.152773 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:41.152719    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp" podStartSLOduration=1.9086461780000001 podStartE2EDuration="2.152701141s" totalImagesPullingTime="244.054963ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:20:41.151079318 +0000 UTC m=+591.955062333" watchObservedRunningTime="2026-09-09 14:20:41.152701141 +0000 UTC m=+591.956684145"
Sep 09 14:20:50.013156 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:50.013118    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:50.013686 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:50.013184    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:50.025727 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:50.025700    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:50.184100 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:50.184071    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp"
Sep 09 14:20:51.757927 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:20:51.757891    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:21:20.199036 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:20.198947    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:21:33.296230 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.296193    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"]
Sep 09 14:21:33.304420 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.304399    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.306519 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.306502    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 09 14:21:33.310450 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.310431    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"]
Sep 09 14:21:33.383462 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.383438    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.383603 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.383478    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.383603 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.383499    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.383603 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.383523    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cprjm\" (UniqueName: \"kubernetes.io/projected/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-kube-api-access-cprjm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.383603 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.383557    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.383747 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.383630    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.484840 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.484806    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.485002 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.484858    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.485002 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.484962    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.485002 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.484993    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cprjm\" (UniqueName: \"kubernetes.io/projected/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-kube-api-access-cprjm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.485116 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.485020    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.485116 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.485063    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.485232 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.485212    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.485312 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.485292    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.485394 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.485375    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.487171 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.487143    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.487331 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.487313    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.492360 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.492342    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cprjm\" (UniqueName: \"kubernetes.io/projected/0530bd95-8d3a-4d96-9b6c-672900e7ac3c-kube-api-access-cprjm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xxckq\" (UID: \"0530bd95-8d3a-4d96-9b6c-672900e7ac3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.616016 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.615934    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:33.898136 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.898103    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"]
Sep 09 14:21:33.898710 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:21:33.898689    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0530bd95_8d3a_4d96_9b6c_672900e7ac3c.slice/crio-fe58284e139de58db712f2fdf45fb8292face818776747d4a6bcea4c85805f36 WatchSource:0}: Error finding container fe58284e139de58db712f2fdf45fb8292face818776747d4a6bcea4c85805f36: Status 404 returned error can't find the container with id fe58284e139de58db712f2fdf45fb8292face818776747d4a6bcea4c85805f36
Sep 09 14:21:33.900420 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:33.900389    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 14:21:34.366481 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:34.366441    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq" event={"ID":"0530bd95-8d3a-4d96-9b6c-672900e7ac3c","Type":"ContainerStarted","Data":"a1710333d96d20754afb2a2263a591db681fe50352762cd972b8eaf4856395d5"}
Sep 09 14:21:34.366866 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:34.366499    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq" event={"ID":"0530bd95-8d3a-4d96-9b6c-672900e7ac3c","Type":"ContainerStarted","Data":"fe58284e139de58db712f2fdf45fb8292face818776747d4a6bcea4c85805f36"}
Sep 09 14:21:34.383415 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:34.383372    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq" podStartSLOduration=1.180755378 podStartE2EDuration="1.383356381s" totalImagesPullingTime="202.601003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:21:34.382044256 +0000 UTC m=+645.186027260" watchObservedRunningTime="2026-09-09 14:21:34.383356381 +0000 UTC m=+645.187339394"
Sep 09 14:21:35.087534 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:35.087500    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:21:40.989368 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:40.989329    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:21:43.616452 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:43.616405    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:43.616882 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:43.616502    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:43.628703 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:43.628675    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:21:44.424513 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:21:44.424481    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xxckq"
Sep 09 14:23:56.403342 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:23:56.403306    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:24:03.717995 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.717956    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"]
Sep 09 14:24:03.721273 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.721255    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.726794 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.726611    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-a2ffe2-openshift-default-dockercfg-x4rws\""
Sep 09 14:24:03.742065 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.742040    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"]
Sep 09 14:24:03.890240 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.890202    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-workload-certs\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.890422 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.890271    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37f18f84-16df-4be4-8824-8650cf737dce-istio-podinfo\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.890422 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.890355    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37f18f84-16df-4be4-8824-8650cf737dce-istiod-ca-cert\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.890542 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.890416    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-workload-socket\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.890542 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.890446    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z5tq\" (UniqueName: \"kubernetes.io/projected/37f18f84-16df-4be4-8824-8650cf737dce-kube-api-access-8z5tq\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.890542 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.890473    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f18f84-16df-4be4-8824-8650cf737dce-istio-token\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.890542 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.890489    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-istio-data\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.890542 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.890523    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-istio-envoy\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.890775 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.890617    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-credential-socket\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.992039 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.991951    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-istio-envoy\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.992039 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.992007    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-credential-socket\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.992264 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.992130    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-workload-certs\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.992264 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.992180    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37f18f84-16df-4be4-8824-8650cf737dce-istio-podinfo\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.992264 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.992227    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37f18f84-16df-4be4-8824-8650cf737dce-istiod-ca-cert\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.992264 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.992261    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-workload-socket\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.992470 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.992322    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z5tq\" (UniqueName: \"kubernetes.io/projected/37f18f84-16df-4be4-8824-8650cf737dce-kube-api-access-8z5tq\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.992470 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.992376    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f18f84-16df-4be4-8824-8650cf737dce-istio-token\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.992470 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.992404    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-istio-data\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.992649 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.992527    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-workload-certs\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.992914 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.992887    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-credential-socket\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.993047 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.993019    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37f18f84-16df-4be4-8824-8650cf737dce-istiod-ca-cert\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.993130 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.993111    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-istio-data\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.993192 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.993169    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-workload-socket\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.994502 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.994469    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-istio-envoy\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:03.995046 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:03.995021    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37f18f84-16df-4be4-8824-8650cf737dce-istio-podinfo\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:04.000827 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:04.000803    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z5tq\" (UniqueName: \"kubernetes.io/projected/37f18f84-16df-4be4-8824-8650cf737dce-kube-api-access-8z5tq\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:04.000942 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:04.000891    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f18f84-16df-4be4-8824-8650cf737dce-istio-token\") pod \"e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") " pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:04.034069 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:04.034047    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:04.317005 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:04.316976    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"]
Sep 09 14:24:04.319066 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:24:04.319028    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f18f84_16df_4be4_8824_8650cf737dce.slice/crio-02e91a2f4f88f4f98e01ce31543b93f547185fbaf571d580c5c920078e20c786 WatchSource:0}: Error finding container 02e91a2f4f88f4f98e01ce31543b93f547185fbaf571d580c5c920078e20c786: Status 404 returned error can't find the container with id 02e91a2f4f88f4f98e01ce31543b93f547185fbaf571d580c5c920078e20c786
Sep 09 14:24:05.062500 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:05.062462    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd" event={"ID":"37f18f84-16df-4be4-8824-8650cf737dce","Type":"ContainerStarted","Data":"02e91a2f4f88f4f98e01ce31543b93f547185fbaf571d580c5c920078e20c786"}
Sep 09 14:24:07.017055 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:07.017018    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:24:07.017430 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:07.017105    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:24:07.017430 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:07.017155    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:24:08.078845 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:08.078816    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd" event={"ID":"37f18f84-16df-4be4-8824-8650cf737dce","Type":"ContainerStarted","Data":"eb61ae2f3fc5784c55d053c883bd70f13ef3e0bc62ec4d25d404917bda624c67"}
Sep 09 14:24:08.100636 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:08.100592    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd" podStartSLOduration=2.404980011 podStartE2EDuration="5.100560858s" totalImagesPullingTime="2.695580847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:24:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:24:08.099949744 +0000 UTC m=+798.903932747" watchObservedRunningTime="2026-09-09 14:24:08.100560858 +0000 UTC m=+798.904543860"
Sep 09 14:24:09.034991 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:09.034956    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:09.039937 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:09.039909    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:09.083347 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:09.083316    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:09.084205 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:09.084187    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:11.200084 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.200050    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"]
Sep 09 14:24:11.204152 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.204128    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:24:11.207168 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.207148    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:24:11.207821 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.207764    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 14:24:11.207821 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.207764    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 14:24:11.207821 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.207766    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fkrmg\""
Sep 09 14:24:11.208056 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.207768    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-a2ffe2-serving-cert\""
Sep 09 14:24:11.218943 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.218919    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"]
Sep 09 14:24:11.362027 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.361992    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msbt7\" (UniqueName: \"kubernetes.io/projected/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-kube-api-access-msbt7\") pod \"maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb\" (UID: \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:24:11.362188 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.362047    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-maas-api-tls\") pod \"maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb\" (UID: \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:24:11.362188 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.362090    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-metrics-certs\") pod \"maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb\" (UID: \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:24:11.362188 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.362136    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-openshift-service-ca\") pod \"maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb\" (UID: \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:24:11.463209 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.463128    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-metrics-certs\") pod \"maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb\" (UID: \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:24:11.463209 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.463168    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-openshift-service-ca\") pod \"maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb\" (UID: \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:24:11.463416 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.463218    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msbt7\" (UniqueName: \"kubernetes.io/projected/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-kube-api-access-msbt7\") pod \"maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb\" (UID: \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:24:11.463416 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.463378    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-maas-api-tls\") pod \"maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb\" (UID: \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:24:11.463966 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.463936    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-openshift-service-ca\") pod \"maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb\" (UID: \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:24:11.465513 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.465496    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-metrics-certs\") pod \"maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb\" (UID: \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:24:11.465636 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.465618    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-maas-api-tls\") pod \"maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb\" (UID: \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:24:11.471576 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.471546    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msbt7\" (UniqueName: \"kubernetes.io/projected/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-kube-api-access-msbt7\") pod \"maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb\" (UID: \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:24:11.516549 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.516523    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:24:11.787469 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:11.787444    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"]
Sep 09 14:24:11.789823 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:24:11.789792    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec3553eb_d413_4b3a_9aa6_9d4a7089fafe.slice/crio-3e8d2c245dff99f3936ce11dc09f0c5ff6aac9b2f569907101acd638825412cf WatchSource:0}: Error finding container 3e8d2c245dff99f3936ce11dc09f0c5ff6aac9b2f569907101acd638825412cf: Status 404 returned error can't find the container with id 3e8d2c245dff99f3936ce11dc09f0c5ff6aac9b2f569907101acd638825412cf
Sep 09 14:24:12.103587 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:12.103466    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb" event={"ID":"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe","Type":"ContainerStarted","Data":"3e8d2c245dff99f3936ce11dc09f0c5ff6aac9b2f569907101acd638825412cf"}
Sep 09 14:24:12.201557 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:12.201526    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:24:15.120058 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:15.120026    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb" event={"ID":"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe","Type":"ContainerStarted","Data":"884984c8eaecf62d9df64f362d71e82983324c71d14f4f1ff821cd9a578b58fa"}
Sep 09 14:24:15.120464 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:15.120149    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:24:15.137938 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:15.137894    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb" podStartSLOduration=1.810206304 podStartE2EDuration="4.13788117s" totalImagesPullingTime="2.327674866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:24:15.135853359 +0000 UTC m=+805.939836373" watchObservedRunningTime="2026-09-09 14:24:15.13788117 +0000 UTC m=+805.941864172"
Sep 09 14:24:21.130305 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:21.130276    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:24:26.541221 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:26.541189    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"]
Sep 09 14:24:26.544678 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:26.544656    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:26.546970 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:26.546950    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-d85f87-serving-cert\""
Sep 09 14:24:26.556022 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:26.555994    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"]
Sep 09 14:24:26.590237 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:26.590203    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6c4d\" (UniqueName: \"kubernetes.io/projected/00e5a559-a840-4ee5-9dda-c50171b2aca8-kube-api-access-c6c4d\") pod \"maas-api-e2e-inf-b-d85f87-6745b9787b-w664q\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:26.590408 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:26.590250    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00e5a559-a840-4ee5-9dda-c50171b2aca8-metrics-certs\") pod \"maas-api-e2e-inf-b-d85f87-6745b9787b-w664q\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:26.590408 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:26.590307    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e5a559-a840-4ee5-9dda-c50171b2aca8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d85f87-6745b9787b-w664q\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:26.590408 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:26.590360    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00e5a559-a840-4ee5-9dda-c50171b2aca8-maas-api-tls\") pod \"maas-api-e2e-inf-b-d85f87-6745b9787b-w664q\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:26.691896 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:26.691841    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00e5a559-a840-4ee5-9dda-c50171b2aca8-metrics-certs\") pod \"maas-api-e2e-inf-b-d85f87-6745b9787b-w664q\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:26.692101 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:26.691913    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e5a559-a840-4ee5-9dda-c50171b2aca8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d85f87-6745b9787b-w664q\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:26.692101 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:26.691976    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00e5a559-a840-4ee5-9dda-c50171b2aca8-maas-api-tls\") pod \"maas-api-e2e-inf-b-d85f87-6745b9787b-w664q\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:26.692101 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:26.692095    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6c4d\" (UniqueName: \"kubernetes.io/projected/00e5a559-a840-4ee5-9dda-c50171b2aca8-kube-api-access-c6c4d\") pod \"maas-api-e2e-inf-b-d85f87-6745b9787b-w664q\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:26.692454 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:24:26.692429    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-serving-cert: secret "maas-api-e2e-inf-b-d85f87-serving-cert" not found
Sep 09 14:24:26.692683 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:24:26.692660    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e5a559-a840-4ee5-9dda-c50171b2aca8-maas-api-tls podName:00e5a559-a840-4ee5-9dda-c50171b2aca8 nodeName:}" failed. No retries permitted until 2026-09-09 14:24:27.192637083 +0000 UTC m=+817.996620079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/00e5a559-a840-4ee5-9dda-c50171b2aca8-maas-api-tls") pod "maas-api-e2e-inf-b-d85f87-6745b9787b-w664q" (UID: "00e5a559-a840-4ee5-9dda-c50171b2aca8") : secret "maas-api-e2e-inf-b-d85f87-serving-cert" not found
Sep 09 14:24:26.693083 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:26.693057    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e5a559-a840-4ee5-9dda-c50171b2aca8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d85f87-6745b9787b-w664q\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:26.695233 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:26.695211    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00e5a559-a840-4ee5-9dda-c50171b2aca8-metrics-certs\") pod \"maas-api-e2e-inf-b-d85f87-6745b9787b-w664q\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:26.705698 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:26.705621    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6c4d\" (UniqueName: \"kubernetes.io/projected/00e5a559-a840-4ee5-9dda-c50171b2aca8-kube-api-access-c6c4d\") pod \"maas-api-e2e-inf-b-d85f87-6745b9787b-w664q\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:27.197093 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:27.197055    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00e5a559-a840-4ee5-9dda-c50171b2aca8-maas-api-tls\") pod \"maas-api-e2e-inf-b-d85f87-6745b9787b-w664q\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:27.199423 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:27.199398    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00e5a559-a840-4ee5-9dda-c50171b2aca8-maas-api-tls\") pod \"maas-api-e2e-inf-b-d85f87-6745b9787b-w664q\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:27.458608 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:27.458545    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:27.731373 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:27.731345    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"]
Sep 09 14:24:27.733087 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:24:27.733050    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e5a559_a840_4ee5_9dda_c50171b2aca8.slice/crio-5fc2ccef0492183268aa09fa398434d64eb89c84944fab256ef9112d17b91b7d WatchSource:0}: Error finding container 5fc2ccef0492183268aa09fa398434d64eb89c84944fab256ef9112d17b91b7d: Status 404 returned error can't find the container with id 5fc2ccef0492183268aa09fa398434d64eb89c84944fab256ef9112d17b91b7d
Sep 09 14:24:28.185474 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:28.185443    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q" event={"ID":"00e5a559-a840-4ee5-9dda-c50171b2aca8","Type":"ContainerStarted","Data":"5fc2ccef0492183268aa09fa398434d64eb89c84944fab256ef9112d17b91b7d"}
Sep 09 14:24:29.191726 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:29.191684    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q" event={"ID":"00e5a559-a840-4ee5-9dda-c50171b2aca8","Type":"ContainerStarted","Data":"d42c38c5805adaf96629df545ef14606c28188dc0b26746b06dbe0692c9b9b25"}
Sep 09 14:24:29.192094 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:29.191760    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:29.209146 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:29.209102    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q" podStartSLOduration=2.803253227 podStartE2EDuration="3.209086798s" totalImagesPullingTime="405.833571ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:24:29.207630246 +0000 UTC m=+820.011613250" watchObservedRunningTime="2026-09-09 14:24:29.209086798 +0000 UTC m=+820.013069848"
Sep 09 14:24:35.202042 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:35.202016    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:24:35.222806 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:35.222780    2553 generic.go:356] "Generic (PLEG): container finished" podID="37f18f84-16df-4be4-8824-8650cf737dce" containerID="eb61ae2f3fc5784c55d053c883bd70f13ef3e0bc62ec4d25d404917bda624c67" exitCode=0
Sep 09 14:24:35.222913 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:35.222850    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd" event={"ID":"37f18f84-16df-4be4-8824-8650cf737dce","Type":"ContainerDied","Data":"eb61ae2f3fc5784c55d053c883bd70f13ef3e0bc62ec4d25d404917bda624c67"}
Sep 09 14:24:35.223225 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:35.223212    2553 scope.go:117] "RemoveContainer" containerID="eb61ae2f3fc5784c55d053c883bd70f13ef3e0bc62ec4d25d404917bda624c67"
Sep 09 14:24:35.224281 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:35.224255    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:24:35.224342 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:35.224319    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:24:35.224379 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:35.224356    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:24:36.229819 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:36.229785    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd" event={"ID":"37f18f84-16df-4be4-8824-8650cf737dce","Type":"ContainerStarted","Data":"f1c2c498e2ee4c6de48fec436e668f8eae5ec6e8e63d118694e853fbea483a1f"}
Sep 09 14:24:36.805846 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:36.805810    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:24:37.035246 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:37.035210    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:37.036277 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:37.036250    2553 patch_prober.go:28] interesting pod/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 09 14:24:37.036394 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:37.036329    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd" podUID="37f18f84-16df-4be4-8824-8650cf737dce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 09 14:24:38.034464 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:38.034425    2553 patch_prober.go:28] interesting pod/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 09 14:24:38.034944 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:38.034488    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd" podUID="37f18f84-16df-4be4-8824-8650cf737dce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 09 14:24:39.034645 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:39.034612    2553 patch_prober.go:28] interesting pod/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 09 14:24:39.035038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:39.034672    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd" podUID="37f18f84-16df-4be4-8824-8650cf737dce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 09 14:24:39.083825 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:39.083778    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:40.034771 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:40.034738    2553 patch_prober.go:28] interesting pod/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 09 14:24:40.035129 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:40.034790    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd" podUID="37f18f84-16df-4be4-8824-8650cf737dce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 09 14:24:41.034480 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:41.034442    2553 patch_prober.go:28] interesting pod/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 09 14:24:41.034671 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:41.034498    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd" podUID="37f18f84-16df-4be4-8824-8650cf737dce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 09 14:24:42.038252 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:42.038221    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:42.039120 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:42.039101    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:24:46.524464 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.524427    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"]
Sep 09 14:24:46.527686 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.527658    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.530033 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.529995    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-3e00fb33-gw-openshift-default-dockercfg-4j2jr\""
Sep 09 14:24:46.541627 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.541605    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"]
Sep 09 14:24:46.667616 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.667581    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-credential-socket\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.667765 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.667632    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw2sj\" (UniqueName: \"kubernetes.io/projected/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-kube-api-access-bw2sj\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.667765 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.667660    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-token\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.667765 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.667690    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-envoy\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.667877 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.667759    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-data\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.667877 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.667829    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-podinfo\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.667877 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.667857    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-workload-socket\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.667974 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.667881    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istiod-ca-cert\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.667974 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.667956    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-workload-certs\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.768736 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.768700    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-envoy\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.768736 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.768740    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-data\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.768965 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.768781    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-podinfo\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.768965 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.768806    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-workload-socket\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.768965 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.768828    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istiod-ca-cert\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.768965 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.768885    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-workload-certs\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.768965 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.768939    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-credential-socket\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.769215 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.768976    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw2sj\" (UniqueName: \"kubernetes.io/projected/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-kube-api-access-bw2sj\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.769215 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.769014    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-token\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.769334 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.769264    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-workload-socket\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.769485 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.769458    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-credential-socket\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.769598 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.769485    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-workload-certs\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.769661 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.769592    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-data\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.769777 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.769751    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istiod-ca-cert\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.771045 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.771028    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-envoy\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.771309 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.771288    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-podinfo\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.776707 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.776657    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-token\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.778631 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.778611    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw2sj\" (UniqueName: \"kubernetes.io/projected/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-kube-api-access-bw2sj\") pod \"e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") " pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:46.838071 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:46.838040    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:47.124425 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:47.124400    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"]
Sep 09 14:24:47.129211 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:24:47.129177    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d8c0bc3_7f1b_4e22_ab03_0020456030e5.slice/crio-74234cd1f6a8abe81e2fa64e9b4209354b6424dd95baa369ca3b6d4c2b42b92a WatchSource:0}: Error finding container 74234cd1f6a8abe81e2fa64e9b4209354b6424dd95baa369ca3b6d4c2b42b92a: Status 404 returned error can't find the container with id 74234cd1f6a8abe81e2fa64e9b4209354b6424dd95baa369ca3b6d4c2b42b92a
Sep 09 14:24:47.131932 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:47.131899    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:24:47.132017 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:47.131962    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:24:47.132017 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:47.131990    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:24:47.293665 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:47.293630    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn" event={"ID":"0d8c0bc3-7f1b-4e22-ab03-0020456030e5","Type":"ContainerStarted","Data":"2708f178f2750aac5649f8f13973e39b4854872d1972ec7a90ab6e02dfe90964"}
Sep 09 14:24:47.293854 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:47.293688    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn" event={"ID":"0d8c0bc3-7f1b-4e22-ab03-0020456030e5","Type":"ContainerStarted","Data":"74234cd1f6a8abe81e2fa64e9b4209354b6424dd95baa369ca3b6d4c2b42b92a"}
Sep 09 14:24:47.315661 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:47.315609    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn" podStartSLOduration=1.315589456 podStartE2EDuration="1.315589456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:24:47.313151267 +0000 UTC m=+838.117134271" watchObservedRunningTime="2026-09-09 14:24:47.315589456 +0000 UTC m=+838.119572454"
Sep 09 14:24:47.839021 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:47.838987    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:48.844115 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:48.844083    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:49.304863 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:49.304837    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:24:49.305683 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:24:49.305663    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:25:00.995875 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:00.995831    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:25:11.409252 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:11.409175    2553 generic.go:356] "Generic (PLEG): container finished" podID="0d8c0bc3-7f1b-4e22-ab03-0020456030e5" containerID="2708f178f2750aac5649f8f13973e39b4854872d1972ec7a90ab6e02dfe90964" exitCode=0
Sep 09 14:25:11.409655 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:11.409252    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn" event={"ID":"0d8c0bc3-7f1b-4e22-ab03-0020456030e5","Type":"ContainerDied","Data":"2708f178f2750aac5649f8f13973e39b4854872d1972ec7a90ab6e02dfe90964"}
Sep 09 14:25:11.409701 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:11.409661    2553 scope.go:117] "RemoveContainer" containerID="2708f178f2750aac5649f8f13973e39b4854872d1972ec7a90ab6e02dfe90964"
Sep 09 14:25:11.410777 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:11.410736    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:25:11.410861 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:11.410814    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:25:11.410861 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:11.410845    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:25:12.415885 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:12.415848    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn" event={"ID":"0d8c0bc3-7f1b-4e22-ab03-0020456030e5","Type":"ContainerStarted","Data":"4f63ba87ebe821f85ce6882b08c26759fcca16aefb6671e45e70da26959f61c1"}
Sep 09 14:25:12.839055 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:12.839019    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:25:12.839304 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:12.839278    2553 patch_prober.go:28] interesting pod/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 09 14:25:12.839388 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:12.839346    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn" podUID="0d8c0bc3-7f1b-4e22-ab03-0020456030e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 09 14:25:13.846953 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:13.846915    2553 patch_prober.go:28] interesting pod/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 09 14:25:13.847534 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:13.847500    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn" podUID="0d8c0bc3-7f1b-4e22-ab03-0020456030e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 09 14:25:14.839435 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:14.839398    2553 patch_prober.go:28] interesting pod/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 09 14:25:14.839763 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:14.839733    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn" podUID="0d8c0bc3-7f1b-4e22-ab03-0020456030e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 09 14:25:15.839216 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:15.839169    2553 patch_prober.go:28] interesting pod/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 09 14:25:15.839726 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:15.839238    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn" podUID="0d8c0bc3-7f1b-4e22-ab03-0020456030e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 09 14:25:16.838861 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:16.838822    2553 patch_prober.go:28] interesting pod/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 09 14:25:16.839109 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:16.839080    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn" podUID="0d8c0bc3-7f1b-4e22-ab03-0020456030e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 09 14:25:17.842116 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:17.842086    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:25:17.842481 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:17.842450    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:25:17.843089 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:17.843069    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:25:19.497189 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:19.497156    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:25:20.787670 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:20.787638    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"]
Sep 09 14:25:20.788096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:20.787847    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn" podUID="0d8c0bc3-7f1b-4e22-ab03-0020456030e5" containerName="istio-proxy" containerID="cri-o://4f63ba87ebe821f85ce6882b08c26759fcca16aefb6671e45e70da26959f61c1" gracePeriod=30
Sep 09 14:25:26.028227 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.028200    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:25:26.109813 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.109742    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-envoy\") pod \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") "
Sep 09 14:25:26.109813 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.109782    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-workload-certs\") pod \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") "
Sep 09 14:25:26.109813 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.109805    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-data\") pod \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") "
Sep 09 14:25:26.110038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.109858    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-credential-socket\") pod \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") "
Sep 09 14:25:26.110038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.109891    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw2sj\" (UniqueName: \"kubernetes.io/projected/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-kube-api-access-bw2sj\") pod \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") "
Sep 09 14:25:26.110038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.109917    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-token\") pod \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") "
Sep 09 14:25:26.110038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.109952    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istiod-ca-cert\") pod \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") "
Sep 09 14:25:26.110038 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.109984    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-workload-socket\") pod \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") "
Sep 09 14:25:26.110245 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.110073    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0d8c0bc3-7f1b-4e22-ab03-0020456030e5" (UID: "0d8c0bc3-7f1b-4e22-ab03-0020456030e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:25:26.110245 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.110109    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-podinfo\") pod \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\" (UID: \"0d8c0bc3-7f1b-4e22-ab03-0020456030e5\") "
Sep 09 14:25:26.110245 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.110212    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "0d8c0bc3-7f1b-4e22-ab03-0020456030e5" (UID: "0d8c0bc3-7f1b-4e22-ab03-0020456030e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:25:26.110245 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.110218    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0d8c0bc3-7f1b-4e22-ab03-0020456030e5" (UID: "0d8c0bc3-7f1b-4e22-ab03-0020456030e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:25:26.110488 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.110468    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-workload-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:25:26.110688 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.110668    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-data\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:25:26.110794 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.110690    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-credential-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:25:26.110794 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.110549    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0d8c0bc3-7f1b-4e22-ab03-0020456030e5" (UID: "0d8c0bc3-7f1b-4e22-ab03-0020456030e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:25:26.110794 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.110688    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0d8c0bc3-7f1b-4e22-ab03-0020456030e5" (UID: "0d8c0bc3-7f1b-4e22-ab03-0020456030e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:25:26.112106 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.112075    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "0d8c0bc3-7f1b-4e22-ab03-0020456030e5" (UID: "0d8c0bc3-7f1b-4e22-ab03-0020456030e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:25:26.112185 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.112132    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-kube-api-access-bw2sj" (OuterVolumeSpecName: "kube-api-access-bw2sj") pod "0d8c0bc3-7f1b-4e22-ab03-0020456030e5" (UID: "0d8c0bc3-7f1b-4e22-ab03-0020456030e5"). InnerVolumeSpecName "kube-api-access-bw2sj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:25:26.112379 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.112351    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0d8c0bc3-7f1b-4e22-ab03-0020456030e5" (UID: "0d8c0bc3-7f1b-4e22-ab03-0020456030e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:25:26.112379 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.112365    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0d8c0bc3-7f1b-4e22-ab03-0020456030e5" (UID: "0d8c0bc3-7f1b-4e22-ab03-0020456030e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:25:26.211463 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.211442    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw2sj\" (UniqueName: \"kubernetes.io/projected/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-kube-api-access-bw2sj\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:25:26.211463 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.211465    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-token\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:25:26.211619 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.211474    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istiod-ca-cert\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:25:26.211619 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.211482    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-workload-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:25:26.211619 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.211491    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-podinfo\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:25:26.211619 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.211499    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d8c0bc3-7f1b-4e22-ab03-0020456030e5-istio-envoy\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:25:26.487178 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.487149    2553 generic.go:356] "Generic (PLEG): container finished" podID="0d8c0bc3-7f1b-4e22-ab03-0020456030e5" containerID="4f63ba87ebe821f85ce6882b08c26759fcca16aefb6671e45e70da26959f61c1" exitCode=0
Sep 09 14:25:26.487336 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.487197    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"
Sep 09 14:25:26.487336 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.487197    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn" event={"ID":"0d8c0bc3-7f1b-4e22-ab03-0020456030e5","Type":"ContainerDied","Data":"4f63ba87ebe821f85ce6882b08c26759fcca16aefb6671e45e70da26959f61c1"}
Sep 09 14:25:26.487336 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.487312    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn" event={"ID":"0d8c0bc3-7f1b-4e22-ab03-0020456030e5","Type":"ContainerDied","Data":"74234cd1f6a8abe81e2fa64e9b4209354b6424dd95baa369ca3b6d4c2b42b92a"}
Sep 09 14:25:26.487460 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.487338    2553 scope.go:117] "RemoveContainer" containerID="4f63ba87ebe821f85ce6882b08c26759fcca16aefb6671e45e70da26959f61c1"
Sep 09 14:25:26.496701 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.496683    2553 scope.go:117] "RemoveContainer" containerID="2708f178f2750aac5649f8f13973e39b4854872d1972ec7a90ab6e02dfe90964"
Sep 09 14:25:26.504517 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.504499    2553 scope.go:117] "RemoveContainer" containerID="4f63ba87ebe821f85ce6882b08c26759fcca16aefb6671e45e70da26959f61c1"
Sep 09 14:25:26.504843 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:25:26.504824    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f63ba87ebe821f85ce6882b08c26759fcca16aefb6671e45e70da26959f61c1\": container with ID starting with 4f63ba87ebe821f85ce6882b08c26759fcca16aefb6671e45e70da26959f61c1 not found: ID does not exist" containerID="4f63ba87ebe821f85ce6882b08c26759fcca16aefb6671e45e70da26959f61c1"
Sep 09 14:25:26.504914 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.504849    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f63ba87ebe821f85ce6882b08c26759fcca16aefb6671e45e70da26959f61c1"} err="failed to get container status \"4f63ba87ebe821f85ce6882b08c26759fcca16aefb6671e45e70da26959f61c1\": rpc error: code = NotFound desc = could not find container \"4f63ba87ebe821f85ce6882b08c26759fcca16aefb6671e45e70da26959f61c1\": container with ID starting with 4f63ba87ebe821f85ce6882b08c26759fcca16aefb6671e45e70da26959f61c1 not found: ID does not exist"
Sep 09 14:25:26.504914 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.504867    2553 scope.go:117] "RemoveContainer" containerID="2708f178f2750aac5649f8f13973e39b4854872d1972ec7a90ab6e02dfe90964"
Sep 09 14:25:26.505121 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:25:26.505095    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2708f178f2750aac5649f8f13973e39b4854872d1972ec7a90ab6e02dfe90964\": container with ID starting with 2708f178f2750aac5649f8f13973e39b4854872d1972ec7a90ab6e02dfe90964 not found: ID does not exist" containerID="2708f178f2750aac5649f8f13973e39b4854872d1972ec7a90ab6e02dfe90964"
Sep 09 14:25:26.505178 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.505131    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2708f178f2750aac5649f8f13973e39b4854872d1972ec7a90ab6e02dfe90964"} err="failed to get container status \"2708f178f2750aac5649f8f13973e39b4854872d1972ec7a90ab6e02dfe90964\": rpc error: code = NotFound desc = could not find container \"2708f178f2750aac5649f8f13973e39b4854872d1972ec7a90ab6e02dfe90964\": container with ID starting with 2708f178f2750aac5649f8f13973e39b4854872d1972ec7a90ab6e02dfe90964 not found: ID does not exist"
Sep 09 14:25:26.509909 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.509890    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"]
Sep 09 14:25:26.513386 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:26.513363    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-3e00fb33-gw-openshift-default-fc86b5948-xwvnn"]
Sep 09 14:25:27.646803 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:27.646772    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d8c0bc3-7f1b-4e22-ab03-0020456030e5" path="/var/lib/kubelet/pods/0d8c0bc3-7f1b-4e22-ab03-0020456030e5/volumes"
Sep 09 14:25:47.303042 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:47.302967    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:25:57.942418 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:57.942382    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"]
Sep 09 14:25:57.942920 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:57.942755    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d8c0bc3-7f1b-4e22-ab03-0020456030e5" containerName="istio-proxy"
Sep 09 14:25:57.942920 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:57.942768    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d8c0bc3-7f1b-4e22-ab03-0020456030e5" containerName="istio-proxy"
Sep 09 14:25:57.942920 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:57.942853    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d8c0bc3-7f1b-4e22-ab03-0020456030e5" containerName="istio-proxy"
Sep 09 14:25:57.942920 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:57.942863    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d8c0bc3-7f1b-4e22-ab03-0020456030e5" containerName="istio-proxy"
Sep 09 14:25:57.945425 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:57.945409    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:57.947697 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:57.947673    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a80b9686-openshift-default-dockercfg-7s7kh\""
Sep 09 14:25:57.955880 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:57.955849    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"]
Sep 09 14:25:58.075598 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.075550    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-podinfo\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.075598 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.075603    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-token\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.075790 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.075622    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istiod-ca-cert\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.075790 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.075679    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-envoy\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.075790 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.075761    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmwqn\" (UniqueName: \"kubernetes.io/projected/d19f4242-1b1c-40e4-83f8-278b7b0172d8-kube-api-access-cmwqn\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.075890 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.075837    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-workload-socket\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.075890 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.075875    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-data\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.075959 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.075945    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-credential-socket\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.075994 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.075975    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-workload-certs\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.176957 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.176925    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-data\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.177132 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.176976    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-credential-socket\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.177132 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.177009    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-workload-certs\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.177132 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.177048    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-podinfo\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.177132 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.177072    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-token\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.177132 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.177095    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istiod-ca-cert\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.177400 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.177134    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-envoy\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.177400 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.177165    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmwqn\" (UniqueName: \"kubernetes.io/projected/d19f4242-1b1c-40e4-83f8-278b7b0172d8-kube-api-access-cmwqn\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.177400 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.177234    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-workload-socket\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.177400 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.177349    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-data\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.177704 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.177396    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-credential-socket\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.177704 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.177425    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-workload-certs\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.184046 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.178010    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-workload-socket\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.184046 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.178247    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istiod-ca-cert\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.184291 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.184269    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-envoy\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.184987 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.184961    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-podinfo\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.186538 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.186517    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmwqn\" (UniqueName: \"kubernetes.io/projected/d19f4242-1b1c-40e4-83f8-278b7b0172d8-kube-api-access-cmwqn\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.186765 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.186746    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-token\") pod \"e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") " pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.256498 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.256420    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:58.533901 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.533750    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"]
Sep 09 14:25:58.539301 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:25:58.539268    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd19f4242_1b1c_40e4_83f8_278b7b0172d8.slice/crio-4a907240859978f452e5d7b07ae2d360035bb26ac9c510e22456069f42d9ab66 WatchSource:0}: Error finding container 4a907240859978f452e5d7b07ae2d360035bb26ac9c510e22456069f42d9ab66: Status 404 returned error can't find the container with id 4a907240859978f452e5d7b07ae2d360035bb26ac9c510e22456069f42d9ab66
Sep 09 14:25:58.542366 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.542320    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:25:58.542457 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.542417    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:25:58.542498 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.542462    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:25:58.653492 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.653451    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn" event={"ID":"d19f4242-1b1c-40e4-83f8-278b7b0172d8","Type":"ContainerStarted","Data":"2f0e67d3933cf1cf9b3bc1fcb3863b2ec7c6d795aead1e1b09806e0e733f113a"}
Sep 09 14:25:58.653671 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.653507    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn" event={"ID":"d19f4242-1b1c-40e4-83f8-278b7b0172d8","Type":"ContainerStarted","Data":"4a907240859978f452e5d7b07ae2d360035bb26ac9c510e22456069f42d9ab66"}
Sep 09 14:25:58.674898 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:58.674851    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn" podStartSLOduration=1.674836014 podStartE2EDuration="1.674836014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:25:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:25:58.671995801 +0000 UTC m=+909.475978829" watchObservedRunningTime="2026-09-09 14:25:58.674836014 +0000 UTC m=+909.478819017"
Sep 09 14:25:59.257222 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:59.257192    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:59.262107 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:59.262083    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:59.658446 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:59.658370    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:25:59.659299 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:25:59.659281    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:26:01.083101 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.083066    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"]
Sep 09 14:26:01.083523 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.083478    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d8c0bc3-7f1b-4e22-ab03-0020456030e5" containerName="istio-proxy"
Sep 09 14:26:01.083658 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.083525    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d8c0bc3-7f1b-4e22-ab03-0020456030e5" containerName="istio-proxy"
Sep 09 14:26:01.085355 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.085338    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.088482 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.088451    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-a2ffe2\"/\"autores-model-a2ffe2-kserve-self-signed-certs\""
Sep 09 14:26:01.088587 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.088454    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-a2ffe2\"/\"kube-root-ca.crt\""
Sep 09 14:26:01.088587 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.088488    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-a2ffe2\"/\"default-dockercfg-r4wzk\""
Sep 09 14:26:01.088804 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.088787    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-a2ffe2\"/\"openshift-service-ca.crt\""
Sep 09 14:26:01.097720 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.097699    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"]
Sep 09 14:26:01.205985 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.205955    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-home\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.206115 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.205997    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-model-cache\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.206115 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.206015    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-tmp-dir\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.206115 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.206038    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-dshm\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.206115 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.206080    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9s44\" (UniqueName: \"kubernetes.io/projected/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-kube-api-access-v9s44\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.206115 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.206109    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-tls-certs\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.307365 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.307337    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9s44\" (UniqueName: \"kubernetes.io/projected/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-kube-api-access-v9s44\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.307494 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.307376    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-tls-certs\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.307494 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.307420    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-home\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.307494 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.307448    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-model-cache\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.307494 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.307463    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-tmp-dir\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.307494 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.307480    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-dshm\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.307848 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.307827    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-home\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.307922 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.307878    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-model-cache\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.307972 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.307947    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-tmp-dir\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.309652 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.309635    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-dshm\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.309903 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.309887    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-tls-certs\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.315460 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.315434    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9s44\" (UniqueName: \"kubernetes.io/projected/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-kube-api-access-v9s44\") pod \"autores-model-a2ffe2-kserve-588b4495d7-s7gr4\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") " pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.395325 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.395243    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:01.685753 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:01.685616    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"]
Sep 09 14:26:01.688236 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:26:01.688213    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01c9e11e_bee2_48d1_96ce_30bb3f78bfd9.slice/crio-9897516c39011590d3b3d833b55da246feb2689478de9fdcaa6a483f4f6eeeb6 WatchSource:0}: Error finding container 9897516c39011590d3b3d833b55da246feb2689478de9fdcaa6a483f4f6eeeb6: Status 404 returned error can't find the container with id 9897516c39011590d3b3d833b55da246feb2689478de9fdcaa6a483f4f6eeeb6
Sep 09 14:26:02.674770 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:02.674728    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4" event={"ID":"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9","Type":"ContainerStarted","Data":"babecf655e8bfa8a7143a570803ed0c88c6efa2b78001f84e4769972cb815968"}
Sep 09 14:26:02.675214 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:02.674779    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4" event={"ID":"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9","Type":"ContainerStarted","Data":"9897516c39011590d3b3d833b55da246feb2689478de9fdcaa6a483f4f6eeeb6"}
Sep 09 14:26:02.693302 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:02.693249    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4" podStartSLOduration=1.693234363 podStartE2EDuration="1.693234363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:26:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:26:02.692584882 +0000 UTC m=+913.496567879" watchObservedRunningTime="2026-09-09 14:26:02.693234363 +0000 UTC m=+913.497217400"
Sep 09 14:26:06.596070 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:06.596033    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:26:11.395854 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:11.395810    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:11.396337 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:11.395877    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:11.408383 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:11.408350    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:11.730445 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:11.730419    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:15.700726 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:15.700681    2553 patch_prober.go:28] interesting pod/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 14:26:15.701096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:15.700756    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn" podUID="d19f4242-1b1c-40e4-83f8-278b7b0172d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 14:26:17.748042 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:17.748009    2553 generic.go:356] "Generic (PLEG): container finished" podID="d19f4242-1b1c-40e4-83f8-278b7b0172d8" containerID="2f0e67d3933cf1cf9b3bc1fcb3863b2ec7c6d795aead1e1b09806e0e733f113a" exitCode=0
Sep 09 14:26:17.748470 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:17.748082    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn" event={"ID":"d19f4242-1b1c-40e4-83f8-278b7b0172d8","Type":"ContainerDied","Data":"2f0e67d3933cf1cf9b3bc1fcb3863b2ec7c6d795aead1e1b09806e0e733f113a"}
Sep 09 14:26:17.748470 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:17.748462    2553 scope.go:117] "RemoveContainer" containerID="2f0e67d3933cf1cf9b3bc1fcb3863b2ec7c6d795aead1e1b09806e0e733f113a"
Sep 09 14:26:17.749509 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:17.749477    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:26:17.749629 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:17.749547    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:26:17.749629 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:17.749602    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:26:18.759979 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:18.759936    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn" event={"ID":"d19f4242-1b1c-40e4-83f8-278b7b0172d8","Type":"ContainerStarted","Data":"15463e39f850f6befd765919ccb7a8ebb03f317b22ece9ab7bb69cdbca0b872a"}
Sep 09 14:26:19.257693 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.257655    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:26:19.257901 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.257789    2553 patch_prober.go:28] interesting pod/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 09 14:26:19.257901 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.257839    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn" podUID="d19f4242-1b1c-40e4-83f8-278b7b0172d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 09 14:26:19.297987 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.297957    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"]
Sep 09 14:26:19.300308 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.300286    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.303229 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.303202    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a0fa5a\"/\"test-model-a0fa5a-kserve-self-signed-certs\""
Sep 09 14:26:19.303344 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.303228    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a0fa5a\"/\"openshift-service-ca.crt\""
Sep 09 14:26:19.303344 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.303219    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a0fa5a\"/\"kube-root-ca.crt\""
Sep 09 14:26:19.303344 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.303278    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a0fa5a\"/\"default-dockercfg-7ldcf\""
Sep 09 14:26:19.309477 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.309452    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"]
Sep 09 14:26:19.363026 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.362988    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzddm\" (UniqueName: \"kubernetes.io/projected/ceb69eff-0bd0-45e4-8dc7-898d9659f277-kube-api-access-wzddm\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.363199 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.363030    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-tmp-dir\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.363199 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.363063    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-dshm\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.363199 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.363100    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-model-cache\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.363199 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.363127    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ceb69eff-0bd0-45e4-8dc7-898d9659f277-tls-certs\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.363199 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.363145    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-home\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.464166 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.464129    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzddm\" (UniqueName: \"kubernetes.io/projected/ceb69eff-0bd0-45e4-8dc7-898d9659f277-kube-api-access-wzddm\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.464166 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.464169    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-tmp-dir\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.464417 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.464189    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-dshm\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.464417 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.464217    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-model-cache\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.464417 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.464251    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ceb69eff-0bd0-45e4-8dc7-898d9659f277-tls-certs\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.464417 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.464275    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-home\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.464711 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.464683    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-home\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.464711 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.464700    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-tmp-dir\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.464820 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.464765    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-model-cache\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.466574 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.466535    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-dshm\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.466863 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.466841    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ceb69eff-0bd0-45e4-8dc7-898d9659f277-tls-certs\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.471557 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.471528    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzddm\" (UniqueName: \"kubernetes.io/projected/ceb69eff-0bd0-45e4-8dc7-898d9659f277-kube-api-access-wzddm\") pod \"test-model-a0fa5a-kserve-c796d59b9-wlgmm\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") " pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.611122 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.611029    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:19.905594 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:19.905556    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"]
Sep 09 14:26:19.907616 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:26:19.907586    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podceb69eff_0bd0_45e4_8dc7_898d9659f277.slice/crio-5628b88da302c0d43156062f8e821176361ef02dd0ef3053e29f05fd8d0e2226 WatchSource:0}: Error finding container 5628b88da302c0d43156062f8e821176361ef02dd0ef3053e29f05fd8d0e2226: Status 404 returned error can't find the container with id 5628b88da302c0d43156062f8e821176361ef02dd0ef3053e29f05fd8d0e2226
Sep 09 14:26:20.256984 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:20.256942    2553 patch_prober.go:28] interesting pod/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 09 14:26:20.257227 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:20.257005    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn" podUID="d19f4242-1b1c-40e4-83f8-278b7b0172d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 09 14:26:20.772715 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:20.772679    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm" event={"ID":"ceb69eff-0bd0-45e4-8dc7-898d9659f277","Type":"ContainerStarted","Data":"91f1ab8a2aecc0207f9b6559e74f75a1d3a359b94bf2136d1829c6e559a0bd55"}
Sep 09 14:26:20.772715 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:20.772720    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm" event={"ID":"ceb69eff-0bd0-45e4-8dc7-898d9659f277","Type":"ContainerStarted","Data":"5628b88da302c0d43156062f8e821176361ef02dd0ef3053e29f05fd8d0e2226"}
Sep 09 14:26:20.790872 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:20.790828    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm" podStartSLOduration=1.7908129449999999 podStartE2EDuration="1.790812945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:26:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:26:20.789148143 +0000 UTC m=+931.593131146" watchObservedRunningTime="2026-09-09 14:26:20.790812945 +0000 UTC m=+931.594795947"
Sep 09 14:26:21.257461 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:21.257415    2553 patch_prober.go:28] interesting pod/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 09 14:26:21.257961 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:21.257485    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn" podUID="d19f4242-1b1c-40e4-83f8-278b7b0172d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 09 14:26:22.257768 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:22.257725    2553 patch_prober.go:28] interesting pod/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 09 14:26:22.258236 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:22.257789    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn" podUID="d19f4242-1b1c-40e4-83f8-278b7b0172d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 09 14:26:23.257817 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:23.257768    2553 patch_prober.go:28] interesting pod/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 09 14:26:23.258398 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:23.257844    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn" podUID="d19f4242-1b1c-40e4-83f8-278b7b0172d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 09 14:26:23.782501 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:23.782458    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"]
Sep 09 14:26:24.478433 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:24.478388    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:26:24.478989 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:24.478970    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:26:24.480401 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:24.480370    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:26:27.692518 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:27.692488    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:26:29.611582 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:29.611542    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:29.611989 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:29.611607    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:29.623777 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:29.623754    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:29.833324 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:29.833289    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:26:32.292646 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:32.292614    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"]
Sep 09 14:26:32.293052 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:32.292803    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn" podUID="d19f4242-1b1c-40e4-83f8-278b7b0172d8" containerName="istio-proxy" containerID="cri-o://15463e39f850f6befd765919ccb7a8ebb03f317b22ece9ab7bb69cdbca0b872a" gracePeriod=30
Sep 09 14:26:34.589922 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.589891    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"]
Sep 09 14:26:34.590489 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.590131    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb" podUID="ec3553eb-d413-4b3a-9aa6-9d4a7089fafe" containerName="maas-api" containerID="cri-o://884984c8eaecf62d9df64f362d71e82983324c71d14f4f1ff821cd9a578b58fa" gracePeriod=30
Sep 09 14:26:34.842308 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.842244    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:26:34.847664 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.847639    2553 generic.go:356] "Generic (PLEG): container finished" podID="ec3553eb-d413-4b3a-9aa6-9d4a7089fafe" containerID="884984c8eaecf62d9df64f362d71e82983324c71d14f4f1ff821cd9a578b58fa" exitCode=0
Sep 09 14:26:34.847784 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.847677    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"
Sep 09 14:26:34.847784 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.847674    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb" event={"ID":"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe","Type":"ContainerDied","Data":"884984c8eaecf62d9df64f362d71e82983324c71d14f4f1ff821cd9a578b58fa"}
Sep 09 14:26:34.847891 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.847801    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb" event={"ID":"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe","Type":"ContainerDied","Data":"3e8d2c245dff99f3936ce11dc09f0c5ff6aac9b2f569907101acd638825412cf"}
Sep 09 14:26:34.847891 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.847819    2553 scope.go:117] "RemoveContainer" containerID="884984c8eaecf62d9df64f362d71e82983324c71d14f4f1ff821cd9a578b58fa"
Sep 09 14:26:34.856350 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.856333    2553 scope.go:117] "RemoveContainer" containerID="884984c8eaecf62d9df64f362d71e82983324c71d14f4f1ff821cd9a578b58fa"
Sep 09 14:26:34.856616 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:26:34.856596    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"884984c8eaecf62d9df64f362d71e82983324c71d14f4f1ff821cd9a578b58fa\": container with ID starting with 884984c8eaecf62d9df64f362d71e82983324c71d14f4f1ff821cd9a578b58fa not found: ID does not exist" containerID="884984c8eaecf62d9df64f362d71e82983324c71d14f4f1ff821cd9a578b58fa"
Sep 09 14:26:34.856665 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.856625    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"884984c8eaecf62d9df64f362d71e82983324c71d14f4f1ff821cd9a578b58fa"} err="failed to get container status \"884984c8eaecf62d9df64f362d71e82983324c71d14f4f1ff821cd9a578b58fa\": rpc error: code = NotFound desc = could not find container \"884984c8eaecf62d9df64f362d71e82983324c71d14f4f1ff821cd9a578b58fa\": container with ID starting with 884984c8eaecf62d9df64f362d71e82983324c71d14f4f1ff821cd9a578b58fa not found: ID does not exist"
Sep 09 14:26:34.903679 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.903657    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-maas-api-tls\") pod \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\" (UID: \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\") "
Sep 09 14:26:34.903790 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.903753    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-metrics-certs\") pod \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\" (UID: \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\") "
Sep 09 14:26:34.903790 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.903781    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-openshift-service-ca\") pod \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\" (UID: \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\") "
Sep 09 14:26:34.903902 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.903801    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msbt7\" (UniqueName: \"kubernetes.io/projected/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-kube-api-access-msbt7\") pod \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\" (UID: \"ec3553eb-d413-4b3a-9aa6-9d4a7089fafe\") "
Sep 09 14:26:34.904069 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.904045    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ec3553eb-d413-4b3a-9aa6-9d4a7089fafe" (UID: "ec3553eb-d413-4b3a-9aa6-9d4a7089fafe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:26:34.905893 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.905870    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-kube-api-access-msbt7" (OuterVolumeSpecName: "kube-api-access-msbt7") pod "ec3553eb-d413-4b3a-9aa6-9d4a7089fafe" (UID: "ec3553eb-d413-4b3a-9aa6-9d4a7089fafe"). InnerVolumeSpecName "kube-api-access-msbt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:26:34.905980 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.905904    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ec3553eb-d413-4b3a-9aa6-9d4a7089fafe" (UID: "ec3553eb-d413-4b3a-9aa6-9d4a7089fafe"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:26:34.905980 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:34.905926    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ec3553eb-d413-4b3a-9aa6-9d4a7089fafe" (UID: "ec3553eb-d413-4b3a-9aa6-9d4a7089fafe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:26:35.005430 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:35.005358    2553 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-metrics-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:35.005430 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:35.005395    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-openshift-service-ca\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:35.005430 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:35.005411    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msbt7\" (UniqueName: \"kubernetes.io/projected/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-kube-api-access-msbt7\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:35.005430 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:35.005424    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe-maas-api-tls\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:35.171306 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:35.171274    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"]
Sep 09 14:26:35.175206 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:35.175182    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a2ffe2-55f6596c89-9jtvb"]
Sep 09 14:26:35.646787 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:35.646753    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec3553eb-d413-4b3a-9aa6-9d4a7089fafe" path="/var/lib/kubelet/pods/ec3553eb-d413-4b3a-9aa6-9d4a7089fafe/volumes"
Sep 09 14:26:37.543617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.543594    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:26:37.625686 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.625620    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istiod-ca-cert\") pod \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") "
Sep 09 14:26:37.625686 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.625667    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-token\") pod \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") "
Sep 09 14:26:37.625843 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.625692    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmwqn\" (UniqueName: \"kubernetes.io/projected/d19f4242-1b1c-40e4-83f8-278b7b0172d8-kube-api-access-cmwqn\") pod \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") "
Sep 09 14:26:37.625843 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.625717    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-data\") pod \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") "
Sep 09 14:26:37.625843 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.625742    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-credential-socket\") pod \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") "
Sep 09 14:26:37.625843 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.625776    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-envoy\") pod \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") "
Sep 09 14:26:37.625843 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.625800    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-workload-certs\") pod \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") "
Sep 09 14:26:37.625843 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.625828    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-workload-socket\") pod \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") "
Sep 09 14:26:37.626113 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.625921    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-podinfo\") pod \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\" (UID: \"d19f4242-1b1c-40e4-83f8-278b7b0172d8\") "
Sep 09 14:26:37.626113 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.626029    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d19f4242-1b1c-40e4-83f8-278b7b0172d8" (UID: "d19f4242-1b1c-40e4-83f8-278b7b0172d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:26:37.626218 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.626141    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-data" (OuterVolumeSpecName: "istio-data") pod "d19f4242-1b1c-40e4-83f8-278b7b0172d8" (UID: "d19f4242-1b1c-40e4-83f8-278b7b0172d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:37.626218 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.626151    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d19f4242-1b1c-40e4-83f8-278b7b0172d8" (UID: "d19f4242-1b1c-40e4-83f8-278b7b0172d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:37.626334 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.626237    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istiod-ca-cert\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:37.626334 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.626254    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-data\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:37.626334 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.626293    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-credential-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:37.626334 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.626326    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d19f4242-1b1c-40e4-83f8-278b7b0172d8" (UID: "d19f4242-1b1c-40e4-83f8-278b7b0172d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:37.626529 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.626344    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d19f4242-1b1c-40e4-83f8-278b7b0172d8" (UID: "d19f4242-1b1c-40e4-83f8-278b7b0172d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:37.627910 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.627880    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-token" (OuterVolumeSpecName: "istio-token") pod "d19f4242-1b1c-40e4-83f8-278b7b0172d8" (UID: "d19f4242-1b1c-40e4-83f8-278b7b0172d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:26:37.628017 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.627918    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d19f4242-1b1c-40e4-83f8-278b7b0172d8" (UID: "d19f4242-1b1c-40e4-83f8-278b7b0172d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:37.628067 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.628031    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d19f4242-1b1c-40e4-83f8-278b7b0172d8" (UID: "d19f4242-1b1c-40e4-83f8-278b7b0172d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:26:37.628109 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.628090    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d19f4242-1b1c-40e4-83f8-278b7b0172d8-kube-api-access-cmwqn" (OuterVolumeSpecName: "kube-api-access-cmwqn") pod "d19f4242-1b1c-40e4-83f8-278b7b0172d8" (UID: "d19f4242-1b1c-40e4-83f8-278b7b0172d8"). InnerVolumeSpecName "kube-api-access-cmwqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:26:37.727046 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.727023    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-token\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:37.727046 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.727044    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmwqn\" (UniqueName: \"kubernetes.io/projected/d19f4242-1b1c-40e4-83f8-278b7b0172d8-kube-api-access-cmwqn\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:37.727175 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.727054    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-envoy\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:37.727175 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.727066    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-workload-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:37.727175 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.727077    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d19f4242-1b1c-40e4-83f8-278b7b0172d8-workload-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:37.727175 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.727086    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d19f4242-1b1c-40e4-83f8-278b7b0172d8-istio-podinfo\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:37.864694 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.864664    2553 generic.go:356] "Generic (PLEG): container finished" podID="d19f4242-1b1c-40e4-83f8-278b7b0172d8" containerID="15463e39f850f6befd765919ccb7a8ebb03f317b22ece9ab7bb69cdbca0b872a" exitCode=0
Sep 09 14:26:37.864840 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.864718    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn" event={"ID":"d19f4242-1b1c-40e4-83f8-278b7b0172d8","Type":"ContainerDied","Data":"15463e39f850f6befd765919ccb7a8ebb03f317b22ece9ab7bb69cdbca0b872a"}
Sep 09 14:26:37.864840 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.864719    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"
Sep 09 14:26:37.864840 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.864762    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn" event={"ID":"d19f4242-1b1c-40e4-83f8-278b7b0172d8","Type":"ContainerDied","Data":"4a907240859978f452e5d7b07ae2d360035bb26ac9c510e22456069f42d9ab66"}
Sep 09 14:26:37.864840 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.864787    2553 scope.go:117] "RemoveContainer" containerID="15463e39f850f6befd765919ccb7a8ebb03f317b22ece9ab7bb69cdbca0b872a"
Sep 09 14:26:37.873350 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.873334    2553 scope.go:117] "RemoveContainer" containerID="2f0e67d3933cf1cf9b3bc1fcb3863b2ec7c6d795aead1e1b09806e0e733f113a"
Sep 09 14:26:37.882271 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.882249    2553 scope.go:117] "RemoveContainer" containerID="15463e39f850f6befd765919ccb7a8ebb03f317b22ece9ab7bb69cdbca0b872a"
Sep 09 14:26:37.882544 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:26:37.882524    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15463e39f850f6befd765919ccb7a8ebb03f317b22ece9ab7bb69cdbca0b872a\": container with ID starting with 15463e39f850f6befd765919ccb7a8ebb03f317b22ece9ab7bb69cdbca0b872a not found: ID does not exist" containerID="15463e39f850f6befd765919ccb7a8ebb03f317b22ece9ab7bb69cdbca0b872a"
Sep 09 14:26:37.882648 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.882606    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"]
Sep 09 14:26:37.882707 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.882555    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15463e39f850f6befd765919ccb7a8ebb03f317b22ece9ab7bb69cdbca0b872a"} err="failed to get container status \"15463e39f850f6befd765919ccb7a8ebb03f317b22ece9ab7bb69cdbca0b872a\": rpc error: code = NotFound desc = could not find container \"15463e39f850f6befd765919ccb7a8ebb03f317b22ece9ab7bb69cdbca0b872a\": container with ID starting with 15463e39f850f6befd765919ccb7a8ebb03f317b22ece9ab7bb69cdbca0b872a not found: ID does not exist"
Sep 09 14:26:37.882769 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.882709    2553 scope.go:117] "RemoveContainer" containerID="2f0e67d3933cf1cf9b3bc1fcb3863b2ec7c6d795aead1e1b09806e0e733f113a"
Sep 09 14:26:37.882982 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:26:37.882964    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f0e67d3933cf1cf9b3bc1fcb3863b2ec7c6d795aead1e1b09806e0e733f113a\": container with ID starting with 2f0e67d3933cf1cf9b3bc1fcb3863b2ec7c6d795aead1e1b09806e0e733f113a not found: ID does not exist" containerID="2f0e67d3933cf1cf9b3bc1fcb3863b2ec7c6d795aead1e1b09806e0e733f113a"
Sep 09 14:26:37.883034 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.882987    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f0e67d3933cf1cf9b3bc1fcb3863b2ec7c6d795aead1e1b09806e0e733f113a"} err="failed to get container status \"2f0e67d3933cf1cf9b3bc1fcb3863b2ec7c6d795aead1e1b09806e0e733f113a\": rpc error: code = NotFound desc = could not find container \"2f0e67d3933cf1cf9b3bc1fcb3863b2ec7c6d795aead1e1b09806e0e733f113a\": container with ID starting with 2f0e67d3933cf1cf9b3bc1fcb3863b2ec7c6d795aead1e1b09806e0e733f113a not found: ID does not exist"
Sep 09 14:26:37.886082 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:37.886060    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a80b9686-openshift-default-6c99cdbc6-n97sn"]
Sep 09 14:26:38.802731 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:38.802688    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4" podUID="01c9e11e-bee2-48d1-96ce-30bb3f78bfd9" containerName="main" containerID="cri-o://babecf655e8bfa8a7143a570803ed0c88c6efa2b78001f84e4769972cb815968" gracePeriod=45
Sep 09 14:26:39.053901 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.053828    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:39.137635 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.137607    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-home\") pod \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") "
Sep 09 14:26:39.137635 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.137641    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-model-cache\") pod \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") "
Sep 09 14:26:39.137867 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.137666    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9s44\" (UniqueName: \"kubernetes.io/projected/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-kube-api-access-v9s44\") pod \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") "
Sep 09 14:26:39.137867 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.137704    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-tmp-dir\") pod \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") "
Sep 09 14:26:39.137867 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.137772    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-dshm\") pod \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") "
Sep 09 14:26:39.137867 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.137810    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-tls-certs\") pod \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\" (UID: \"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9\") "
Sep 09 14:26:39.138050 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.137891    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-home" (OuterVolumeSpecName: "home") pod "01c9e11e-bee2-48d1-96ce-30bb3f78bfd9" (UID: "01c9e11e-bee2-48d1-96ce-30bb3f78bfd9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:39.138050 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.137910    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-model-cache" (OuterVolumeSpecName: "model-cache") pod "01c9e11e-bee2-48d1-96ce-30bb3f78bfd9" (UID: "01c9e11e-bee2-48d1-96ce-30bb3f78bfd9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:39.138050 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.137981    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "01c9e11e-bee2-48d1-96ce-30bb3f78bfd9" (UID: "01c9e11e-bee2-48d1-96ce-30bb3f78bfd9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:39.138050 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.138043    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-home\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:39.138189 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.138056    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-model-cache\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:39.138189 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.138071    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-tmp-dir\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:39.139896 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.139863    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "01c9e11e-bee2-48d1-96ce-30bb3f78bfd9" (UID: "01c9e11e-bee2-48d1-96ce-30bb3f78bfd9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:26:39.139896 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.139888    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-dshm" (OuterVolumeSpecName: "dshm") pod "01c9e11e-bee2-48d1-96ce-30bb3f78bfd9" (UID: "01c9e11e-bee2-48d1-96ce-30bb3f78bfd9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:39.140033 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.139988    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-kube-api-access-v9s44" (OuterVolumeSpecName: "kube-api-access-v9s44") pod "01c9e11e-bee2-48d1-96ce-30bb3f78bfd9" (UID: "01c9e11e-bee2-48d1-96ce-30bb3f78bfd9"). InnerVolumeSpecName "kube-api-access-v9s44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:26:39.238830 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.238800    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-dshm\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:39.238830 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.238826    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-tls-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:39.238995 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.238837    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9s44\" (UniqueName: \"kubernetes.io/projected/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9-kube-api-access-v9s44\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:39.650304 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.650269    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d19f4242-1b1c-40e4-83f8-278b7b0172d8" path="/var/lib/kubelet/pods/d19f4242-1b1c-40e4-83f8-278b7b0172d8/volumes"
Sep 09 14:26:39.876395 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.876363    2553 generic.go:356] "Generic (PLEG): container finished" podID="01c9e11e-bee2-48d1-96ce-30bb3f78bfd9" containerID="babecf655e8bfa8a7143a570803ed0c88c6efa2b78001f84e4769972cb815968" exitCode=0
Sep 09 14:26:39.876908 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.876418    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"
Sep 09 14:26:39.876908 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.876449    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4" event={"ID":"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9","Type":"ContainerDied","Data":"babecf655e8bfa8a7143a570803ed0c88c6efa2b78001f84e4769972cb815968"}
Sep 09 14:26:39.876908 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.876495    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4" event={"ID":"01c9e11e-bee2-48d1-96ce-30bb3f78bfd9","Type":"ContainerDied","Data":"9897516c39011590d3b3d833b55da246feb2689478de9fdcaa6a483f4f6eeeb6"}
Sep 09 14:26:39.876908 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.876513    2553 scope.go:117] "RemoveContainer" containerID="babecf655e8bfa8a7143a570803ed0c88c6efa2b78001f84e4769972cb815968"
Sep 09 14:26:39.885078 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.885057    2553 scope.go:117] "RemoveContainer" containerID="babecf655e8bfa8a7143a570803ed0c88c6efa2b78001f84e4769972cb815968"
Sep 09 14:26:39.885324 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:26:39.885302    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"babecf655e8bfa8a7143a570803ed0c88c6efa2b78001f84e4769972cb815968\": container with ID starting with babecf655e8bfa8a7143a570803ed0c88c6efa2b78001f84e4769972cb815968 not found: ID does not exist" containerID="babecf655e8bfa8a7143a570803ed0c88c6efa2b78001f84e4769972cb815968"
Sep 09 14:26:39.885418 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.885328    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"babecf655e8bfa8a7143a570803ed0c88c6efa2b78001f84e4769972cb815968"} err="failed to get container status \"babecf655e8bfa8a7143a570803ed0c88c6efa2b78001f84e4769972cb815968\": rpc error: code = NotFound desc = could not find container \"babecf655e8bfa8a7143a570803ed0c88c6efa2b78001f84e4769972cb815968\": container with ID starting with babecf655e8bfa8a7143a570803ed0c88c6efa2b78001f84e4769972cb815968 not found: ID does not exist"
Sep 09 14:26:39.895265 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.895241    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"]
Sep 09 14:26:39.899126 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:39.899106    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-a2ffe2/autores-model-a2ffe2-kserve-588b4495d7-s7gr4"]
Sep 09 14:26:41.646272 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:41.646240    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01c9e11e-bee2-48d1-96ce-30bb3f78bfd9" path="/var/lib/kubelet/pods/01c9e11e-bee2-48d1-96ce-30bb3f78bfd9/volumes"
Sep 09 14:26:42.872847 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:42.872812    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"]
Sep 09 14:26:42.873640 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:42.873603    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd" podUID="37f18f84-16df-4be4-8824-8650cf737dce" containerName="istio-proxy" containerID="cri-o://f1c2c498e2ee4c6de48fec436e668f8eae5ec6e8e63d118694e853fbea483a1f" gracePeriod=30
Sep 09 14:26:47.404959 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:47.404926    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:26:48.130164 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.130140    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:26:48.215024 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.214995    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37f18f84-16df-4be4-8824-8650cf737dce-istiod-ca-cert\") pod \"37f18f84-16df-4be4-8824-8650cf737dce\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") "
Sep 09 14:26:48.215198 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.215032    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-istio-data\") pod \"37f18f84-16df-4be4-8824-8650cf737dce\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") "
Sep 09 14:26:48.215198 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.215088    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-istio-envoy\") pod \"37f18f84-16df-4be4-8824-8650cf737dce\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") "
Sep 09 14:26:48.215198 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.215159    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37f18f84-16df-4be4-8824-8650cf737dce-istio-podinfo\") pod \"37f18f84-16df-4be4-8824-8650cf737dce\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") "
Sep 09 14:26:48.215368 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.215217    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f18f84-16df-4be4-8824-8650cf737dce-istio-token\") pod \"37f18f84-16df-4be4-8824-8650cf737dce\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") "
Sep 09 14:26:48.215368 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.215266    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-workload-certs\") pod \"37f18f84-16df-4be4-8824-8650cf737dce\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") "
Sep 09 14:26:48.215368 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.215278    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-istio-data" (OuterVolumeSpecName: "istio-data") pod "37f18f84-16df-4be4-8824-8650cf737dce" (UID: "37f18f84-16df-4be4-8824-8650cf737dce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:48.215368 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.215296    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z5tq\" (UniqueName: \"kubernetes.io/projected/37f18f84-16df-4be4-8824-8650cf737dce-kube-api-access-8z5tq\") pod \"37f18f84-16df-4be4-8824-8650cf737dce\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") "
Sep 09 14:26:48.215368 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.215326    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-workload-socket\") pod \"37f18f84-16df-4be4-8824-8650cf737dce\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") "
Sep 09 14:26:48.215368 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.215364    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-credential-socket\") pod \"37f18f84-16df-4be4-8824-8650cf737dce\" (UID: \"37f18f84-16df-4be4-8824-8650cf737dce\") "
Sep 09 14:26:48.215687 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.215456    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f18f84-16df-4be4-8824-8650cf737dce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "37f18f84-16df-4be4-8824-8650cf737dce" (UID: "37f18f84-16df-4be4-8824-8650cf737dce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:26:48.215687 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.215674    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37f18f84-16df-4be4-8824-8650cf737dce-istiod-ca-cert\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:48.215793 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.215692    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-istio-data\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:48.215793 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.215711    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "37f18f84-16df-4be4-8824-8650cf737dce" (UID: "37f18f84-16df-4be4-8824-8650cf737dce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:48.215793 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.215743    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "37f18f84-16df-4be4-8824-8650cf737dce" (UID: "37f18f84-16df-4be4-8824-8650cf737dce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:48.215793 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.215772    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "37f18f84-16df-4be4-8824-8650cf737dce" (UID: "37f18f84-16df-4be4-8824-8650cf737dce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:48.217331 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.217305    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "37f18f84-16df-4be4-8824-8650cf737dce" (UID: "37f18f84-16df-4be4-8824-8650cf737dce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:48.217475 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.217372    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f18f84-16df-4be4-8824-8650cf737dce-kube-api-access-8z5tq" (OuterVolumeSpecName: "kube-api-access-8z5tq") pod "37f18f84-16df-4be4-8824-8650cf737dce" (UID: "37f18f84-16df-4be4-8824-8650cf737dce"). InnerVolumeSpecName "kube-api-access-8z5tq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:26:48.217696 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.217671    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f18f84-16df-4be4-8824-8650cf737dce-istio-token" (OuterVolumeSpecName: "istio-token") pod "37f18f84-16df-4be4-8824-8650cf737dce" (UID: "37f18f84-16df-4be4-8824-8650cf737dce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:26:48.217696 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.217675    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37f18f84-16df-4be4-8824-8650cf737dce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "37f18f84-16df-4be4-8824-8650cf737dce" (UID: "37f18f84-16df-4be4-8824-8650cf737dce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:26:48.316232 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.316208    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37f18f84-16df-4be4-8824-8650cf737dce-istio-podinfo\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:48.316232 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.316230    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f18f84-16df-4be4-8824-8650cf737dce-istio-token\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:48.316372 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.316240    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-workload-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:48.316372 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.316250    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z5tq\" (UniqueName: \"kubernetes.io/projected/37f18f84-16df-4be4-8824-8650cf737dce-kube-api-access-8z5tq\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:48.316372 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.316260    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-workload-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:48.316372 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.316269    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-credential-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:48.316372 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.316277    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37f18f84-16df-4be4-8824-8650cf737dce-istio-envoy\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:26:48.923798 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.923761    2553 generic.go:356] "Generic (PLEG): container finished" podID="37f18f84-16df-4be4-8824-8650cf737dce" containerID="f1c2c498e2ee4c6de48fec436e668f8eae5ec6e8e63d118694e853fbea483a1f" exitCode=0
Sep 09 14:26:48.924159 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.923810    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"
Sep 09 14:26:48.924159 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.923835    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd" event={"ID":"37f18f84-16df-4be4-8824-8650cf737dce","Type":"ContainerDied","Data":"f1c2c498e2ee4c6de48fec436e668f8eae5ec6e8e63d118694e853fbea483a1f"}
Sep 09 14:26:48.924159 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.923890    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd" event={"ID":"37f18f84-16df-4be4-8824-8650cf737dce","Type":"ContainerDied","Data":"02e91a2f4f88f4f98e01ce31543b93f547185fbaf571d580c5c920078e20c786"}
Sep 09 14:26:48.924159 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.923914    2553 scope.go:117] "RemoveContainer" containerID="f1c2c498e2ee4c6de48fec436e668f8eae5ec6e8e63d118694e853fbea483a1f"
Sep 09 14:26:48.933325 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.933308    2553 scope.go:117] "RemoveContainer" containerID="eb61ae2f3fc5784c55d053c883bd70f13ef3e0bc62ec4d25d404917bda624c67"
Sep 09 14:26:48.940914 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.940895    2553 scope.go:117] "RemoveContainer" containerID="f1c2c498e2ee4c6de48fec436e668f8eae5ec6e8e63d118694e853fbea483a1f"
Sep 09 14:26:48.941194 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:26:48.941175    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1c2c498e2ee4c6de48fec436e668f8eae5ec6e8e63d118694e853fbea483a1f\": container with ID starting with f1c2c498e2ee4c6de48fec436e668f8eae5ec6e8e63d118694e853fbea483a1f not found: ID does not exist" containerID="f1c2c498e2ee4c6de48fec436e668f8eae5ec6e8e63d118694e853fbea483a1f"
Sep 09 14:26:48.941241 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.941201    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1c2c498e2ee4c6de48fec436e668f8eae5ec6e8e63d118694e853fbea483a1f"} err="failed to get container status \"f1c2c498e2ee4c6de48fec436e668f8eae5ec6e8e63d118694e853fbea483a1f\": rpc error: code = NotFound desc = could not find container \"f1c2c498e2ee4c6de48fec436e668f8eae5ec6e8e63d118694e853fbea483a1f\": container with ID starting with f1c2c498e2ee4c6de48fec436e668f8eae5ec6e8e63d118694e853fbea483a1f not found: ID does not exist"
Sep 09 14:26:48.941241 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.941219    2553 scope.go:117] "RemoveContainer" containerID="eb61ae2f3fc5784c55d053c883bd70f13ef3e0bc62ec4d25d404917bda624c67"
Sep 09 14:26:48.941464 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:26:48.941444    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb61ae2f3fc5784c55d053c883bd70f13ef3e0bc62ec4d25d404917bda624c67\": container with ID starting with eb61ae2f3fc5784c55d053c883bd70f13ef3e0bc62ec4d25d404917bda624c67 not found: ID does not exist" containerID="eb61ae2f3fc5784c55d053c883bd70f13ef3e0bc62ec4d25d404917bda624c67"
Sep 09 14:26:48.941521 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.941474    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb61ae2f3fc5784c55d053c883bd70f13ef3e0bc62ec4d25d404917bda624c67"} err="failed to get container status \"eb61ae2f3fc5784c55d053c883bd70f13ef3e0bc62ec4d25d404917bda624c67\": rpc error: code = NotFound desc = could not find container \"eb61ae2f3fc5784c55d053c883bd70f13ef3e0bc62ec4d25d404917bda624c67\": container with ID starting with eb61ae2f3fc5784c55d053c883bd70f13ef3e0bc62ec4d25d404917bda624c67 not found: ID does not exist"
Sep 09 14:26:48.944608 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.944586    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"]
Sep 09 14:26:48.954739 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:48.954719    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-a2ffe2-openshift-default-cfd844858-wvbfd"]
Sep 09 14:26:49.646583 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:26:49.646534    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37f18f84-16df-4be4-8824-8650cf737dce" path="/var/lib/kubelet/pods/37f18f84-16df-4be4-8824-8650cf737dce/volumes"
Sep 09 14:27:07.489309 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:07.489265    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:27:23.003890 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:23.003807    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:27:27.000705 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.000672    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"]
Sep 09 14:27:27.001160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.001074    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d19f4242-1b1c-40e4-83f8-278b7b0172d8" containerName="istio-proxy"
Sep 09 14:27:27.001160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.001090    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d19f4242-1b1c-40e4-83f8-278b7b0172d8" containerName="istio-proxy"
Sep 09 14:27:27.001160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.001100    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37f18f84-16df-4be4-8824-8650cf737dce" containerName="istio-proxy"
Sep 09 14:27:27.001160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.001105    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="37f18f84-16df-4be4-8824-8650cf737dce" containerName="istio-proxy"
Sep 09 14:27:27.001160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.001111    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec3553eb-d413-4b3a-9aa6-9d4a7089fafe" containerName="maas-api"
Sep 09 14:27:27.001160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.001117    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec3553eb-d413-4b3a-9aa6-9d4a7089fafe" containerName="maas-api"
Sep 09 14:27:27.001160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.001136    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37f18f84-16df-4be4-8824-8650cf737dce" containerName="istio-proxy"
Sep 09 14:27:27.001160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.001141    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="37f18f84-16df-4be4-8824-8650cf737dce" containerName="istio-proxy"
Sep 09 14:27:27.001160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.001151    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c9e11e-bee2-48d1-96ce-30bb3f78bfd9" containerName="main"
Sep 09 14:27:27.001160 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.001156    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c9e11e-bee2-48d1-96ce-30bb3f78bfd9" containerName="main"
Sep 09 14:27:27.001529 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.001214    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="37f18f84-16df-4be4-8824-8650cf737dce" containerName="istio-proxy"
Sep 09 14:27:27.001529 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.001223    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d19f4242-1b1c-40e4-83f8-278b7b0172d8" containerName="istio-proxy"
Sep 09 14:27:27.001529 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.001238    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="01c9e11e-bee2-48d1-96ce-30bb3f78bfd9" containerName="main"
Sep 09 14:27:27.001529 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.001244    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d19f4242-1b1c-40e4-83f8-278b7b0172d8" containerName="istio-proxy"
Sep 09 14:27:27.001529 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.001250    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec3553eb-d413-4b3a-9aa6-9d4a7089fafe" containerName="maas-api"
Sep 09 14:27:27.004324 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.004308    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.006532 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.006511    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-0da694\"/\"explicit-model-0da694-kserve-self-signed-certs\""
Sep 09 14:27:27.007432 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.007412    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-0da694\"/\"default-dockercfg-sq9t6\""
Sep 09 14:27:27.007533 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.007462    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-0da694\"/\"openshift-service-ca.crt\""
Sep 09 14:27:27.007533 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.007485    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-0da694\"/\"kube-root-ca.crt\""
Sep 09 14:27:27.018011 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.015324    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"]
Sep 09 14:27:27.134597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.134550    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-model-cache\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.134597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.134603    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40dacd81-ec08-42df-bc8b-62bb3b8b937d-tls-certs\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.134786 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.134695    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-dshm\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.134786 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.134724    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ptls\" (UniqueName: \"kubernetes.io/projected/40dacd81-ec08-42df-bc8b-62bb3b8b937d-kube-api-access-9ptls\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.134786 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.134744    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-tmp-dir\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.134884 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.134830    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-home\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.235698 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.235657    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-dshm\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.235698 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.235702    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ptls\" (UniqueName: \"kubernetes.io/projected/40dacd81-ec08-42df-bc8b-62bb3b8b937d-kube-api-access-9ptls\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.236112 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.235728    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-tmp-dir\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.236112 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.235790    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-home\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.236112 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.235838    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-model-cache\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.236112 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.235858    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40dacd81-ec08-42df-bc8b-62bb3b8b937d-tls-certs\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.236441 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.236224    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-tmp-dir\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.236441 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.236252    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-home\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.236441 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.236275    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-model-cache\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.238015 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.237992    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-dshm\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.238246 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.238229    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40dacd81-ec08-42df-bc8b-62bb3b8b937d-tls-certs\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.243705 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.243684    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ptls\" (UniqueName: \"kubernetes.io/projected/40dacd81-ec08-42df-bc8b-62bb3b8b937d-kube-api-access-9ptls\") pod \"explicit-model-0da694-kserve-7b4f84bc5c-gr6hf\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") " pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.314753 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.314693    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:27.586719 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:27.586686    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"]
Sep 09 14:27:27.589057 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:27:27.589031    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40dacd81_ec08_42df_bc8b_62bb3b8b937d.slice/crio-4e77d31e84dc607962bab929e5c9628fdc73b5f34b27f034756f04154bbec31d WatchSource:0}: Error finding container 4e77d31e84dc607962bab929e5c9628fdc73b5f34b27f034756f04154bbec31d: Status 404 returned error can't find the container with id 4e77d31e84dc607962bab929e5c9628fdc73b5f34b27f034756f04154bbec31d
Sep 09 14:27:28.107671 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:28.107636    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf" event={"ID":"40dacd81-ec08-42df-bc8b-62bb3b8b937d","Type":"ContainerStarted","Data":"8efbf43f99cbab7ed5c2e1611ddd1c1868d29aa0cc4ffc482fb1fba3601b8cd6"}
Sep 09 14:27:28.107671 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:28.107676    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf" event={"ID":"40dacd81-ec08-42df-bc8b-62bb3b8b937d","Type":"ContainerStarted","Data":"4e77d31e84dc607962bab929e5c9628fdc73b5f34b27f034756f04154bbec31d"}
Sep 09 14:27:28.124427 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:28.124382    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf" podStartSLOduration=2.124366899 podStartE2EDuration="2.124366899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:27:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:27:28.123258203 +0000 UTC m=+998.927241207" watchObservedRunningTime="2026-09-09 14:27:28.124366899 +0000 UTC m=+998.928349901"
Sep 09 14:27:34.519029 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:34.518989    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"]
Sep 09 14:27:37.315746 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:37.315710    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:42.898256 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:42.898218    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:27:49.538603 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:49.538535    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf" podUID="40dacd81-ec08-42df-bc8b-62bb3b8b937d" containerName="main" containerID="cri-o://8efbf43f99cbab7ed5c2e1611ddd1c1868d29aa0cc4ffc482fb1fba3601b8cd6" gracePeriod=45
Sep 09 14:27:49.775919 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:49.775896    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:49.927727 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:49.927655    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-model-cache\") pod \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") "
Sep 09 14:27:49.927727 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:49.927692    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40dacd81-ec08-42df-bc8b-62bb3b8b937d-tls-certs\") pod \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") "
Sep 09 14:27:49.927727 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:49.927709    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-dshm\") pod \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") "
Sep 09 14:27:49.927985 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:49.927742    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-tmp-dir\") pod \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") "
Sep 09 14:27:49.927985 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:49.927803    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ptls\" (UniqueName: \"kubernetes.io/projected/40dacd81-ec08-42df-bc8b-62bb3b8b937d-kube-api-access-9ptls\") pod \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") "
Sep 09 14:27:49.927985 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:49.927870    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-home\") pod \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\" (UID: \"40dacd81-ec08-42df-bc8b-62bb3b8b937d\") "
Sep 09 14:27:49.927985 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:49.927928    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-model-cache" (OuterVolumeSpecName: "model-cache") pod "40dacd81-ec08-42df-bc8b-62bb3b8b937d" (UID: "40dacd81-ec08-42df-bc8b-62bb3b8b937d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:27:49.928188 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:49.928035    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "40dacd81-ec08-42df-bc8b-62bb3b8b937d" (UID: "40dacd81-ec08-42df-bc8b-62bb3b8b937d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:27:49.928240 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:49.928183    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-home" (OuterVolumeSpecName: "home") pod "40dacd81-ec08-42df-bc8b-62bb3b8b937d" (UID: "40dacd81-ec08-42df-bc8b-62bb3b8b937d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:27:49.928240 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:49.928211    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-model-cache\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:27:49.928314 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:49.928241    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-tmp-dir\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:27:49.929995 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:49.929973    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-dshm" (OuterVolumeSpecName: "dshm") pod "40dacd81-ec08-42df-bc8b-62bb3b8b937d" (UID: "40dacd81-ec08-42df-bc8b-62bb3b8b937d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:27:49.930083 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:49.930025    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40dacd81-ec08-42df-bc8b-62bb3b8b937d-kube-api-access-9ptls" (OuterVolumeSpecName: "kube-api-access-9ptls") pod "40dacd81-ec08-42df-bc8b-62bb3b8b937d" (UID: "40dacd81-ec08-42df-bc8b-62bb3b8b937d"). InnerVolumeSpecName "kube-api-access-9ptls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:27:49.930134 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:49.930083    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40dacd81-ec08-42df-bc8b-62bb3b8b937d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "40dacd81-ec08-42df-bc8b-62bb3b8b937d" (UID: "40dacd81-ec08-42df-bc8b-62bb3b8b937d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:27:50.028825 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:50.028803    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40dacd81-ec08-42df-bc8b-62bb3b8b937d-tls-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:27:50.028825 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:50.028823    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-dshm\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:27:50.028971 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:50.028832    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ptls\" (UniqueName: \"kubernetes.io/projected/40dacd81-ec08-42df-bc8b-62bb3b8b937d-kube-api-access-9ptls\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:27:50.028971 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:50.028841    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40dacd81-ec08-42df-bc8b-62bb3b8b937d-home\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:27:50.222299 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:50.222264    2553 generic.go:356] "Generic (PLEG): container finished" podID="40dacd81-ec08-42df-bc8b-62bb3b8b937d" containerID="8efbf43f99cbab7ed5c2e1611ddd1c1868d29aa0cc4ffc482fb1fba3601b8cd6" exitCode=0
Sep 09 14:27:50.222445 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:50.222310    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf" event={"ID":"40dacd81-ec08-42df-bc8b-62bb3b8b937d","Type":"ContainerDied","Data":"8efbf43f99cbab7ed5c2e1611ddd1c1868d29aa0cc4ffc482fb1fba3601b8cd6"}
Sep 09 14:27:50.222445 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:50.222314    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"
Sep 09 14:27:50.222445 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:50.222346    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf" event={"ID":"40dacd81-ec08-42df-bc8b-62bb3b8b937d","Type":"ContainerDied","Data":"4e77d31e84dc607962bab929e5c9628fdc73b5f34b27f034756f04154bbec31d"}
Sep 09 14:27:50.222445 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:50.222365    2553 scope.go:117] "RemoveContainer" containerID="8efbf43f99cbab7ed5c2e1611ddd1c1868d29aa0cc4ffc482fb1fba3601b8cd6"
Sep 09 14:27:50.230928 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:50.230912    2553 scope.go:117] "RemoveContainer" containerID="8efbf43f99cbab7ed5c2e1611ddd1c1868d29aa0cc4ffc482fb1fba3601b8cd6"
Sep 09 14:27:50.231170 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:27:50.231152    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8efbf43f99cbab7ed5c2e1611ddd1c1868d29aa0cc4ffc482fb1fba3601b8cd6\": container with ID starting with 8efbf43f99cbab7ed5c2e1611ddd1c1868d29aa0cc4ffc482fb1fba3601b8cd6 not found: ID does not exist" containerID="8efbf43f99cbab7ed5c2e1611ddd1c1868d29aa0cc4ffc482fb1fba3601b8cd6"
Sep 09 14:27:50.231215 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:50.231179    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8efbf43f99cbab7ed5c2e1611ddd1c1868d29aa0cc4ffc482fb1fba3601b8cd6"} err="failed to get container status \"8efbf43f99cbab7ed5c2e1611ddd1c1868d29aa0cc4ffc482fb1fba3601b8cd6\": rpc error: code = NotFound desc = could not find container \"8efbf43f99cbab7ed5c2e1611ddd1c1868d29aa0cc4ffc482fb1fba3601b8cd6\": container with ID starting with 8efbf43f99cbab7ed5c2e1611ddd1c1868d29aa0cc4ffc482fb1fba3601b8cd6 not found: ID does not exist"
Sep 09 14:27:50.243504 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:50.243481    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"]
Sep 09 14:27:50.248956 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:50.248936    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-0da694/explicit-model-0da694-kserve-7b4f84bc5c-gr6hf"]
Sep 09 14:27:51.646469 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:51.646436    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40dacd81-ec08-42df-bc8b-62bb3b8b937d" path="/var/lib/kubelet/pods/40dacd81-ec08-42df-bc8b-62bb3b8b937d/volumes"
Sep 09 14:27:52.989596 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:52.987432    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"]
Sep 09 14:27:52.992143 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:52.992114    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40dacd81-ec08-42df-bc8b-62bb3b8b937d" containerName="main"
Sep 09 14:27:52.992143 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:52.992142    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="40dacd81-ec08-42df-bc8b-62bb3b8b937d" containerName="main"
Sep 09 14:27:52.992322 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:52.992155    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d19f4242-1b1c-40e4-83f8-278b7b0172d8" containerName="istio-proxy"
Sep 09 14:27:52.992322 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:52.992163    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d19f4242-1b1c-40e4-83f8-278b7b0172d8" containerName="istio-proxy"
Sep 09 14:27:52.992322 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:52.992249    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="40dacd81-ec08-42df-bc8b-62bb3b8b937d" containerName="main"
Sep 09 14:27:52.992322 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:52.992260    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="37f18f84-16df-4be4-8824-8650cf737dce" containerName="istio-proxy"
Sep 09 14:27:52.996752 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:52.996732    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:52.999013 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:52.998990    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-aa5470-openshift-default-dockercfg-z64nl\""
Sep 09 14:27:53.006004 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.005980    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"]
Sep 09 14:27:53.152216 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.152179    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-workload-socket\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.152397 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.152223    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-credential-socket\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.152397 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.152285    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73ad15e7-050e-4afe-bca0-334e29b51e2b-istiod-ca-cert\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.152397 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.152310    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-workload-certs\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.152523 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.152419    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-envoy\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.152523 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.152457    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-token\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.152523 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.152486    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljb5j\" (UniqueName: \"kubernetes.io/projected/73ad15e7-050e-4afe-bca0-334e29b51e2b-kube-api-access-ljb5j\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.152523 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.152507    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-data\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.152523 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.152522    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-podinfo\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.253163 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.253087    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73ad15e7-050e-4afe-bca0-334e29b51e2b-istiod-ca-cert\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.253163 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.253121    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-workload-certs\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.253163 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.253156    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-envoy\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.253446 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.253181    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-token\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.253446 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.253205    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljb5j\" (UniqueName: \"kubernetes.io/projected/73ad15e7-050e-4afe-bca0-334e29b51e2b-kube-api-access-ljb5j\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.253446 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.253221    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-data\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.253446 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.253237    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-podinfo\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.253446 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.253320    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-workload-socket\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.253446 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.253368    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-credential-socket\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.253793 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.253516    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-workload-certs\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.253793 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.253620    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-data\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.253793 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.253707    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-credential-socket\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.253963 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.253795    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-workload-socket\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.254021 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.253995    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73ad15e7-050e-4afe-bca0-334e29b51e2b-istiod-ca-cert\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.255292 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.255269    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-envoy\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.255738 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.255721    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-podinfo\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.261305 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.261273    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-token\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.261539 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.261520    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljb5j\" (UniqueName: \"kubernetes.io/projected/73ad15e7-050e-4afe-bca0-334e29b51e2b-kube-api-access-ljb5j\") pod \"e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") " pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.295050 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.295024    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:27:53.309548 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.309525    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:53.585950 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.585926    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"]
Sep 09 14:27:53.587465 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:27:53.587430    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ad15e7_050e_4afe_bca0_334e29b51e2b.slice/crio-480b85abddf0875ad31168261337531541a9dfe4ef3a6fc85e139d3d0a11f27d WatchSource:0}: Error finding container 480b85abddf0875ad31168261337531541a9dfe4ef3a6fc85e139d3d0a11f27d: Status 404 returned error can't find the container with id 480b85abddf0875ad31168261337531541a9dfe4ef3a6fc85e139d3d0a11f27d
Sep 09 14:27:53.589588 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.589540    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:27:53.589659 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.589622    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:27:53.589659 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:53.589651    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:27:54.245079 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:54.245039    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc" event={"ID":"73ad15e7-050e-4afe-bca0-334e29b51e2b","Type":"ContainerStarted","Data":"85f969c8b7e3e4b3784824f6861f84bc4ac545d21abee756329824b2ab3041e9"}
Sep 09 14:27:54.245521 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:54.245101    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc" event={"ID":"73ad15e7-050e-4afe-bca0-334e29b51e2b","Type":"ContainerStarted","Data":"480b85abddf0875ad31168261337531541a9dfe4ef3a6fc85e139d3d0a11f27d"}
Sep 09 14:27:54.270226 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:54.270170    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc" podStartSLOduration=2.270150688 podStartE2EDuration="2.270150688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:27:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:27:54.266069012 +0000 UTC m=+1025.070052018" watchObservedRunningTime="2026-09-09 14:27:54.270150688 +0000 UTC m=+1025.074133695"
Sep 09 14:27:54.310157 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:54.310126    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:54.315113 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:54.315093    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:55.249913 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:55.249882    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:27:55.250730 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:27:55.250712    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:28:10.267851 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.267814    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"]
Sep 09 14:28:10.271706 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.271684    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.273997 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.273966    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d94c06b6-openshift-default-dockercfg-bswkv\""
Sep 09 14:28:10.274233 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.274206    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrqt9\" (UniqueName: \"kubernetes.io/projected/4825caa1-831e-46ea-9fda-36eeb1a44a88-kube-api-access-nrqt9\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.274368 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.274349    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-envoy\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.274439 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.274383    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-podinfo\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.274530 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.274512    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-credential-socket\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.274644 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.274628    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-token\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.274688 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.274661    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-workload-certs\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.274726 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.274687    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4825caa1-831e-46ea-9fda-36eeb1a44a88-istiod-ca-cert\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.274726 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.274717    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-workload-socket\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.274797 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.274784    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-data\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.282891 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.282834    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"]
Sep 09 14:28:10.375696 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.375658    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-data\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.375878 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.375738    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrqt9\" (UniqueName: \"kubernetes.io/projected/4825caa1-831e-46ea-9fda-36eeb1a44a88-kube-api-access-nrqt9\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.375878 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.375773    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-envoy\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.375878 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.375799    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-podinfo\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.375878 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.375834    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-credential-socket\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.375878 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.375855    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-token\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.376149 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.375882    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-workload-certs\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.376149 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.375907    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4825caa1-831e-46ea-9fda-36eeb1a44a88-istiod-ca-cert\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.376149 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.375935    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-workload-socket\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.376304 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.376203    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-data\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.376304 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.376227    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-workload-socket\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.376475 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.376447    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-workload-certs\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.376714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.376515    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-credential-socket\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.376870 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.376815    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4825caa1-831e-46ea-9fda-36eeb1a44a88-istiod-ca-cert\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.378950 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.378920    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-envoy\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.379158 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.379131    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-podinfo\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.383934 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.383910    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-token\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.384232 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.384207    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrqt9\" (UniqueName: \"kubernetes.io/projected/4825caa1-831e-46ea-9fda-36eeb1a44a88-kube-api-access-nrqt9\") pod \"e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") " pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.584008 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.583927    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:10.863545 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.863519    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"]
Sep 09 14:28:10.865021 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:28:10.864991    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4825caa1_831e_46ea_9fda_36eeb1a44a88.slice/crio-4dd9b7bab00df33f9eaad49003b9b5035b7fa2465af2f084965feb3f31d697e9 WatchSource:0}: Error finding container 4dd9b7bab00df33f9eaad49003b9b5035b7fa2465af2f084965feb3f31d697e9: Status 404 returned error can't find the container with id 4dd9b7bab00df33f9eaad49003b9b5035b7fa2465af2f084965feb3f31d697e9
Sep 09 14:28:10.867110 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.867077    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:28:10.867208 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.867139    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:28:10.867208 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:10.867166    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:28:11.330767 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:11.330724    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9" event={"ID":"4825caa1-831e-46ea-9fda-36eeb1a44a88","Type":"ContainerStarted","Data":"a05a8d0fea898ba90c74622803df3cacda3d83ad8d8a74eb13915d9d3a6db3b8"}
Sep 09 14:28:11.331185 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:11.330790    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9" event={"ID":"4825caa1-831e-46ea-9fda-36eeb1a44a88","Type":"ContainerStarted","Data":"4dd9b7bab00df33f9eaad49003b9b5035b7fa2465af2f084965feb3f31d697e9"}
Sep 09 14:28:11.350540 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:11.350492    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9" podStartSLOduration=1.350476969 podStartE2EDuration="1.350476969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:28:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:28:11.349021387 +0000 UTC m=+1042.153004401" watchObservedRunningTime="2026-09-09 14:28:11.350476969 +0000 UTC m=+1042.154459968"
Sep 09 14:28:11.585274 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:11.585188    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:11.590129 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:11.590107    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:12.341326 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:12.341295    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:12.342241 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:12.342217    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:15.397995 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:15.397956    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"]
Sep 09 14:28:15.398468 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:15.398173    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc" podUID="73ad15e7-050e-4afe-bca0-334e29b51e2b" containerName="istio-proxy" containerID="cri-o://85f969c8b7e3e4b3784824f6861f84bc4ac545d21abee756329824b2ab3041e9" gracePeriod=30
Sep 09 14:28:20.652584 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.652543    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:28:20.763948 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.763915    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73ad15e7-050e-4afe-bca0-334e29b51e2b-istiod-ca-cert\") pod \"73ad15e7-050e-4afe-bca0-334e29b51e2b\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") "
Sep 09 14:28:20.764137 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.763981    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-podinfo\") pod \"73ad15e7-050e-4afe-bca0-334e29b51e2b\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") "
Sep 09 14:28:20.764137 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.764029    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-token\") pod \"73ad15e7-050e-4afe-bca0-334e29b51e2b\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") "
Sep 09 14:28:20.764137 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.764056    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-data\") pod \"73ad15e7-050e-4afe-bca0-334e29b51e2b\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") "
Sep 09 14:28:20.764137 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.764099    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljb5j\" (UniqueName: \"kubernetes.io/projected/73ad15e7-050e-4afe-bca0-334e29b51e2b-kube-api-access-ljb5j\") pod \"73ad15e7-050e-4afe-bca0-334e29b51e2b\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") "
Sep 09 14:28:20.764137 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.764130    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-workload-socket\") pod \"73ad15e7-050e-4afe-bca0-334e29b51e2b\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") "
Sep 09 14:28:20.764406 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.764196    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-credential-socket\") pod \"73ad15e7-050e-4afe-bca0-334e29b51e2b\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") "
Sep 09 14:28:20.764406 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.764223    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-workload-certs\") pod \"73ad15e7-050e-4afe-bca0-334e29b51e2b\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") "
Sep 09 14:28:20.764406 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.764247    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-envoy\") pod \"73ad15e7-050e-4afe-bca0-334e29b51e2b\" (UID: \"73ad15e7-050e-4afe-bca0-334e29b51e2b\") "
Sep 09 14:28:20.764406 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.764360    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-data" (OuterVolumeSpecName: "istio-data") pod "73ad15e7-050e-4afe-bca0-334e29b51e2b" (UID: "73ad15e7-050e-4afe-bca0-334e29b51e2b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:28:20.764651 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.764407    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73ad15e7-050e-4afe-bca0-334e29b51e2b" (UID: "73ad15e7-050e-4afe-bca0-334e29b51e2b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:28:20.764651 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.764540    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73ad15e7-050e-4afe-bca0-334e29b51e2b" (UID: "73ad15e7-050e-4afe-bca0-334e29b51e2b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:28:20.764651 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.764555    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73ad15e7-050e-4afe-bca0-334e29b51e2b" (UID: "73ad15e7-050e-4afe-bca0-334e29b51e2b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:28:20.764651 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.764366    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73ad15e7-050e-4afe-bca0-334e29b51e2b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73ad15e7-050e-4afe-bca0-334e29b51e2b" (UID: "73ad15e7-050e-4afe-bca0-334e29b51e2b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:28:20.764651 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.764597    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-data\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:20.764651 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.764628    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-workload-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:20.766303 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.766265    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-token" (OuterVolumeSpecName: "istio-token") pod "73ad15e7-050e-4afe-bca0-334e29b51e2b" (UID: "73ad15e7-050e-4afe-bca0-334e29b51e2b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:28:20.766412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.766345    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73ad15e7-050e-4afe-bca0-334e29b51e2b" (UID: "73ad15e7-050e-4afe-bca0-334e29b51e2b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:28:20.766607 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.766553    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73ad15e7-050e-4afe-bca0-334e29b51e2b-kube-api-access-ljb5j" (OuterVolumeSpecName: "kube-api-access-ljb5j") pod "73ad15e7-050e-4afe-bca0-334e29b51e2b" (UID: "73ad15e7-050e-4afe-bca0-334e29b51e2b"). InnerVolumeSpecName "kube-api-access-ljb5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:28:20.766718 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.766626    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73ad15e7-050e-4afe-bca0-334e29b51e2b" (UID: "73ad15e7-050e-4afe-bca0-334e29b51e2b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:28:20.865127 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.865107    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-credential-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:20.865127 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.865129    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-workload-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:20.865268 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.865138    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-envoy\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:20.865268 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.865146    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73ad15e7-050e-4afe-bca0-334e29b51e2b-istiod-ca-cert\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:20.865268 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.865156    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-podinfo\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:20.865268 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.865163    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73ad15e7-050e-4afe-bca0-334e29b51e2b-istio-token\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:20.865268 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:20.865171    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljb5j\" (UniqueName: \"kubernetes.io/projected/73ad15e7-050e-4afe-bca0-334e29b51e2b-kube-api-access-ljb5j\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:21.383978 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:21.383943    2553 generic.go:356] "Generic (PLEG): container finished" podID="73ad15e7-050e-4afe-bca0-334e29b51e2b" containerID="85f969c8b7e3e4b3784824f6861f84bc4ac545d21abee756329824b2ab3041e9" exitCode=0
Sep 09 14:28:21.384187 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:21.383987    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"
Sep 09 14:28:21.384187 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:21.384015    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc" event={"ID":"73ad15e7-050e-4afe-bca0-334e29b51e2b","Type":"ContainerDied","Data":"85f969c8b7e3e4b3784824f6861f84bc4ac545d21abee756329824b2ab3041e9"}
Sep 09 14:28:21.384187 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:21.384066    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc" event={"ID":"73ad15e7-050e-4afe-bca0-334e29b51e2b","Type":"ContainerDied","Data":"480b85abddf0875ad31168261337531541a9dfe4ef3a6fc85e139d3d0a11f27d"}
Sep 09 14:28:21.384187 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:21.384094    2553 scope.go:117] "RemoveContainer" containerID="85f969c8b7e3e4b3784824f6861f84bc4ac545d21abee756329824b2ab3041e9"
Sep 09 14:28:21.393738 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:21.393720    2553 scope.go:117] "RemoveContainer" containerID="85f969c8b7e3e4b3784824f6861f84bc4ac545d21abee756329824b2ab3041e9"
Sep 09 14:28:21.394014 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:28:21.393994    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85f969c8b7e3e4b3784824f6861f84bc4ac545d21abee756329824b2ab3041e9\": container with ID starting with 85f969c8b7e3e4b3784824f6861f84bc4ac545d21abee756329824b2ab3041e9 not found: ID does not exist" containerID="85f969c8b7e3e4b3784824f6861f84bc4ac545d21abee756329824b2ab3041e9"
Sep 09 14:28:21.394058 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:21.394022    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85f969c8b7e3e4b3784824f6861f84bc4ac545d21abee756329824b2ab3041e9"} err="failed to get container status \"85f969c8b7e3e4b3784824f6861f84bc4ac545d21abee756329824b2ab3041e9\": rpc error: code = NotFound desc = could not find container \"85f969c8b7e3e4b3784824f6861f84bc4ac545d21abee756329824b2ab3041e9\": container with ID starting with 85f969c8b7e3e4b3784824f6861f84bc4ac545d21abee756329824b2ab3041e9 not found: ID does not exist"
Sep 09 14:28:21.405040 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:21.405017    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"]
Sep 09 14:28:21.410930 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:21.410909    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-aa5470-openshift-default-65656f4fbd-lbvgc"]
Sep 09 14:28:21.646030 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:21.645962    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73ad15e7-050e-4afe-bca0-334e29b51e2b" path="/var/lib/kubelet/pods/73ad15e7-050e-4afe-bca0-334e29b51e2b/volumes"
Sep 09 14:28:24.900217 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:24.900181    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:28:27.633678 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:27.633638    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"]
Sep 09 14:28:34.450037 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:34.450010    2553 generic.go:356] "Generic (PLEG): container finished" podID="4825caa1-831e-46ea-9fda-36eeb1a44a88" containerID="a05a8d0fea898ba90c74622803df3cacda3d83ad8d8a74eb13915d9d3a6db3b8" exitCode=0
Sep 09 14:28:34.450342 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:34.450078    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9" event={"ID":"4825caa1-831e-46ea-9fda-36eeb1a44a88","Type":"ContainerDied","Data":"a05a8d0fea898ba90c74622803df3cacda3d83ad8d8a74eb13915d9d3a6db3b8"}
Sep 09 14:28:34.450448 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:34.450433    2553 scope.go:117] "RemoveContainer" containerID="a05a8d0fea898ba90c74622803df3cacda3d83ad8d8a74eb13915d9d3a6db3b8"
Sep 09 14:28:34.451576 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:34.451533    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:28:34.451660 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:34.451637    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:28:34.451704 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:34.451676    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:28:35.460694 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:35.460650    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9" event={"ID":"4825caa1-831e-46ea-9fda-36eeb1a44a88","Type":"ContainerStarted","Data":"799ddb4244e4a87f05fff3f3eb4ab65886145fb46c5f043ee6b21ab952cf3ccb"}
Sep 09 14:28:35.584362 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:35.584323    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:35.584613 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:35.584585    2553 patch_prober.go:28] interesting pod/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 09 14:28:35.584664 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:35.584647    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9" podUID="4825caa1-831e-46ea-9fda-36eeb1a44a88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 09 14:28:36.584900 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:36.584865    2553 patch_prober.go:28] interesting pod/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 09 14:28:36.585264 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:36.584943    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9" podUID="4825caa1-831e-46ea-9fda-36eeb1a44a88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 09 14:28:37.585139 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:37.585098    2553 patch_prober.go:28] interesting pod/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 09 14:28:37.585520 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:37.585157    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9" podUID="4825caa1-831e-46ea-9fda-36eeb1a44a88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 09 14:28:38.584706 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:38.584664    2553 patch_prober.go:28] interesting pod/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 09 14:28:38.584885 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:38.584738    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9" podUID="4825caa1-831e-46ea-9fda-36eeb1a44a88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 09 14:28:39.506511 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:39.506477    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:28:39.584948 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:39.584918    2553 patch_prober.go:28] interesting pod/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 09 14:28:39.585097 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:39.584968    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9" podUID="4825caa1-831e-46ea-9fda-36eeb1a44a88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 09 14:28:40.584461 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:40.584420    2553 patch_prober.go:28] interesting pod/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 09 14:28:40.584865 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:40.584491    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9" podUID="4825caa1-831e-46ea-9fda-36eeb1a44a88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 09 14:28:41.588983 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:41.588950    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:41.589427 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:41.589236    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:41.590023 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:41.590007    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:28:42.678258 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:42.678170    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm" podUID="ceb69eff-0bd0-45e4-8dc7-898d9659f277" containerName="main" containerID="cri-o://91f1ab8a2aecc0207f9b6559e74f75a1d3a359b94bf2136d1829c6e559a0bd55" gracePeriod=45
Sep 09 14:28:42.920676 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:42.920653    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:28:43.073887 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.073852    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-model-cache\") pod \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") "
Sep 09 14:28:43.074050 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.073915    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-home\") pod \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") "
Sep 09 14:28:43.074050 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.073951    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzddm\" (UniqueName: \"kubernetes.io/projected/ceb69eff-0bd0-45e4-8dc7-898d9659f277-kube-api-access-wzddm\") pod \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") "
Sep 09 14:28:43.074050 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.073971    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-tmp-dir\") pod \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") "
Sep 09 14:28:43.074050 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.073997    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ceb69eff-0bd0-45e4-8dc7-898d9659f277-tls-certs\") pod \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") "
Sep 09 14:28:43.074050 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.074020    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-dshm\") pod \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\" (UID: \"ceb69eff-0bd0-45e4-8dc7-898d9659f277\") "
Sep 09 14:28:43.074286 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.074155    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-model-cache" (OuterVolumeSpecName: "model-cache") pod "ceb69eff-0bd0-45e4-8dc7-898d9659f277" (UID: "ceb69eff-0bd0-45e4-8dc7-898d9659f277"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:28:43.074286 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.074233    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ceb69eff-0bd0-45e4-8dc7-898d9659f277" (UID: "ceb69eff-0bd0-45e4-8dc7-898d9659f277"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:28:43.074286 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.074246    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-home" (OuterVolumeSpecName: "home") pod "ceb69eff-0bd0-45e4-8dc7-898d9659f277" (UID: "ceb69eff-0bd0-45e4-8dc7-898d9659f277"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:28:43.076222 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.076190    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-dshm" (OuterVolumeSpecName: "dshm") pod "ceb69eff-0bd0-45e4-8dc7-898d9659f277" (UID: "ceb69eff-0bd0-45e4-8dc7-898d9659f277"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:28:43.076222 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.076194    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ceb69eff-0bd0-45e4-8dc7-898d9659f277-kube-api-access-wzddm" (OuterVolumeSpecName: "kube-api-access-wzddm") pod "ceb69eff-0bd0-45e4-8dc7-898d9659f277" (UID: "ceb69eff-0bd0-45e4-8dc7-898d9659f277"). InnerVolumeSpecName "kube-api-access-wzddm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:28:43.076390 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.076245    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ceb69eff-0bd0-45e4-8dc7-898d9659f277-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ceb69eff-0bd0-45e4-8dc7-898d9659f277" (UID: "ceb69eff-0bd0-45e4-8dc7-898d9659f277"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:28:43.175395 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.175363    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzddm\" (UniqueName: \"kubernetes.io/projected/ceb69eff-0bd0-45e4-8dc7-898d9659f277-kube-api-access-wzddm\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:43.175395 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.175394    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-tmp-dir\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:43.175395 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.175404    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ceb69eff-0bd0-45e4-8dc7-898d9659f277-tls-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:43.175587 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.175414    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-dshm\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:43.175587 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.175422    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-model-cache\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:43.175587 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.175429    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ceb69eff-0bd0-45e4-8dc7-898d9659f277-home\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:43.500427 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.500395    2553 generic.go:356] "Generic (PLEG): container finished" podID="ceb69eff-0bd0-45e4-8dc7-898d9659f277" containerID="91f1ab8a2aecc0207f9b6559e74f75a1d3a359b94bf2136d1829c6e559a0bd55" exitCode=0
Sep 09 14:28:43.500608 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.500443    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"
Sep 09 14:28:43.500608 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.500479    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm" event={"ID":"ceb69eff-0bd0-45e4-8dc7-898d9659f277","Type":"ContainerDied","Data":"91f1ab8a2aecc0207f9b6559e74f75a1d3a359b94bf2136d1829c6e559a0bd55"}
Sep 09 14:28:43.500608 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.500524    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm" event={"ID":"ceb69eff-0bd0-45e4-8dc7-898d9659f277","Type":"ContainerDied","Data":"5628b88da302c0d43156062f8e821176361ef02dd0ef3053e29f05fd8d0e2226"}
Sep 09 14:28:43.500608 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.500541    2553 scope.go:117] "RemoveContainer" containerID="91f1ab8a2aecc0207f9b6559e74f75a1d3a359b94bf2136d1829c6e559a0bd55"
Sep 09 14:28:43.509311 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.509294    2553 scope.go:117] "RemoveContainer" containerID="91f1ab8a2aecc0207f9b6559e74f75a1d3a359b94bf2136d1829c6e559a0bd55"
Sep 09 14:28:43.509595 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:28:43.509574    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91f1ab8a2aecc0207f9b6559e74f75a1d3a359b94bf2136d1829c6e559a0bd55\": container with ID starting with 91f1ab8a2aecc0207f9b6559e74f75a1d3a359b94bf2136d1829c6e559a0bd55 not found: ID does not exist" containerID="91f1ab8a2aecc0207f9b6559e74f75a1d3a359b94bf2136d1829c6e559a0bd55"
Sep 09 14:28:43.509656 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.509603    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f1ab8a2aecc0207f9b6559e74f75a1d3a359b94bf2136d1829c6e559a0bd55"} err="failed to get container status \"91f1ab8a2aecc0207f9b6559e74f75a1d3a359b94bf2136d1829c6e559a0bd55\": rpc error: code = NotFound desc = could not find container \"91f1ab8a2aecc0207f9b6559e74f75a1d3a359b94bf2136d1829c6e559a0bd55\": container with ID starting with 91f1ab8a2aecc0207f9b6559e74f75a1d3a359b94bf2136d1829c6e559a0bd55 not found: ID does not exist"
Sep 09 14:28:43.519654 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.519632    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"]
Sep 09 14:28:43.523019 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.522999    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-a0fa5a/test-model-a0fa5a-kserve-c796d59b9-wlgmm"]
Sep 09 14:28:43.646025 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:43.645993    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ceb69eff-0bd0-45e4-8dc7-898d9659f277" path="/var/lib/kubelet/pods/ceb69eff-0bd0-45e4-8dc7-898d9659f277/volumes"
Sep 09 14:28:47.584095 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:47.584059    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g"]
Sep 09 14:28:47.584755 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:47.584540    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ad15e7-050e-4afe-bca0-334e29b51e2b" containerName="istio-proxy"
Sep 09 14:28:47.584755 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:47.584561    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ad15e7-050e-4afe-bca0-334e29b51e2b" containerName="istio-proxy"
Sep 09 14:28:47.584755 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:47.584607    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceb69eff-0bd0-45e4-8dc7-898d9659f277" containerName="main"
Sep 09 14:28:47.584755 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:47.584617    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceb69eff-0bd0-45e4-8dc7-898d9659f277" containerName="main"
Sep 09 14:28:47.584755 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:47.584716    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ceb69eff-0bd0-45e4-8dc7-898d9659f277" containerName="main"
Sep 09 14:28:47.584755 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:47.584727    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="73ad15e7-050e-4afe-bca0-334e29b51e2b" containerName="istio-proxy"
Sep 09 14:28:47.587005 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:47.586984    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g"
Sep 09 14:28:47.589155 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:47.589137    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:28:47.595747 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:47.595724    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g"]
Sep 09 14:28:47.716674 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:47.716649    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6a0c57-99ed-494f-84f2-daea46ed80d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g\" (UID: \"3b6a0c57-99ed-494f-84f2-daea46ed80d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g"
Sep 09 14:28:47.817930 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:47.817901    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6a0c57-99ed-494f-84f2-daea46ed80d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g\" (UID: \"3b6a0c57-99ed-494f-84f2-daea46ed80d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g"
Sep 09 14:28:47.818500 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:47.818479    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6a0c57-99ed-494f-84f2-daea46ed80d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g\" (UID: \"3b6a0c57-99ed-494f-84f2-daea46ed80d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g"
Sep 09 14:28:47.898054 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:47.897972    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g"
Sep 09 14:28:48.165318 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:48.165233    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g"]
Sep 09 14:28:48.167939 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:28:48.167912    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6a0c57_99ed_494f_84f2_daea46ed80d4.slice/crio-e67579c97a86eb0afa61951012a7d0a20f354217d2bb71e95501e3e0fe8a5b05 WatchSource:0}: Error finding container e67579c97a86eb0afa61951012a7d0a20f354217d2bb71e95501e3e0fe8a5b05: Status 404 returned error can't find the container with id e67579c97a86eb0afa61951012a7d0a20f354217d2bb71e95501e3e0fe8a5b05
Sep 09 14:28:48.169719 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:48.169700    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 14:28:48.526473 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:48.526437    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g" event={"ID":"3b6a0c57-99ed-494f-84f2-daea46ed80d4","Type":"ContainerStarted","Data":"e67579c97a86eb0afa61951012a7d0a20f354217d2bb71e95501e3e0fe8a5b05"}
Sep 09 14:28:49.596354 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:49.596314    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:28:54.555704 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:54.555667    2553 generic.go:356] "Generic (PLEG): container finished" podID="3b6a0c57-99ed-494f-84f2-daea46ed80d4" containerID="10b273e83531a7d7c3807e23e9dfdcc928e88d4f4f8ea2b3aad44d2bf8945915" exitCode=0
Sep 09 14:28:54.556035 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:54.555747    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g" event={"ID":"3b6a0c57-99ed-494f-84f2-daea46ed80d4","Type":"ContainerDied","Data":"10b273e83531a7d7c3807e23e9dfdcc928e88d4f4f8ea2b3aad44d2bf8945915"}
Sep 09 14:28:55.687176 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:55.687156    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g"
Sep 09 14:28:55.883443 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:55.883364    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6a0c57-99ed-494f-84f2-daea46ed80d4-maas-api-service-ca\") pod \"3b6a0c57-99ed-494f-84f2-daea46ed80d4\" (UID: \"3b6a0c57-99ed-494f-84f2-daea46ed80d4\") "
Sep 09 14:28:55.883727 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:55.883703    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b6a0c57-99ed-494f-84f2-daea46ed80d4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3b6a0c57-99ed-494f-84f2-daea46ed80d4" (UID: "3b6a0c57-99ed-494f-84f2-daea46ed80d4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:28:55.984189 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:55.984156    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6a0c57-99ed-494f-84f2-daea46ed80d4-maas-api-service-ca\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:56.566112 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:56.566076    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g" event={"ID":"3b6a0c57-99ed-494f-84f2-daea46ed80d4","Type":"ContainerDied","Data":"e67579c97a86eb0afa61951012a7d0a20f354217d2bb71e95501e3e0fe8a5b05"}
Sep 09 14:28:56.566274 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:56.566127    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e67579c97a86eb0afa61951012a7d0a20f354217d2bb71e95501e3e0fe8a5b05"
Sep 09 14:28:56.566274 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:56.566087    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g"
Sep 09 14:28:58.379780 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:58.379748    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"]
Sep 09 14:28:58.380350 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:58.379943    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q" podUID="00e5a559-a840-4ee5-9dda-c50171b2aca8" containerName="maas-api" containerID="cri-o://d42c38c5805adaf96629df545ef14606c28188dc0b26746b06dbe0692c9b9b25" gracePeriod=30
Sep 09 14:28:58.601385 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:58.601347    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g"]
Sep 09 14:28:58.601647 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:58.601629    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d85f87-k8b9g"]
Sep 09 14:28:58.821928 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:58.821906    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:28:58.907224 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:58.907192    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6c4d\" (UniqueName: \"kubernetes.io/projected/00e5a559-a840-4ee5-9dda-c50171b2aca8-kube-api-access-c6c4d\") pod \"00e5a559-a840-4ee5-9dda-c50171b2aca8\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") "
Sep 09 14:28:58.907224 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:58.907229    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00e5a559-a840-4ee5-9dda-c50171b2aca8-metrics-certs\") pod \"00e5a559-a840-4ee5-9dda-c50171b2aca8\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") "
Sep 09 14:28:58.907408 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:58.907270    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00e5a559-a840-4ee5-9dda-c50171b2aca8-maas-api-tls\") pod \"00e5a559-a840-4ee5-9dda-c50171b2aca8\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") "
Sep 09 14:28:58.907408 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:58.907296    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e5a559-a840-4ee5-9dda-c50171b2aca8-openshift-service-ca\") pod \"00e5a559-a840-4ee5-9dda-c50171b2aca8\" (UID: \"00e5a559-a840-4ee5-9dda-c50171b2aca8\") "
Sep 09 14:28:58.907801 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:58.907766    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00e5a559-a840-4ee5-9dda-c50171b2aca8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "00e5a559-a840-4ee5-9dda-c50171b2aca8" (UID: "00e5a559-a840-4ee5-9dda-c50171b2aca8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:28:58.909427 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:58.909399    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00e5a559-a840-4ee5-9dda-c50171b2aca8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "00e5a559-a840-4ee5-9dda-c50171b2aca8" (UID: "00e5a559-a840-4ee5-9dda-c50171b2aca8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:28:58.909531 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:58.909428    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00e5a559-a840-4ee5-9dda-c50171b2aca8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "00e5a559-a840-4ee5-9dda-c50171b2aca8" (UID: "00e5a559-a840-4ee5-9dda-c50171b2aca8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:28:58.909531 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:58.909446    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00e5a559-a840-4ee5-9dda-c50171b2aca8-kube-api-access-c6c4d" (OuterVolumeSpecName: "kube-api-access-c6c4d") pod "00e5a559-a840-4ee5-9dda-c50171b2aca8" (UID: "00e5a559-a840-4ee5-9dda-c50171b2aca8"). InnerVolumeSpecName "kube-api-access-c6c4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:28:59.008108 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:59.008069    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e5a559-a840-4ee5-9dda-c50171b2aca8-openshift-service-ca\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:59.008108 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:59.008103    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6c4d\" (UniqueName: \"kubernetes.io/projected/00e5a559-a840-4ee5-9dda-c50171b2aca8-kube-api-access-c6c4d\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:59.008302 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:59.008118    2553 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00e5a559-a840-4ee5-9dda-c50171b2aca8-metrics-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:59.008302 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:59.008132    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00e5a559-a840-4ee5-9dda-c50171b2aca8-maas-api-tls\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:28:59.582070 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:59.582033    2553 generic.go:356] "Generic (PLEG): container finished" podID="00e5a559-a840-4ee5-9dda-c50171b2aca8" containerID="d42c38c5805adaf96629df545ef14606c28188dc0b26746b06dbe0692c9b9b25" exitCode=0
Sep 09 14:28:59.582453 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:59.582084    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"
Sep 09 14:28:59.582453 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:59.582117    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q" event={"ID":"00e5a559-a840-4ee5-9dda-c50171b2aca8","Type":"ContainerDied","Data":"d42c38c5805adaf96629df545ef14606c28188dc0b26746b06dbe0692c9b9b25"}
Sep 09 14:28:59.582453 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:59.582174    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q" event={"ID":"00e5a559-a840-4ee5-9dda-c50171b2aca8","Type":"ContainerDied","Data":"5fc2ccef0492183268aa09fa398434d64eb89c84944fab256ef9112d17b91b7d"}
Sep 09 14:28:59.582453 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:59.582196    2553 scope.go:117] "RemoveContainer" containerID="d42c38c5805adaf96629df545ef14606c28188dc0b26746b06dbe0692c9b9b25"
Sep 09 14:28:59.591404 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:59.591382    2553 scope.go:117] "RemoveContainer" containerID="d42c38c5805adaf96629df545ef14606c28188dc0b26746b06dbe0692c9b9b25"
Sep 09 14:28:59.591679 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:28:59.591661    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d42c38c5805adaf96629df545ef14606c28188dc0b26746b06dbe0692c9b9b25\": container with ID starting with d42c38c5805adaf96629df545ef14606c28188dc0b26746b06dbe0692c9b9b25 not found: ID does not exist" containerID="d42c38c5805adaf96629df545ef14606c28188dc0b26746b06dbe0692c9b9b25"
Sep 09 14:28:59.591745 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:59.591688    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d42c38c5805adaf96629df545ef14606c28188dc0b26746b06dbe0692c9b9b25"} err="failed to get container status \"d42c38c5805adaf96629df545ef14606c28188dc0b26746b06dbe0692c9b9b25\": rpc error: code = NotFound desc = could not find container \"d42c38c5805adaf96629df545ef14606c28188dc0b26746b06dbe0692c9b9b25\": container with ID starting with d42c38c5805adaf96629df545ef14606c28188dc0b26746b06dbe0692c9b9b25 not found: ID does not exist"
Sep 09 14:28:59.602403 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:59.602381    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"]
Sep 09 14:28:59.606598 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:59.606553    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d85f87-6745b9787b-w664q"]
Sep 09 14:28:59.645285 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:59.645264    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00e5a559-a840-4ee5-9dda-c50171b2aca8" path="/var/lib/kubelet/pods/00e5a559-a840-4ee5-9dda-c50171b2aca8/volumes"
Sep 09 14:28:59.645605 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:28:59.645592    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b6a0c57-99ed-494f-84f2-daea46ed80d4" path="/var/lib/kubelet/pods/3b6a0c57-99ed-494f-84f2-daea46ed80d4/volumes"
Sep 09 14:29:00.719892 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:00.719857    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:29:04.172555 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:04.172514    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"]
Sep 09 14:29:04.172962 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:04.172817    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9" podUID="4825caa1-831e-46ea-9fda-36eeb1a44a88" containerName="istio-proxy" containerID="cri-o://799ddb4244e4a87f05fff3f3eb4ab65886145fb46c5f043ee6b21ab952cf3ccb" gracePeriod=30
Sep 09 14:29:09.403120 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.403096    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:29:09.473071 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.473048    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4825caa1-831e-46ea-9fda-36eeb1a44a88-istiod-ca-cert\") pod \"4825caa1-831e-46ea-9fda-36eeb1a44a88\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") "
Sep 09 14:29:09.473184 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.473083    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrqt9\" (UniqueName: \"kubernetes.io/projected/4825caa1-831e-46ea-9fda-36eeb1a44a88-kube-api-access-nrqt9\") pod \"4825caa1-831e-46ea-9fda-36eeb1a44a88\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") "
Sep 09 14:29:09.473184 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.473104    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-token\") pod \"4825caa1-831e-46ea-9fda-36eeb1a44a88\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") "
Sep 09 14:29:09.473184 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.473138    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-podinfo\") pod \"4825caa1-831e-46ea-9fda-36eeb1a44a88\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") "
Sep 09 14:29:09.473315 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.473205    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-workload-certs\") pod \"4825caa1-831e-46ea-9fda-36eeb1a44a88\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") "
Sep 09 14:29:09.473315 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.473258    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-workload-socket\") pod \"4825caa1-831e-46ea-9fda-36eeb1a44a88\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") "
Sep 09 14:29:09.473315 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.473287    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-credential-socket\") pod \"4825caa1-831e-46ea-9fda-36eeb1a44a88\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") "
Sep 09 14:29:09.473461 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.473322    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-data\") pod \"4825caa1-831e-46ea-9fda-36eeb1a44a88\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") "
Sep 09 14:29:09.473461 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.473365    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-envoy\") pod \"4825caa1-831e-46ea-9fda-36eeb1a44a88\" (UID: \"4825caa1-831e-46ea-9fda-36eeb1a44a88\") "
Sep 09 14:29:09.473586 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.473528    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4825caa1-831e-46ea-9fda-36eeb1a44a88-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4825caa1-831e-46ea-9fda-36eeb1a44a88" (UID: "4825caa1-831e-46ea-9fda-36eeb1a44a88"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:29:09.473586 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.473533    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4825caa1-831e-46ea-9fda-36eeb1a44a88" (UID: "4825caa1-831e-46ea-9fda-36eeb1a44a88"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:29:09.473701 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.473659    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-workload-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:29:09.473701 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.473676    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4825caa1-831e-46ea-9fda-36eeb1a44a88-istiod-ca-cert\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:29:09.473811 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.473731    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-data" (OuterVolumeSpecName: "istio-data") pod "4825caa1-831e-46ea-9fda-36eeb1a44a88" (UID: "4825caa1-831e-46ea-9fda-36eeb1a44a88"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:29:09.473811 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.473753    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4825caa1-831e-46ea-9fda-36eeb1a44a88" (UID: "4825caa1-831e-46ea-9fda-36eeb1a44a88"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:29:09.473902 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.473815    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4825caa1-831e-46ea-9fda-36eeb1a44a88" (UID: "4825caa1-831e-46ea-9fda-36eeb1a44a88"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:29:09.475381 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.475355    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4825caa1-831e-46ea-9fda-36eeb1a44a88" (UID: "4825caa1-831e-46ea-9fda-36eeb1a44a88"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:29:09.475493 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.475403    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4825caa1-831e-46ea-9fda-36eeb1a44a88" (UID: "4825caa1-831e-46ea-9fda-36eeb1a44a88"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:29:09.475690 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.475670    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-token" (OuterVolumeSpecName: "istio-token") pod "4825caa1-831e-46ea-9fda-36eeb1a44a88" (UID: "4825caa1-831e-46ea-9fda-36eeb1a44a88"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:29:09.475763 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.475673    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4825caa1-831e-46ea-9fda-36eeb1a44a88-kube-api-access-nrqt9" (OuterVolumeSpecName: "kube-api-access-nrqt9") pod "4825caa1-831e-46ea-9fda-36eeb1a44a88" (UID: "4825caa1-831e-46ea-9fda-36eeb1a44a88"). InnerVolumeSpecName "kube-api-access-nrqt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:29:09.573996 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.573971    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-workload-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:29:09.573996 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.573994    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-credential-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:29:09.574130 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.574004    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-data\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:29:09.574130 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.574013    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-envoy\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:29:09.574130 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.574021    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrqt9\" (UniqueName: \"kubernetes.io/projected/4825caa1-831e-46ea-9fda-36eeb1a44a88-kube-api-access-nrqt9\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:29:09.574130 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.574030    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-token\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:29:09.574130 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.574037    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4825caa1-831e-46ea-9fda-36eeb1a44a88-istio-podinfo\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:29:09.633433 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.633408    2553 generic.go:356] "Generic (PLEG): container finished" podID="4825caa1-831e-46ea-9fda-36eeb1a44a88" containerID="799ddb4244e4a87f05fff3f3eb4ab65886145fb46c5f043ee6b21ab952cf3ccb" exitCode=0
Sep 09 14:29:09.633545 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.633443    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9" event={"ID":"4825caa1-831e-46ea-9fda-36eeb1a44a88","Type":"ContainerDied","Data":"799ddb4244e4a87f05fff3f3eb4ab65886145fb46c5f043ee6b21ab952cf3ccb"}
Sep 09 14:29:09.633545 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.633516    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9" event={"ID":"4825caa1-831e-46ea-9fda-36eeb1a44a88","Type":"ContainerDied","Data":"4dd9b7bab00df33f9eaad49003b9b5035b7fa2465af2f084965feb3f31d697e9"}
Sep 09 14:29:09.633545 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.633455    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"
Sep 09 14:29:09.633725 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.633549    2553 scope.go:117] "RemoveContainer" containerID="799ddb4244e4a87f05fff3f3eb4ab65886145fb46c5f043ee6b21ab952cf3ccb"
Sep 09 14:29:09.642094 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.642076    2553 scope.go:117] "RemoveContainer" containerID="a05a8d0fea898ba90c74622803df3cacda3d83ad8d8a74eb13915d9d3a6db3b8"
Sep 09 14:29:09.650131 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.650115    2553 scope.go:117] "RemoveContainer" containerID="799ddb4244e4a87f05fff3f3eb4ab65886145fb46c5f043ee6b21ab952cf3ccb"
Sep 09 14:29:09.650378 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:29:09.650357    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"799ddb4244e4a87f05fff3f3eb4ab65886145fb46c5f043ee6b21ab952cf3ccb\": container with ID starting with 799ddb4244e4a87f05fff3f3eb4ab65886145fb46c5f043ee6b21ab952cf3ccb not found: ID does not exist" containerID="799ddb4244e4a87f05fff3f3eb4ab65886145fb46c5f043ee6b21ab952cf3ccb"
Sep 09 14:29:09.650426 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.650387    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799ddb4244e4a87f05fff3f3eb4ab65886145fb46c5f043ee6b21ab952cf3ccb"} err="failed to get container status \"799ddb4244e4a87f05fff3f3eb4ab65886145fb46c5f043ee6b21ab952cf3ccb\": rpc error: code = NotFound desc = could not find container \"799ddb4244e4a87f05fff3f3eb4ab65886145fb46c5f043ee6b21ab952cf3ccb\": container with ID starting with 799ddb4244e4a87f05fff3f3eb4ab65886145fb46c5f043ee6b21ab952cf3ccb not found: ID does not exist"
Sep 09 14:29:09.650426 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.650402    2553 scope.go:117] "RemoveContainer" containerID="a05a8d0fea898ba90c74622803df3cacda3d83ad8d8a74eb13915d9d3a6db3b8"
Sep 09 14:29:09.650645 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:29:09.650629    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a05a8d0fea898ba90c74622803df3cacda3d83ad8d8a74eb13915d9d3a6db3b8\": container with ID starting with a05a8d0fea898ba90c74622803df3cacda3d83ad8d8a74eb13915d9d3a6db3b8 not found: ID does not exist" containerID="a05a8d0fea898ba90c74622803df3cacda3d83ad8d8a74eb13915d9d3a6db3b8"
Sep 09 14:29:09.650697 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.650652    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a05a8d0fea898ba90c74622803df3cacda3d83ad8d8a74eb13915d9d3a6db3b8"} err="failed to get container status \"a05a8d0fea898ba90c74622803df3cacda3d83ad8d8a74eb13915d9d3a6db3b8\": rpc error: code = NotFound desc = could not find container \"a05a8d0fea898ba90c74622803df3cacda3d83ad8d8a74eb13915d9d3a6db3b8\": container with ID starting with a05a8d0fea898ba90c74622803df3cacda3d83ad8d8a74eb13915d9d3a6db3b8 not found: ID does not exist"
Sep 09 14:29:09.657085 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.657065    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"]
Sep 09 14:29:09.662946 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:09.662926    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d94c06b6-openshift-default-5876645f44-r8vf9"]
Sep 09 14:29:11.099188 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.099157    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"]
Sep 09 14:29:11.100137 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.100113    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4825caa1-831e-46ea-9fda-36eeb1a44a88" containerName="istio-proxy"
Sep 09 14:29:11.100254 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.100145    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4825caa1-831e-46ea-9fda-36eeb1a44a88" containerName="istio-proxy"
Sep 09 14:29:11.100254 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.100160    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4825caa1-831e-46ea-9fda-36eeb1a44a88" containerName="istio-proxy"
Sep 09 14:29:11.100254 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.100165    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4825caa1-831e-46ea-9fda-36eeb1a44a88" containerName="istio-proxy"
Sep 09 14:29:11.100254 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.100174    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b6a0c57-99ed-494f-84f2-daea46ed80d4" containerName="revoke-keys"
Sep 09 14:29:11.100254 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.100180    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b6a0c57-99ed-494f-84f2-daea46ed80d4" containerName="revoke-keys"
Sep 09 14:29:11.100254 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.100187    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e5a559-a840-4ee5-9dda-c50171b2aca8" containerName="maas-api"
Sep 09 14:29:11.100254 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.100192    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e5a559-a840-4ee5-9dda-c50171b2aca8" containerName="maas-api"
Sep 09 14:29:11.100254 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.100252    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b6a0c57-99ed-494f-84f2-daea46ed80d4" containerName="revoke-keys"
Sep 09 14:29:11.100500 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.100262    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="00e5a559-a840-4ee5-9dda-c50171b2aca8" containerName="maas-api"
Sep 09 14:29:11.100500 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.100269    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4825caa1-831e-46ea-9fda-36eeb1a44a88" containerName="istio-proxy"
Sep 09 14:29:11.100500 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.100275    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4825caa1-831e-46ea-9fda-36eeb1a44a88" containerName="istio-proxy"
Sep 09 14:29:11.103095 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.103072    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:29:11.105498 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.105474    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 14:29:11.106266 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.106246    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-e565aa-serving-cert\""
Sep 09 14:29:11.106389 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.106301    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fkrmg\""
Sep 09 14:29:11.106389 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.106349    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 14:29:11.106530 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.106416    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:29:11.116560 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.116534    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"]
Sep 09 14:29:11.187428 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.187401    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41931dd1-0134-445b-ab7e-ab55cb88219b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4\" (UID: \"41931dd1-0134-445b-ab7e-ab55cb88219b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:29:11.187597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.187472    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41931dd1-0134-445b-ab7e-ab55cb88219b-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4\" (UID: \"41931dd1-0134-445b-ab7e-ab55cb88219b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:29:11.187597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.187512    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9cqr\" (UniqueName: \"kubernetes.io/projected/41931dd1-0134-445b-ab7e-ab55cb88219b-kube-api-access-c9cqr\") pod \"maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4\" (UID: \"41931dd1-0134-445b-ab7e-ab55cb88219b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:29:11.187597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.187558    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41931dd1-0134-445b-ab7e-ab55cb88219b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4\" (UID: \"41931dd1-0134-445b-ab7e-ab55cb88219b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:29:11.287953 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.287922    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41931dd1-0134-445b-ab7e-ab55cb88219b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4\" (UID: \"41931dd1-0134-445b-ab7e-ab55cb88219b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:29:11.288103 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.287966    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41931dd1-0134-445b-ab7e-ab55cb88219b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4\" (UID: \"41931dd1-0134-445b-ab7e-ab55cb88219b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:29:11.288103 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.288016    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41931dd1-0134-445b-ab7e-ab55cb88219b-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4\" (UID: \"41931dd1-0134-445b-ab7e-ab55cb88219b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:29:11.288103 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.288054    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9cqr\" (UniqueName: \"kubernetes.io/projected/41931dd1-0134-445b-ab7e-ab55cb88219b-kube-api-access-c9cqr\") pod \"maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4\" (UID: \"41931dd1-0134-445b-ab7e-ab55cb88219b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:29:11.288677 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.288655    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41931dd1-0134-445b-ab7e-ab55cb88219b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4\" (UID: \"41931dd1-0134-445b-ab7e-ab55cb88219b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:29:11.290447 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.290418    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41931dd1-0134-445b-ab7e-ab55cb88219b-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4\" (UID: \"41931dd1-0134-445b-ab7e-ab55cb88219b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:29:11.290534 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.290468    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41931dd1-0134-445b-ab7e-ab55cb88219b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4\" (UID: \"41931dd1-0134-445b-ab7e-ab55cb88219b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:29:11.310162 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.310136    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9cqr\" (UniqueName: \"kubernetes.io/projected/41931dd1-0134-445b-ab7e-ab55cb88219b-kube-api-access-c9cqr\") pod \"maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4\" (UID: \"41931dd1-0134-445b-ab7e-ab55cb88219b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:29:11.415293 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.415231    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:29:11.645386 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.645356    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4825caa1-831e-46ea-9fda-36eeb1a44a88" path="/var/lib/kubelet/pods/4825caa1-831e-46ea-9fda-36eeb1a44a88/volumes"
Sep 09 14:29:11.685649 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:11.685627    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"]
Sep 09 14:29:11.688265 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:29:11.688231    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41931dd1_0134_445b_ab7e_ab55cb88219b.slice/crio-19d02bc0a27ee79f26817abe8e69c79cb9a38e34c536e757aa464710dd992be6 WatchSource:0}: Error finding container 19d02bc0a27ee79f26817abe8e69c79cb9a38e34c536e757aa464710dd992be6: Status 404 returned error can't find the container with id 19d02bc0a27ee79f26817abe8e69c79cb9a38e34c536e757aa464710dd992be6
Sep 09 14:29:12.651188 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:12.651149    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4" event={"ID":"41931dd1-0134-445b-ab7e-ab55cb88219b","Type":"ContainerStarted","Data":"ed805313b26f9c7fc0c3daadb6d40b879269ca57e4b80350e744d3bb06379e78"}
Sep 09 14:29:12.651543 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:12.651206    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:29:12.651543 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:12.651229    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4" event={"ID":"41931dd1-0134-445b-ab7e-ab55cb88219b","Type":"ContainerStarted","Data":"19d02bc0a27ee79f26817abe8e69c79cb9a38e34c536e757aa464710dd992be6"}
Sep 09 14:29:12.676460 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:12.676416    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4" podStartSLOduration=1.320187177 podStartE2EDuration="1.67640108s" totalImagesPullingTime="356.213903ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:29:12.674540773 +0000 UTC m=+1103.478523775" watchObservedRunningTime="2026-09-09 14:29:12.67640108 +0000 UTC m=+1103.480384082"
Sep 09 14:29:14.798416 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:14.798382    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:29:18.661013 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:18.660982    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:29:20.251987 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.251956    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"]
Sep 09 14:29:20.255539 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.255516    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.258725 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.258704    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-cbb7fb-openshift-default-dockercfg-sf5vx\""
Sep 09 14:29:20.269076 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.269051    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"]
Sep 09 14:29:20.347387 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.347359    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-workload-socket\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.347523 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.347398    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-data\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.347523 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.347462    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-workload-certs\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.347523 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.347514    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-podinfo\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.347741 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.347552    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-token\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.347741 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.347609    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-credential-socket\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.347741 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.347638    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-envoy\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.347741 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.347670    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctx8f\" (UniqueName: \"kubernetes.io/projected/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-kube-api-access-ctx8f\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.347741 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.347715    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istiod-ca-cert\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.448505 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.448464    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-data\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.448724 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.448530    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-workload-certs\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.448724 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.448604    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-podinfo\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.448724 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.448647    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-token\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.448724 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.448676    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-credential-socket\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.448724 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.448703    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-envoy\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.449003 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.448729    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctx8f\" (UniqueName: \"kubernetes.io/projected/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-kube-api-access-ctx8f\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.449003 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.448758    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istiod-ca-cert\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.449003 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.448816    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-workload-socket\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.449003 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.448897    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-data\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.449216 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.449180    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-credential-socket\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.449323 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.449297    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-workload-certs\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.449601 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.449555    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istiod-ca-cert\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.449697 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.449680    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-workload-socket\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.451080 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.451058    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-envoy\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.451286 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.451270    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-podinfo\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.457475 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.457444    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctx8f\" (UniqueName: \"kubernetes.io/projected/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-kube-api-access-ctx8f\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.457587 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.457521    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-token\") pod \"e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") " pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.568701 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.568612    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:20.845172 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.845143    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"]
Sep 09 14:29:20.846629 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:29:20.846597    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b1adf6_7f98_4e1c_a4cd_ee9a58cf30e3.slice/crio-45da79af26f6cc8e52e9c2817ac3d9455b54f745728f31cfc2752abb9c38d1f5 WatchSource:0}: Error finding container 45da79af26f6cc8e52e9c2817ac3d9455b54f745728f31cfc2752abb9c38d1f5: Status 404 returned error can't find the container with id 45da79af26f6cc8e52e9c2817ac3d9455b54f745728f31cfc2752abb9c38d1f5
Sep 09 14:29:20.848785 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.848755    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:29:20.848855 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.848818    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:29:20.848855 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:20.848849    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:29:21.695832 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:21.695796    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn" event={"ID":"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3","Type":"ContainerStarted","Data":"b0b901b4ad724b342ec3fe353614eb276d6f4a27db92d11fb54aa96cf0f3075e"}
Sep 09 14:29:21.696249 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:21.695846    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn" event={"ID":"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3","Type":"ContainerStarted","Data":"45da79af26f6cc8e52e9c2817ac3d9455b54f745728f31cfc2752abb9c38d1f5"}
Sep 09 14:29:21.715810 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:21.715759    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn" podStartSLOduration=1.715739944 podStartE2EDuration="1.715739944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:29:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:29:21.714883904 +0000 UTC m=+1112.518866944" watchObservedRunningTime="2026-09-09 14:29:21.715739944 +0000 UTC m=+1112.519722946"
Sep 09 14:29:22.569218 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:22.569174    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:22.573907 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:22.573883    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:22.701580 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:22.701528    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:22.702463 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:22.702440    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:29.803191 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:29.803148    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:29:35.539131 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.539095    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"]
Sep 09 14:29:35.552545 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.552517    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.559790 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.559763    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-c5e2d3-openshift-default-dockercfg-7wvcx\""
Sep 09 14:29:35.561033 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.561013    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"]
Sep 09 14:29:35.686932 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.686891    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2g8v\" (UniqueName: \"kubernetes.io/projected/3869a2b6-b582-4256-949e-08457b3f98c7-kube-api-access-q2g8v\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.686932 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.686927    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-istio-envoy\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.687192 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.686953    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3869a2b6-b582-4256-949e-08457b3f98c7-istio-token\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.687192 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.687029    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-workload-socket\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.687192 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.687061    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3869a2b6-b582-4256-949e-08457b3f98c7-istiod-ca-cert\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.687192 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.687098    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-workload-certs\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.687192 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.687138    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-istio-data\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.687192 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.687168    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-credential-socket\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.687513 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.687214    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3869a2b6-b582-4256-949e-08457b3f98c7-istio-podinfo\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.788526 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.788486    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2g8v\" (UniqueName: \"kubernetes.io/projected/3869a2b6-b582-4256-949e-08457b3f98c7-kube-api-access-q2g8v\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.788526 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.788529    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-istio-envoy\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.788818 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.788559    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3869a2b6-b582-4256-949e-08457b3f98c7-istio-token\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.788818 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.788618    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-workload-socket\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.788818 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.788650    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3869a2b6-b582-4256-949e-08457b3f98c7-istiod-ca-cert\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.788818 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.788721    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-workload-certs\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.788818 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.788750    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-istio-data\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.788818 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.788799    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-credential-socket\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.789162 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.788843    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3869a2b6-b582-4256-949e-08457b3f98c7-istio-podinfo\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.789162 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.789009    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-workload-socket\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.789162 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.789082    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-workload-certs\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.789500 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.789477    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-credential-socket\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.789753 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.789731    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-istio-data\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.790188 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.790165    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3869a2b6-b582-4256-949e-08457b3f98c7-istiod-ca-cert\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.791409 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.791389    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-istio-envoy\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.791788 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.791770    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3869a2b6-b582-4256-949e-08457b3f98c7-istio-podinfo\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.796025 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.795997    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2g8v\" (UniqueName: \"kubernetes.io/projected/3869a2b6-b582-4256-949e-08457b3f98c7-kube-api-access-q2g8v\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.796116 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.796098    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3869a2b6-b582-4256-949e-08457b3f98c7-istio-token\") pod \"e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") " pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:35.874114 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:35.874081    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:36.156059 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:36.154073    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"]
Sep 09 14:29:36.157223 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:29:36.157182    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3869a2b6_b582_4256_949e_08457b3f98c7.slice/crio-457661b7b7b0f5d45115f3bee9f825c2da6f777ffb94882cfd77736a72885260 WatchSource:0}: Error finding container 457661b7b7b0f5d45115f3bee9f825c2da6f777ffb94882cfd77736a72885260: Status 404 returned error can't find the container with id 457661b7b7b0f5d45115f3bee9f825c2da6f777ffb94882cfd77736a72885260
Sep 09 14:29:36.161104 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:36.160380    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:29:36.161104 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:36.160464    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:29:36.161104 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:36.160507    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:29:36.778829 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:36.778785    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp" event={"ID":"3869a2b6-b582-4256-949e-08457b3f98c7","Type":"ContainerStarted","Data":"0627efe6a869c81774f7725c2ed67470672ce38167aa09354ebcbbec573e1c17"}
Sep 09 14:29:36.779300 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:36.778842    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp" event={"ID":"3869a2b6-b582-4256-949e-08457b3f98c7","Type":"ContainerStarted","Data":"457661b7b7b0f5d45115f3bee9f825c2da6f777ffb94882cfd77736a72885260"}
Sep 09 14:29:36.801094 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:36.801041    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp" podStartSLOduration=1.80102454 podStartE2EDuration="1.80102454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:29:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:29:36.799722151 +0000 UTC m=+1127.603705188" watchObservedRunningTime="2026-09-09 14:29:36.80102454 +0000 UTC m=+1127.605007544"
Sep 09 14:29:36.874941 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:36.874910    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:37.879923 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:37.879892    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:38.787908 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:38.787874    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:38.795988 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:38.789322    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:29:41.804979 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:41.804949    2553 generic.go:356] "Generic (PLEG): container finished" podID="b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" containerID="b0b901b4ad724b342ec3fe353614eb276d6f4a27db92d11fb54aa96cf0f3075e" exitCode=0
Sep 09 14:29:41.805395 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:41.805006    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn" event={"ID":"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3","Type":"ContainerDied","Data":"b0b901b4ad724b342ec3fe353614eb276d6f4a27db92d11fb54aa96cf0f3075e"}
Sep 09 14:29:41.805395 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:41.805354    2553 scope.go:117] "RemoveContainer" containerID="b0b901b4ad724b342ec3fe353614eb276d6f4a27db92d11fb54aa96cf0f3075e"
Sep 09 14:29:41.806389 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:41.806361    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:29:41.806446 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:41.806436    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:29:41.806483 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:41.806466    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:29:42.811583 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:42.811535    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn" event={"ID":"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3","Type":"ContainerStarted","Data":"c16d6913ce0c323c1415bff6c4f4a72d58556e208a0f27ca67df3fbcb8dd83d2"}
Sep 09 14:29:43.569753 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:43.569716    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:43.569926 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:43.569907    2553 patch_prober.go:28] interesting pod/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 09 14:29:43.569986 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:43.569964    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn" podUID="b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 09 14:29:44.402111 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:44.402075    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:29:44.569054 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:44.569015    2553 patch_prober.go:28] interesting pod/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 09 14:29:44.569244 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:44.569088    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn" podUID="b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 09 14:29:45.569930 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:45.569893    2553 patch_prober.go:28] interesting pod/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 09 14:29:45.570306 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:45.569948    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn" podUID="b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 09 14:29:46.569001 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:46.568963    2553 patch_prober.go:28] interesting pod/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 09 14:29:46.569190 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:46.569034    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn" podUID="b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 09 14:29:47.569170 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:47.569128    2553 patch_prober.go:28] interesting pod/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 09 14:29:47.569602 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:47.569189    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn" podUID="b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 09 14:29:48.573511 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:48.573478    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:48.573890 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:48.573752    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:48.574344 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:48.574329    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:29:49.315058 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.315023    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"]
Sep 09 14:29:49.322544 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.322238    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.324873 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.324846    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-fecaf9-openshift-default-dockercfg-7cz4t\""
Sep 09 14:29:49.330496 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.330323    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"]
Sep 09 14:29:49.419986 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.419946    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-istio-data\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.420186 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.420000    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-workload-certs\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.420186 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.420080    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5649edb4-ea1f-436a-b822-aed83d685a29-istio-token\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.420186 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.420104    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5649edb4-ea1f-436a-b822-aed83d685a29-istiod-ca-cert\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.420355 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.420210    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-workload-socket\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.420355 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.420286    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-credential-socket\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.420460 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.420351    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-istio-envoy\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.420460 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.420382    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5649edb4-ea1f-436a-b822-aed83d685a29-istio-podinfo\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.420460 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.420414    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdqnd\" (UniqueName: \"kubernetes.io/projected/5649edb4-ea1f-436a-b822-aed83d685a29-kube-api-access-qdqnd\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.521650 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.521600    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-istio-data\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.521820 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.521746    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-workload-certs\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.521820 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.521796    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5649edb4-ea1f-436a-b822-aed83d685a29-istio-token\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.521820 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.521811    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5649edb4-ea1f-436a-b822-aed83d685a29-istiod-ca-cert\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.521976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.521948    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-istio-data\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.522036 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.522013    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-workload-socket\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.522087 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.522076    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-credential-socket\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.522140 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.522085    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-workload-certs\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.522193 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.522160    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-istio-envoy\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.522239 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.522191    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5649edb4-ea1f-436a-b822-aed83d685a29-istio-podinfo\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.522239 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.522220    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdqnd\" (UniqueName: \"kubernetes.io/projected/5649edb4-ea1f-436a-b822-aed83d685a29-kube-api-access-qdqnd\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.522338 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.522320    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-workload-socket\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.522394 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.522365    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-credential-socket\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.522504 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.522486    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5649edb4-ea1f-436a-b822-aed83d685a29-istiod-ca-cert\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.524408 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.524381    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-istio-envoy\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.524675 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.524659    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5649edb4-ea1f-436a-b822-aed83d685a29-istio-podinfo\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.529618 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.529596    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdqnd\" (UniqueName: \"kubernetes.io/projected/5649edb4-ea1f-436a-b822-aed83d685a29-kube-api-access-qdqnd\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.529728 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.529668    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5649edb4-ea1f-436a-b822-aed83d685a29-istio-token\") pod \"e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") " pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.636962 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.636891    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-fecaf9-openshift-default-dockercfg-7cz4t\""
Sep 09 14:29:49.644717 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.644689    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:49.918772 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.918749    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"]
Sep 09 14:29:49.920984 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:29:49.920960    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5649edb4_ea1f_436a_b822_aed83d685a29.slice/crio-6eef226ed501cb49d9e3dba3e19f09686a1a5e0e82939e80ae8ff4bfc8c28c9c WatchSource:0}: Error finding container 6eef226ed501cb49d9e3dba3e19f09686a1a5e0e82939e80ae8ff4bfc8c28c9c: Status 404 returned error can't find the container with id 6eef226ed501cb49d9e3dba3e19f09686a1a5e0e82939e80ae8ff4bfc8c28c9c
Sep 09 14:29:49.923538 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.923505    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:29:49.923612 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.923586    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:29:49.923654 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:49.923616    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:29:50.850805 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:50.850768    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r" event={"ID":"5649edb4-ea1f-436a-b822-aed83d685a29","Type":"ContainerStarted","Data":"3c17760ab4707389025ce4552cb808bbe96a6e3f8e52a4d2160759cef787b929"}
Sep 09 14:29:50.851222 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:50.850821    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r" event={"ID":"5649edb4-ea1f-436a-b822-aed83d685a29","Type":"ContainerStarted","Data":"6eef226ed501cb49d9e3dba3e19f09686a1a5e0e82939e80ae8ff4bfc8c28c9c"}
Sep 09 14:29:50.873266 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:50.873211    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r" podStartSLOduration=1.87319663 podStartE2EDuration="1.87319663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:29:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:29:50.870786961 +0000 UTC m=+1141.674769963" watchObservedRunningTime="2026-09-09 14:29:50.87319663 +0000 UTC m=+1141.677179633"
Sep 09 14:29:51.646214 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:51.646178    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:51.650441 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:51.650414    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:51.855171 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:51.855133    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:51.856037 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:51.856015    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:29:57.993610 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:29:57.993555    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:30:00.153337 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.153294    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-cbb7fb-29816070-nr97d"]
Sep 09 14:30:00.170816 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.170786    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-fecaf9-29816070-qg6tj"]
Sep 09 14:30:00.170984 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.170918    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-cbb7fb-29816070-nr97d"
Sep 09 14:30:00.173789 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.173763    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:30:00.174290 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.174267    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-cbb7fb-29816070-nr97d"]
Sep 09 14:30:00.174403 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.174367    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-fecaf9-29816070-qg6tj"
Sep 09 14:30:00.175260 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.175231    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-fecaf9-29816070-qg6tj"]
Sep 09 14:30:00.185340 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.185322    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-cbb7fb-29816070-nr97d"
Sep 09 14:30:00.192906 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.192887    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-fecaf9-29816070-qg6tj"
Sep 09 14:30:00.469810 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.469787    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-cbb7fb-29816070-nr97d"]
Sep 09 14:30:00.471902 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:30:00.471872    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4267fe47_b6e6_4acd_9378_e61f44a0d40d.slice/crio-1946f102b253d8967e1e56cf705969ca7dfb09497ec2506ef6be46f5bd442d7d WatchSource:0}: Error finding container 1946f102b253d8967e1e56cf705969ca7dfb09497ec2506ef6be46f5bd442d7d: Status 404 returned error can't find the container with id 1946f102b253d8967e1e56cf705969ca7dfb09497ec2506ef6be46f5bd442d7d
Sep 09 14:30:00.499915 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.499892    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-fecaf9-29816070-qg6tj"]
Sep 09 14:30:00.511635 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:30:00.511609    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa6c3ac_b16f_4d5f_8439_e0b3d12ebf7b.slice/crio-e491a006f218ff52942dbe698ba4eedb8c6fc9c684c6dc0929d32eb911ce6e84 WatchSource:0}: Error finding container e491a006f218ff52942dbe698ba4eedb8c6fc9c684c6dc0929d32eb911ce6e84: Status 404 returned error can't find the container with id e491a006f218ff52942dbe698ba4eedb8c6fc9c684c6dc0929d32eb911ce6e84
Sep 09 14:30:00.901553 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.901518    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-cbb7fb-29816070-nr97d" event={"ID":"4267fe47-b6e6-4acd-9378-e61f44a0d40d","Type":"ContainerStarted","Data":"9c4656fa94e9a09b4e50d7a527dbe995ef4337bf0c0fbc93c504db7ba877b9c0"}
Sep 09 14:30:00.901704 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.901606    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-cbb7fb-29816070-nr97d" event={"ID":"4267fe47-b6e6-4acd-9378-e61f44a0d40d","Type":"ContainerStarted","Data":"1946f102b253d8967e1e56cf705969ca7dfb09497ec2506ef6be46f5bd442d7d"}
Sep 09 14:30:00.903167 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.903143    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-fecaf9-29816070-qg6tj" event={"ID":"cfa6c3ac-b16f-4d5f-8439-e0b3d12ebf7b","Type":"ContainerStarted","Data":"06344bb50804b2a0bb5d63679c57b4e159cd15a678a1a0d130dc0ab5c24a9fd8"}
Sep 09 14:30:00.903257 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.903183    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-fecaf9-29816070-qg6tj" event={"ID":"cfa6c3ac-b16f-4d5f-8439-e0b3d12ebf7b","Type":"ContainerStarted","Data":"e491a006f218ff52942dbe698ba4eedb8c6fc9c684c6dc0929d32eb911ce6e84"}
Sep 09 14:30:00.918773 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.918732    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-cbb7fb-29816070-nr97d" podStartSLOduration=0.918718588 podStartE2EDuration="918.718588ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:30:00.917237047 +0000 UTC m=+1151.721220028" watchObservedRunningTime="2026-09-09 14:30:00.918718588 +0000 UTC m=+1151.722701591"
Sep 09 14:30:00.931528 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:00.931490    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-fecaf9-29816070-qg6tj" podStartSLOduration=0.931476804 podStartE2EDuration="931.476804ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:30:00.930927085 +0000 UTC m=+1151.734910090" watchObservedRunningTime="2026-09-09 14:30:00.931476804 +0000 UTC m=+1151.735459862"
Sep 09 14:30:01.910267 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:01.910226    2553 generic.go:356] "Generic (PLEG): container finished" podID="cfa6c3ac-b16f-4d5f-8439-e0b3d12ebf7b" containerID="06344bb50804b2a0bb5d63679c57b4e159cd15a678a1a0d130dc0ab5c24a9fd8" exitCode=7
Sep 09 14:30:01.910699 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:01.910362    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-fecaf9-29816070-qg6tj" event={"ID":"cfa6c3ac-b16f-4d5f-8439-e0b3d12ebf7b","Type":"ContainerDied","Data":"06344bb50804b2a0bb5d63679c57b4e159cd15a678a1a0d130dc0ab5c24a9fd8"}
Sep 09 14:30:01.910699 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:01.910458    2553 scope.go:117] "RemoveContainer" containerID="06344bb50804b2a0bb5d63679c57b4e159cd15a678a1a0d130dc0ab5c24a9fd8"
Sep 09 14:30:01.912330 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:01.912310    2553 generic.go:356] "Generic (PLEG): container finished" podID="4267fe47-b6e6-4acd-9378-e61f44a0d40d" containerID="9c4656fa94e9a09b4e50d7a527dbe995ef4337bf0c0fbc93c504db7ba877b9c0" exitCode=0
Sep 09 14:30:01.912424 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:01.912391    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-cbb7fb-29816070-nr97d" event={"ID":"4267fe47-b6e6-4acd-9378-e61f44a0d40d","Type":"ContainerDied","Data":"9c4656fa94e9a09b4e50d7a527dbe995ef4337bf0c0fbc93c504db7ba877b9c0"}
Sep 09 14:30:02.919269 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:02.919226    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-fecaf9-29816070-qg6tj" event={"ID":"cfa6c3ac-b16f-4d5f-8439-e0b3d12ebf7b","Type":"ContainerStarted","Data":"1905c855d7e82e05de00b3a7acd096c44d244088baff1f2f9cf40c6df5989a01"}
Sep 09 14:30:03.125507 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:03.125481    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-cbb7fb-29816070-nr97d"
Sep 09 14:30:03.926422 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:03.926383    2553 generic.go:356] "Generic (PLEG): container finished" podID="cfa6c3ac-b16f-4d5f-8439-e0b3d12ebf7b" containerID="1905c855d7e82e05de00b3a7acd096c44d244088baff1f2f9cf40c6df5989a01" exitCode=0
Sep 09 14:30:03.926830 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:03.926635    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-fecaf9-29816070-qg6tj" event={"ID":"cfa6c3ac-b16f-4d5f-8439-e0b3d12ebf7b","Type":"ContainerDied","Data":"1905c855d7e82e05de00b3a7acd096c44d244088baff1f2f9cf40c6df5989a01"}
Sep 09 14:30:03.926830 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:03.926705    2553 scope.go:117] "RemoveContainer" containerID="06344bb50804b2a0bb5d63679c57b4e159cd15a678a1a0d130dc0ab5c24a9fd8"
Sep 09 14:30:03.927979 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:03.927960    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-cbb7fb-29816070-nr97d"
Sep 09 14:30:03.928041 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:03.927993    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-cbb7fb-29816070-nr97d" event={"ID":"4267fe47-b6e6-4acd-9378-e61f44a0d40d","Type":"ContainerDied","Data":"1946f102b253d8967e1e56cf705969ca7dfb09497ec2506ef6be46f5bd442d7d"}
Sep 09 14:30:03.928041 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:03.928027    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1946f102b253d8967e1e56cf705969ca7dfb09497ec2506ef6be46f5bd442d7d"
Sep 09 14:30:05.117934 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:05.117903    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-fecaf9-29816070-qg6tj"
Sep 09 14:30:05.943878 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:05.943827    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-fecaf9-29816070-qg6tj" event={"ID":"cfa6c3ac-b16f-4d5f-8439-e0b3d12ebf7b","Type":"ContainerDied","Data":"e491a006f218ff52942dbe698ba4eedb8c6fc9c684c6dc0929d32eb911ce6e84"}
Sep 09 14:30:05.944069 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:05.943906    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e491a006f218ff52942dbe698ba4eedb8c6fc9c684c6dc0929d32eb911ce6e84"
Sep 09 14:30:05.944069 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:05.943969    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-fecaf9-29816070-qg6tj"
Sep 09 14:30:07.896839 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:07.896786    2553 patch_prober.go:28] interesting pod/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 14:30:07.898292 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:07.896891    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r" podUID="5649edb4-ea1f-436a-b822-aed83d685a29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 14:30:07.958053 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:07.958022    2553 generic.go:356] "Generic (PLEG): container finished" podID="5649edb4-ea1f-436a-b822-aed83d685a29" containerID="3c17760ab4707389025ce4552cb808bbe96a6e3f8e52a4d2160759cef787b929" exitCode=0
Sep 09 14:30:07.958192 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:07.958068    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r" event={"ID":"5649edb4-ea1f-436a-b822-aed83d685a29","Type":"ContainerDied","Data":"3c17760ab4707389025ce4552cb808bbe96a6e3f8e52a4d2160759cef787b929"}
Sep 09 14:30:07.958454 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:07.958439    2553 scope.go:117] "RemoveContainer" containerID="3c17760ab4707389025ce4552cb808bbe96a6e3f8e52a4d2160759cef787b929"
Sep 09 14:30:07.959553 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:07.959518    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:30:07.959643 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:07.959613    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:30:07.959683 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:07.959647    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:30:08.968582 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:08.968525    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r" event={"ID":"5649edb4-ea1f-436a-b822-aed83d685a29","Type":"ContainerStarted","Data":"9835adaf8035420ab815e2ac064df0befec97594a8054126d53ce21c4adb6387"}
Sep 09 14:30:09.645367 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:09.645328    2553 patch_prober.go:28] interesting pod/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 09 14:30:09.645582 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:09.645395    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r" podUID="5649edb4-ea1f-436a-b822-aed83d685a29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 09 14:30:09.649077 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:09.649049    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:30:09.828731 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:09.828695    2553 patch_prober.go:28] interesting pod/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 14:30:09.828897 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:09.828746    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp" podUID="3869a2b6-b582-4256-949e-08457b3f98c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 14:30:10.646487 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:10.645952    2553 patch_prober.go:28] interesting pod/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 09 14:30:10.646487 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:10.646020    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r" podUID="5649edb4-ea1f-436a-b822-aed83d685a29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 09 14:30:10.981094 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:10.981063    2553 generic.go:356] "Generic (PLEG): container finished" podID="3869a2b6-b582-4256-949e-08457b3f98c7" containerID="0627efe6a869c81774f7725c2ed67470672ce38167aa09354ebcbbec573e1c17" exitCode=0
Sep 09 14:30:10.981277 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:10.981136    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp" event={"ID":"3869a2b6-b582-4256-949e-08457b3f98c7","Type":"ContainerDied","Data":"0627efe6a869c81774f7725c2ed67470672ce38167aa09354ebcbbec573e1c17"}
Sep 09 14:30:10.981536 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:10.981521    2553 scope.go:117] "RemoveContainer" containerID="0627efe6a869c81774f7725c2ed67470672ce38167aa09354ebcbbec573e1c17"
Sep 09 14:30:10.982655 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:10.982625    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:30:10.982708 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:10.982694    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:30:10.982761 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:10.982749    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:30:11.650984 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:11.650933    2553 patch_prober.go:28] interesting pod/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 09 14:30:11.651477 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:11.651006    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r" podUID="5649edb4-ea1f-436a-b822-aed83d685a29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 09 14:30:11.991601 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:11.991543    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp" event={"ID":"3869a2b6-b582-4256-949e-08457b3f98c7","Type":"ContainerStarted","Data":"e97af55f1f53b678e6d3a36660dc7d122ceb104e8e62bd065752dd6636c88abc"}
Sep 09 14:30:12.645515 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:12.645468    2553 patch_prober.go:28] interesting pod/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 09 14:30:12.645745 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:12.645537    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r" podUID="5649edb4-ea1f-436a-b822-aed83d685a29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 09 14:30:12.874965 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:12.874924    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:30:12.875431 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:12.875053    2553 patch_prober.go:28] interesting pod/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 09 14:30:12.875431 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:12.875100    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp" podUID="3869a2b6-b582-4256-949e-08457b3f98c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 09 14:30:13.649122 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:13.649082    2553 patch_prober.go:28] interesting pod/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 09 14:30:13.649355 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:13.649146    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r" podUID="5649edb4-ea1f-436a-b822-aed83d685a29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 09 14:30:13.874523 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:13.874484    2553 patch_prober.go:28] interesting pod/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 09 14:30:13.874850 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:13.874814    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp" podUID="3869a2b6-b582-4256-949e-08457b3f98c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 09 14:30:14.652018 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:14.651987    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:30:14.653075 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:14.653051    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:30:14.657466 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:14.657438    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:30:14.875357 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:14.875316    2553 patch_prober.go:28] interesting pod/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 09 14:30:14.875556 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:14.875377    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp" podUID="3869a2b6-b582-4256-949e-08457b3f98c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 09 14:30:15.875200 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:15.875166    2553 patch_prober.go:28] interesting pod/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 09 14:30:15.875557 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:15.875220    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp" podUID="3869a2b6-b582-4256-949e-08457b3f98c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 09 14:30:16.874435 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:16.874401    2553 patch_prober.go:28] interesting pod/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 09 14:30:16.874610 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:16.874461    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp" podUID="3869a2b6-b582-4256-949e-08457b3f98c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 09 14:30:17.878463 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:17.878432    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:30:17.878869 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:17.878778    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:30:17.879376 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:17.879359    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:30:31.609352 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.609318    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"]
Sep 09 14:30:31.609840 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.609656    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfa6c3ac-b16f-4d5f-8439-e0b3d12ebf7b" containerName="cleanup"
Sep 09 14:30:31.609840 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.609667    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfa6c3ac-b16f-4d5f-8439-e0b3d12ebf7b" containerName="cleanup"
Sep 09 14:30:31.609840 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.609677    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfa6c3ac-b16f-4d5f-8439-e0b3d12ebf7b" containerName="cleanup"
Sep 09 14:30:31.609840 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.609682    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfa6c3ac-b16f-4d5f-8439-e0b3d12ebf7b" containerName="cleanup"
Sep 09 14:30:31.609840 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.609702    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4267fe47-b6e6-4acd-9378-e61f44a0d40d" containerName="cleanup"
Sep 09 14:30:31.609840 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.609707    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4267fe47-b6e6-4acd-9378-e61f44a0d40d" containerName="cleanup"
Sep 09 14:30:31.609840 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.609761    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4267fe47-b6e6-4acd-9378-e61f44a0d40d" containerName="cleanup"
Sep 09 14:30:31.609840 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.609770    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfa6c3ac-b16f-4d5f-8439-e0b3d12ebf7b" containerName="cleanup"
Sep 09 14:30:31.609840 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.609776    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfa6c3ac-b16f-4d5f-8439-e0b3d12ebf7b" containerName="cleanup"
Sep 09 14:30:31.612343 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.612312    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.614482 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.614457    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-e565aa\"/\"default-dockercfg-lxkht\""
Sep 09 14:30:31.615345 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.615318    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-e565aa\"/\"kube-root-ca.crt\""
Sep 09 14:30:31.615345 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.615342    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-e565aa\"/\"auth-test-model-e565aa-kserve-self-signed-certs\""
Sep 09 14:30:31.615494 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.615328    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-e565aa\"/\"openshift-service-ca.crt\""
Sep 09 14:30:31.622767 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.622749    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"]
Sep 09 14:30:31.756396 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.756357    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-tmp-dir\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.756550 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.756422    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh87b\" (UniqueName: \"kubernetes.io/projected/264d5a10-79b7-4109-9d9a-dee4c6016054-kube-api-access-vh87b\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.756550 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.756456    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-home\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.756550 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.756490    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264d5a10-79b7-4109-9d9a-dee4c6016054-tls-certs\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.756550 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.756543    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-dshm\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.756731 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.756631    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-model-cache\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.857770 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.857732    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-home\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.857770 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.857786    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264d5a10-79b7-4109-9d9a-dee4c6016054-tls-certs\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.858052 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.857829    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-dshm\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.858052 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.857860    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-model-cache\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.858052 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.857944    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-tmp-dir\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.858052 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.857991    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh87b\" (UniqueName: \"kubernetes.io/projected/264d5a10-79b7-4109-9d9a-dee4c6016054-kube-api-access-vh87b\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.858281 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.858211    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-home\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.858376 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.858351    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-tmp-dir\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.858596 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.858554    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-model-cache\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.860062 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.860005    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-dshm\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.860421 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.860399    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264d5a10-79b7-4109-9d9a-dee4c6016054-tls-certs\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.866033 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.866012    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh87b\" (UniqueName: \"kubernetes.io/projected/264d5a10-79b7-4109-9d9a-dee4c6016054-kube-api-access-vh87b\") pod \"auth-test-model-e565aa-kserve-65d8d6549f-9xbff\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") " pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:31.922352 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:31.922329    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:32.193497 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:32.193472    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"]
Sep 09 14:30:32.195277 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:30:32.195251    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod264d5a10_79b7_4109_9d9a_dee4c6016054.slice/crio-6a2f34d5e29b3707df91a71e113e84c9c472a38bac44aaa0a34f930696e728e6 WatchSource:0}: Error finding container 6a2f34d5e29b3707df91a71e113e84c9c472a38bac44aaa0a34f930696e728e6: Status 404 returned error can't find the container with id 6a2f34d5e29b3707df91a71e113e84c9c472a38bac44aaa0a34f930696e728e6
Sep 09 14:30:33.096896 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:33.096862    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff" event={"ID":"264d5a10-79b7-4109-9d9a-dee4c6016054","Type":"ContainerStarted","Data":"6642812fc742a2f47c00117a3b63788f4b28e996c55cc1d46de742e757c3f406"}
Sep 09 14:30:33.097349 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:33.096904    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff" event={"ID":"264d5a10-79b7-4109-9d9a-dee4c6016054","Type":"ContainerStarted","Data":"6a2f34d5e29b3707df91a71e113e84c9c472a38bac44aaa0a34f930696e728e6"}
Sep 09 14:30:33.117302 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:33.117232    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff" podStartSLOduration=2.117219504 podStartE2EDuration="2.117219504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:30:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:30:33.115891859 +0000 UTC m=+1183.919874886" watchObservedRunningTime="2026-09-09 14:30:33.117219504 +0000 UTC m=+1183.921202506"
Sep 09 14:30:36.504992 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:36.504954    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:30:41.922993 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:41.922961    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:41.923458 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:41.923048    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:41.935720 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:41.935697    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:42.158618 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:42.158594    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:30:55.091276 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:30:55.091239    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:31:07.389233 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.389199    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"]
Sep 09 14:31:07.391700 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.391675    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.394252 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.394228    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-c5e2d3\"/\"kube-root-ca.crt\""
Sep 09 14:31:07.395198 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.395152    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-c5e2d3\"/\"default-dockercfg-6dpwd\""
Sep 09 14:31:07.395198 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.395177    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-c5e2d3\"/\"auth-test-model-c5e2d3-kserve-self-signed-certs\""
Sep 09 14:31:07.395198 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.395190    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-c5e2d3\"/\"openshift-service-ca.crt\""
Sep 09 14:31:07.403718 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.403697    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"]
Sep 09 14:31:07.482987 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.482945    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c64c4d5-e508-48c1-87d4-07ef955e09fc-tls-certs\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.483177 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.482996    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-model-cache\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.483177 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.483095    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2p4f\" (UniqueName: \"kubernetes.io/projected/6c64c4d5-e508-48c1-87d4-07ef955e09fc-kube-api-access-q2p4f\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.483177 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.483124    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-tmp-dir\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.483177 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.483162    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-home\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.483363 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.483227    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-dshm\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.584171 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.584130    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2p4f\" (UniqueName: \"kubernetes.io/projected/6c64c4d5-e508-48c1-87d4-07ef955e09fc-kube-api-access-q2p4f\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.584422 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.584401    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-tmp-dir\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.584557 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.584543    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-home\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.584736 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.584721    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-dshm\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.584840 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.584828    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c64c4d5-e508-48c1-87d4-07ef955e09fc-tls-certs\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.584943 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.584931    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-model-cache\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.585537 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.585510    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-model-cache\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.585964 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.585925    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-tmp-dir\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.586465 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.586443    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-home\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.589800 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.589777    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-dshm\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.590086 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.590062    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c64c4d5-e508-48c1-87d4-07ef955e09fc-tls-certs\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.593814 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.593790    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2p4f\" (UniqueName: \"kubernetes.io/projected/6c64c4d5-e508-48c1-87d4-07ef955e09fc-kube-api-access-q2p4f\") pod \"auth-test-model-c5e2d3-kserve-7756448db7-mrnzb\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.701070 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.701037    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:07.976517 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:07.976492    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"]
Sep 09 14:31:07.978138 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:31:07.978113    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c64c4d5_e508_48c1_87d4_07ef955e09fc.slice/crio-9ec1b8adbbad3e5f2c0f92f41992872662a6799529b81441bd1e1d41b730b356 WatchSource:0}: Error finding container 9ec1b8adbbad3e5f2c0f92f41992872662a6799529b81441bd1e1d41b730b356: Status 404 returned error can't find the container with id 9ec1b8adbbad3e5f2c0f92f41992872662a6799529b81441bd1e1d41b730b356
Sep 09 14:31:08.281732 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:08.281643    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb" event={"ID":"6c64c4d5-e508-48c1-87d4-07ef955e09fc","Type":"ContainerStarted","Data":"5e903cffa4f1de08f4aad8b3872a98a098e809fa3643a1a83d9039aef7330616"}
Sep 09 14:31:08.281732 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:08.281690    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb" event={"ID":"6c64c4d5-e508-48c1-87d4-07ef955e09fc","Type":"ContainerStarted","Data":"9ec1b8adbbad3e5f2c0f92f41992872662a6799529b81441bd1e1d41b730b356"}
Sep 09 14:31:08.303366 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:08.303322    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb" podStartSLOduration=1.303307086 podStartE2EDuration="1.303307086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:31:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:31:08.301157128 +0000 UTC m=+1219.105140142" watchObservedRunningTime="2026-09-09 14:31:08.303307086 +0000 UTC m=+1219.107290095"
Sep 09 14:31:13.603883 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:13.603848    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:31:17.701892 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:17.701852    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:17.702296 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:17.701942    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:17.714704 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:17.714677    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:18.342084 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:18.342056    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:31:27.703967 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:27.703932    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:31:41.997767 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:31:41.997729    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:32:01.190236 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:32:01.190198    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:32:22.197352 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:32:22.197315    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:32:33.200101 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:32:33.200062    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:32:47.790689 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:32:47.790656    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:33:03.697624 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:03.697582    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:33:21.289123 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:21.289051    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"]
Sep 09 14:33:21.897311 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:21.897281    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:33:22.206431 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:22.206403    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"]
Sep 09 14:33:32.994154 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:32.994123    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:33:36.308581 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.308513    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff" podUID="264d5a10-79b7-4109-9d9a-dee4c6016054" containerName="main" containerID="cri-o://6642812fc742a2f47c00117a3b63788f4b28e996c55cc1d46de742e757c3f406" gracePeriod=45
Sep 09 14:33:36.546057 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.546032    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:33:36.614029 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.613960    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-tmp-dir\") pod \"264d5a10-79b7-4109-9d9a-dee4c6016054\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") "
Sep 09 14:33:36.614029 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.613991    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh87b\" (UniqueName: \"kubernetes.io/projected/264d5a10-79b7-4109-9d9a-dee4c6016054-kube-api-access-vh87b\") pod \"264d5a10-79b7-4109-9d9a-dee4c6016054\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") "
Sep 09 14:33:36.614029 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.614010    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264d5a10-79b7-4109-9d9a-dee4c6016054-tls-certs\") pod \"264d5a10-79b7-4109-9d9a-dee4c6016054\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") "
Sep 09 14:33:36.614233 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.614083    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-model-cache\") pod \"264d5a10-79b7-4109-9d9a-dee4c6016054\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") "
Sep 09 14:33:36.614233 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.614132    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-dshm\") pod \"264d5a10-79b7-4109-9d9a-dee4c6016054\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") "
Sep 09 14:33:36.614233 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.614160    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-home\") pod \"264d5a10-79b7-4109-9d9a-dee4c6016054\" (UID: \"264d5a10-79b7-4109-9d9a-dee4c6016054\") "
Sep 09 14:33:36.614376 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.614259    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "264d5a10-79b7-4109-9d9a-dee4c6016054" (UID: "264d5a10-79b7-4109-9d9a-dee4c6016054"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:33:36.614441 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.614387    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-model-cache" (OuterVolumeSpecName: "model-cache") pod "264d5a10-79b7-4109-9d9a-dee4c6016054" (UID: "264d5a10-79b7-4109-9d9a-dee4c6016054"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:33:36.614537 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.614508    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-home" (OuterVolumeSpecName: "home") pod "264d5a10-79b7-4109-9d9a-dee4c6016054" (UID: "264d5a10-79b7-4109-9d9a-dee4c6016054"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:33:36.614664 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.614593    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-tmp-dir\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:33:36.614664 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.614615    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-model-cache\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:33:36.616330 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.616302    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-dshm" (OuterVolumeSpecName: "dshm") pod "264d5a10-79b7-4109-9d9a-dee4c6016054" (UID: "264d5a10-79b7-4109-9d9a-dee4c6016054"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:33:36.616560 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.616538    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/264d5a10-79b7-4109-9d9a-dee4c6016054-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "264d5a10-79b7-4109-9d9a-dee4c6016054" (UID: "264d5a10-79b7-4109-9d9a-dee4c6016054"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:33:36.616664 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.616551    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/264d5a10-79b7-4109-9d9a-dee4c6016054-kube-api-access-vh87b" (OuterVolumeSpecName: "kube-api-access-vh87b") pod "264d5a10-79b7-4109-9d9a-dee4c6016054" (UID: "264d5a10-79b7-4109-9d9a-dee4c6016054"). InnerVolumeSpecName "kube-api-access-vh87b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:33:36.716016 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.715983    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh87b\" (UniqueName: \"kubernetes.io/projected/264d5a10-79b7-4109-9d9a-dee4c6016054-kube-api-access-vh87b\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:33:36.716016 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.716012    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264d5a10-79b7-4109-9d9a-dee4c6016054-tls-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:33:36.716016 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.716022    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-dshm\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:33:36.716240 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:36.716029    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264d5a10-79b7-4109-9d9a-dee4c6016054-home\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:33:37.034861 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.034832    2553 generic.go:356] "Generic (PLEG): container finished" podID="264d5a10-79b7-4109-9d9a-dee4c6016054" containerID="6642812fc742a2f47c00117a3b63788f4b28e996c55cc1d46de742e757c3f406" exitCode=0
Sep 09 14:33:37.035016 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.034869    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff" event={"ID":"264d5a10-79b7-4109-9d9a-dee4c6016054","Type":"ContainerDied","Data":"6642812fc742a2f47c00117a3b63788f4b28e996c55cc1d46de742e757c3f406"}
Sep 09 14:33:37.035016 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.034874    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"
Sep 09 14:33:37.035016 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.034895    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff" event={"ID":"264d5a10-79b7-4109-9d9a-dee4c6016054","Type":"ContainerDied","Data":"6a2f34d5e29b3707df91a71e113e84c9c472a38bac44aaa0a34f930696e728e6"}
Sep 09 14:33:37.035016 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.034912    2553 scope.go:117] "RemoveContainer" containerID="6642812fc742a2f47c00117a3b63788f4b28e996c55cc1d46de742e757c3f406"
Sep 09 14:33:37.043846 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.043829    2553 scope.go:117] "RemoveContainer" containerID="6642812fc742a2f47c00117a3b63788f4b28e996c55cc1d46de742e757c3f406"
Sep 09 14:33:37.044107 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:33:37.044089    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6642812fc742a2f47c00117a3b63788f4b28e996c55cc1d46de742e757c3f406\": container with ID starting with 6642812fc742a2f47c00117a3b63788f4b28e996c55cc1d46de742e757c3f406 not found: ID does not exist" containerID="6642812fc742a2f47c00117a3b63788f4b28e996c55cc1d46de742e757c3f406"
Sep 09 14:33:37.044152 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.044115    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6642812fc742a2f47c00117a3b63788f4b28e996c55cc1d46de742e757c3f406"} err="failed to get container status \"6642812fc742a2f47c00117a3b63788f4b28e996c55cc1d46de742e757c3f406\": rpc error: code = NotFound desc = could not find container \"6642812fc742a2f47c00117a3b63788f4b28e996c55cc1d46de742e757c3f406\": container with ID starting with 6642812fc742a2f47c00117a3b63788f4b28e996c55cc1d46de742e757c3f406 not found: ID does not exist"
Sep 09 14:33:37.056474 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.056452    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"]
Sep 09 14:33:37.060350 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.060328    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-e565aa/auth-test-model-e565aa-kserve-65d8d6549f-9xbff"]
Sep 09 14:33:37.225695 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.225654    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb" podUID="6c64c4d5-e508-48c1-87d4-07ef955e09fc" containerName="main" containerID="cri-o://5e903cffa4f1de08f4aad8b3872a98a098e809fa3643a1a83d9039aef7330616" gracePeriod=45
Sep 09 14:33:37.473227 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.473204    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:33:37.623207 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.623120    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c64c4d5-e508-48c1-87d4-07ef955e09fc-tls-certs\") pod \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") "
Sep 09 14:33:37.623207 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.623184    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-dshm\") pod \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") "
Sep 09 14:33:37.623207 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.623213    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-tmp-dir\") pod \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") "
Sep 09 14:33:37.623487 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.623363    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2p4f\" (UniqueName: \"kubernetes.io/projected/6c64c4d5-e508-48c1-87d4-07ef955e09fc-kube-api-access-q2p4f\") pod \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") "
Sep 09 14:33:37.623487 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.623405    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-model-cache\") pod \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") "
Sep 09 14:33:37.623487 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.623411    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6c64c4d5-e508-48c1-87d4-07ef955e09fc" (UID: "6c64c4d5-e508-48c1-87d4-07ef955e09fc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:33:37.623487 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.623457    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-home\") pod \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\" (UID: \"6c64c4d5-e508-48c1-87d4-07ef955e09fc\") "
Sep 09 14:33:37.623708 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.623687    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-model-cache" (OuterVolumeSpecName: "model-cache") pod "6c64c4d5-e508-48c1-87d4-07ef955e09fc" (UID: "6c64c4d5-e508-48c1-87d4-07ef955e09fc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:33:37.623768 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.623750    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-home" (OuterVolumeSpecName: "home") pod "6c64c4d5-e508-48c1-87d4-07ef955e09fc" (UID: "6c64c4d5-e508-48c1-87d4-07ef955e09fc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:33:37.623815 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.623753    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-tmp-dir\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:33:37.625495 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.625473    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c64c4d5-e508-48c1-87d4-07ef955e09fc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6c64c4d5-e508-48c1-87d4-07ef955e09fc" (UID: "6c64c4d5-e508-48c1-87d4-07ef955e09fc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:33:37.625495 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.625482    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c64c4d5-e508-48c1-87d4-07ef955e09fc-kube-api-access-q2p4f" (OuterVolumeSpecName: "kube-api-access-q2p4f") pod "6c64c4d5-e508-48c1-87d4-07ef955e09fc" (UID: "6c64c4d5-e508-48c1-87d4-07ef955e09fc"). InnerVolumeSpecName "kube-api-access-q2p4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:33:37.625621 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.625522    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-dshm" (OuterVolumeSpecName: "dshm") pod "6c64c4d5-e508-48c1-87d4-07ef955e09fc" (UID: "6c64c4d5-e508-48c1-87d4-07ef955e09fc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:33:37.647492 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.647467    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="264d5a10-79b7-4109-9d9a-dee4c6016054" path="/var/lib/kubelet/pods/264d5a10-79b7-4109-9d9a-dee4c6016054/volumes"
Sep 09 14:33:37.724782 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.724754    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-dshm\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:33:37.724782 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.724782    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2p4f\" (UniqueName: \"kubernetes.io/projected/6c64c4d5-e508-48c1-87d4-07ef955e09fc-kube-api-access-q2p4f\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:33:37.724918 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.724796    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-model-cache\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:33:37.724918 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.724810    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c64c4d5-e508-48c1-87d4-07ef955e09fc-home\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:33:37.724918 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:37.724823    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c64c4d5-e508-48c1-87d4-07ef955e09fc-tls-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:33:38.041663 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:38.041633    2553 generic.go:356] "Generic (PLEG): container finished" podID="6c64c4d5-e508-48c1-87d4-07ef955e09fc" containerID="5e903cffa4f1de08f4aad8b3872a98a098e809fa3643a1a83d9039aef7330616" exitCode=0
Sep 09 14:33:38.041855 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:38.041672    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"
Sep 09 14:33:38.041855 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:38.041723    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb" event={"ID":"6c64c4d5-e508-48c1-87d4-07ef955e09fc","Type":"ContainerDied","Data":"5e903cffa4f1de08f4aad8b3872a98a098e809fa3643a1a83d9039aef7330616"}
Sep 09 14:33:38.041855 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:38.041766    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb" event={"ID":"6c64c4d5-e508-48c1-87d4-07ef955e09fc","Type":"ContainerDied","Data":"9ec1b8adbbad3e5f2c0f92f41992872662a6799529b81441bd1e1d41b730b356"}
Sep 09 14:33:38.041855 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:38.041788    2553 scope.go:117] "RemoveContainer" containerID="5e903cffa4f1de08f4aad8b3872a98a098e809fa3643a1a83d9039aef7330616"
Sep 09 14:33:38.050503 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:38.050486    2553 scope.go:117] "RemoveContainer" containerID="5e903cffa4f1de08f4aad8b3872a98a098e809fa3643a1a83d9039aef7330616"
Sep 09 14:33:38.050744 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:33:38.050728    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e903cffa4f1de08f4aad8b3872a98a098e809fa3643a1a83d9039aef7330616\": container with ID starting with 5e903cffa4f1de08f4aad8b3872a98a098e809fa3643a1a83d9039aef7330616 not found: ID does not exist" containerID="5e903cffa4f1de08f4aad8b3872a98a098e809fa3643a1a83d9039aef7330616"
Sep 09 14:33:38.050812 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:38.050749    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e903cffa4f1de08f4aad8b3872a98a098e809fa3643a1a83d9039aef7330616"} err="failed to get container status \"5e903cffa4f1de08f4aad8b3872a98a098e809fa3643a1a83d9039aef7330616\": rpc error: code = NotFound desc = could not find container \"5e903cffa4f1de08f4aad8b3872a98a098e809fa3643a1a83d9039aef7330616\": container with ID starting with 5e903cffa4f1de08f4aad8b3872a98a098e809fa3643a1a83d9039aef7330616 not found: ID does not exist"
Sep 09 14:33:38.060532 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:38.060511    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"]
Sep 09 14:33:38.069469 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:38.069449    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/auth-test-model-c5e2d3-kserve-7756448db7-mrnzb"]
Sep 09 14:33:39.647726 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:39.647692    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c64c4d5-e508-48c1-87d4-07ef955e09fc" path="/var/lib/kubelet/pods/6c64c4d5-e508-48c1-87d4-07ef955e09fc/volumes"
Sep 09 14:33:46.595880 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:33:46.595842    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:34:05.060376 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.060339    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"]
Sep 09 14:34:05.060931 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.060909    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c64c4d5-e508-48c1-87d4-07ef955e09fc" containerName="main"
Sep 09 14:34:05.061001 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.060937    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c64c4d5-e508-48c1-87d4-07ef955e09fc" containerName="main"
Sep 09 14:34:05.061001 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.060959    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="264d5a10-79b7-4109-9d9a-dee4c6016054" containerName="main"
Sep 09 14:34:05.061001 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.060969    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="264d5a10-79b7-4109-9d9a-dee4c6016054" containerName="main"
Sep 09 14:34:05.061104 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.061069    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="264d5a10-79b7-4109-9d9a-dee4c6016054" containerName="main"
Sep 09 14:34:05.061104 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.061085    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c64c4d5-e508-48c1-87d4-07ef955e09fc" containerName="main"
Sep 09 14:34:05.066579 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.066545    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:05.068864 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.068837    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-4b83c2-serving-cert\""
Sep 09 14:34:05.073976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.073126    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"]
Sep 09 14:34:05.168117 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.168074    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/837de529-20ce-407b-88c1-86de19399f1d-openshift-service-ca\") pod \"maas-api-e2e-api-a-4b83c2-645845b474-k55hj\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:05.168117 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.168116    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837de529-20ce-407b-88c1-86de19399f1d-metrics-certs\") pod \"maas-api-e2e-api-a-4b83c2-645845b474-k55hj\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:05.168334 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.168140    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/837de529-20ce-407b-88c1-86de19399f1d-maas-api-tls\") pod \"maas-api-e2e-api-a-4b83c2-645845b474-k55hj\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:05.168334 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.168161    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b45rb\" (UniqueName: \"kubernetes.io/projected/837de529-20ce-407b-88c1-86de19399f1d-kube-api-access-b45rb\") pod \"maas-api-e2e-api-a-4b83c2-645845b474-k55hj\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:05.269713 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.269617    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/837de529-20ce-407b-88c1-86de19399f1d-openshift-service-ca\") pod \"maas-api-e2e-api-a-4b83c2-645845b474-k55hj\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:05.269910 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.269735    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837de529-20ce-407b-88c1-86de19399f1d-metrics-certs\") pod \"maas-api-e2e-api-a-4b83c2-645845b474-k55hj\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:05.269910 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.269760    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/837de529-20ce-407b-88c1-86de19399f1d-maas-api-tls\") pod \"maas-api-e2e-api-a-4b83c2-645845b474-k55hj\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:05.269910 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.269776    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b45rb\" (UniqueName: \"kubernetes.io/projected/837de529-20ce-407b-88c1-86de19399f1d-kube-api-access-b45rb\") pod \"maas-api-e2e-api-a-4b83c2-645845b474-k55hj\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:05.269910 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:34:05.269898    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-serving-cert: secret "maas-api-e2e-api-a-4b83c2-serving-cert" not found
Sep 09 14:34:05.270130 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:34:05.269968    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/837de529-20ce-407b-88c1-86de19399f1d-maas-api-tls podName:837de529-20ce-407b-88c1-86de19399f1d nodeName:}" failed. No retries permitted until 2026-09-09 14:34:05.769950392 +0000 UTC m=+1396.573933387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/837de529-20ce-407b-88c1-86de19399f1d-maas-api-tls") pod "maas-api-e2e-api-a-4b83c2-645845b474-k55hj" (UID: "837de529-20ce-407b-88c1-86de19399f1d") : secret "maas-api-e2e-api-a-4b83c2-serving-cert" not found
Sep 09 14:34:05.270315 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.270290    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/837de529-20ce-407b-88c1-86de19399f1d-openshift-service-ca\") pod \"maas-api-e2e-api-a-4b83c2-645845b474-k55hj\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:05.272167 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.272147    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837de529-20ce-407b-88c1-86de19399f1d-metrics-certs\") pod \"maas-api-e2e-api-a-4b83c2-645845b474-k55hj\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:05.281668 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.281640    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b45rb\" (UniqueName: \"kubernetes.io/projected/837de529-20ce-407b-88c1-86de19399f1d-kube-api-access-b45rb\") pod \"maas-api-e2e-api-a-4b83c2-645845b474-k55hj\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:05.774502 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.774468    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/837de529-20ce-407b-88c1-86de19399f1d-maas-api-tls\") pod \"maas-api-e2e-api-a-4b83c2-645845b474-k55hj\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:05.776811 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.776794    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/837de529-20ce-407b-88c1-86de19399f1d-maas-api-tls\") pod \"maas-api-e2e-api-a-4b83c2-645845b474-k55hj\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:05.980714 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:05.980670    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:06.256076 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:06.256050    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"]
Sep 09 14:34:06.257402 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:34:06.257365    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod837de529_20ce_407b_88c1_86de19399f1d.slice/crio-421bffc30019453a69276f4ce572aa999db130d89fbc050af2156538a399a7b9 WatchSource:0}: Error finding container 421bffc30019453a69276f4ce572aa999db130d89fbc050af2156538a399a7b9: Status 404 returned error can't find the container with id 421bffc30019453a69276f4ce572aa999db130d89fbc050af2156538a399a7b9
Sep 09 14:34:06.258718 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:06.258702    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 14:34:07.201387 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:07.201353    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj" event={"ID":"837de529-20ce-407b-88c1-86de19399f1d","Type":"ContainerStarted","Data":"9bc52447a3b3510d956b6afbb2cba1879586081b7d930ccc6089d0d1245b3979"}
Sep 09 14:34:07.201555 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:07.201433    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj" event={"ID":"837de529-20ce-407b-88c1-86de19399f1d","Type":"ContainerStarted","Data":"421bffc30019453a69276f4ce572aa999db130d89fbc050af2156538a399a7b9"}
Sep 09 14:34:07.201555 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:07.201497    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:07.223865 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:07.223817    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj" podStartSLOduration=1.7732211530000002 podStartE2EDuration="2.223802508s" totalImagesPullingTime="450.581355ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:34:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:34:07.22176939 +0000 UTC m=+1398.025752405" watchObservedRunningTime="2026-09-09 14:34:07.223802508 +0000 UTC m=+1398.027785511"
Sep 09 14:34:13.212223 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:13.212193    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:34:14.198755 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:14.198715    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:34:29.822402 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:29.822367    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"]
Sep 09 14:34:29.825894 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:29.825860    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:29.828842 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:29.828804    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-a959bc-openshift-default-dockercfg-2w7vj\""
Sep 09 14:34:29.838824 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:29.838798    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"]
Sep 09 14:34:29.997725 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:29.997689    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-credential-socket\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:29.997884 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:29.997749    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-podinfo\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:29.997884 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:29.997791    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-workload-socket\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:29.997884 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:29.997827    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-envoy\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:29.997884 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:29.997856    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rw4q\" (UniqueName: \"kubernetes.io/projected/67585e41-2de4-49e3-af7c-09e3d4ac620b-kube-api-access-4rw4q\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:29.998025 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:29.997909    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-workload-certs\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:29.998025 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:29.997950    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-data\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:29.998025 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:29.998003    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-token\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:29.998121 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:29.998035    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67585e41-2de4-49e3-af7c-09e3d4ac620b-istiod-ca-cert\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.099423 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.099327    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-credential-socket\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.099423 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.099375    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-podinfo\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.099423 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.099405    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-workload-socket\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.099765 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.099439    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-envoy\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.099765 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.099464    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rw4q\" (UniqueName: \"kubernetes.io/projected/67585e41-2de4-49e3-af7c-09e3d4ac620b-kube-api-access-4rw4q\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.099765 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.099500    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-workload-certs\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.099765 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.099547    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-data\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.099765 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.099636    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-token\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.099765 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.099666    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67585e41-2de4-49e3-af7c-09e3d4ac620b-istiod-ca-cert\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.100088 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.099798    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-credential-socket\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.100088 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.099810    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-workload-socket\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.100088 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.100075    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-data\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.100213 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.100191    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-workload-certs\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.100431 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.100409    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67585e41-2de4-49e3-af7c-09e3d4ac620b-istiod-ca-cert\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.101790 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.101767    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-envoy\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.102033 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.102014    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-podinfo\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.108107 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.108077    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rw4q\" (UniqueName: \"kubernetes.io/projected/67585e41-2de4-49e3-af7c-09e3d4ac620b-kube-api-access-4rw4q\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.108755 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.108736    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-token\") pod \"e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") " pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.137231 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.137209    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:30.418622 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.416387    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"]
Sep 09 14:34:30.424745 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.424709    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:34:30.424839 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.424778    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:34:30.424839 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:30.424806    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:34:31.323412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:31.323381    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h" event={"ID":"67585e41-2de4-49e3-af7c-09e3d4ac620b","Type":"ContainerStarted","Data":"3fadd693811e5d70ba76f0b6983f9fc3c0aefd2ee61a332af0a4a242552c5dde"}
Sep 09 14:34:31.323853 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:31.323430    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h" event={"ID":"67585e41-2de4-49e3-af7c-09e3d4ac620b","Type":"ContainerStarted","Data":"2f7095b86db48471c217cb1c3f0eccbfd1027ae18f27d24eb8d06a9080e25f75"}
Sep 09 14:34:31.344894 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:31.344848    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h" podStartSLOduration=2.344834224 podStartE2EDuration="2.344834224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:34:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:34:31.343770512 +0000 UTC m=+1422.147753508" watchObservedRunningTime="2026-09-09 14:34:31.344834224 +0000 UTC m=+1422.148817228"
Sep 09 14:34:32.137772 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:32.137732    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:32.142827 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:32.142799    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:32.328668 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:32.328638    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:32.329686 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:32.329664    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:44.194280 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:44.194200    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:34:54.446710 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:54.446675    2553 generic.go:356] "Generic (PLEG): container finished" podID="67585e41-2de4-49e3-af7c-09e3d4ac620b" containerID="3fadd693811e5d70ba76f0b6983f9fc3c0aefd2ee61a332af0a4a242552c5dde" exitCode=0
Sep 09 14:34:54.447105 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:54.446751    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h" event={"ID":"67585e41-2de4-49e3-af7c-09e3d4ac620b","Type":"ContainerDied","Data":"3fadd693811e5d70ba76f0b6983f9fc3c0aefd2ee61a332af0a4a242552c5dde"}
Sep 09 14:34:54.447150 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:54.447127    2553 scope.go:117] "RemoveContainer" containerID="3fadd693811e5d70ba76f0b6983f9fc3c0aefd2ee61a332af0a4a242552c5dde"
Sep 09 14:34:54.448267 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:54.448234    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:34:54.448365 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:54.448304    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:34:54.448365 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:54.448334    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:34:55.199762 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.199727    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"]
Sep 09 14:34:55.202112 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.202091    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.205037 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.205012    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-c5e2d3\"/\"kube-root-ca.crt\""
Sep 09 14:34:55.205144 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.205118    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-c5e2d3\"/\"default-dockercfg-6dpwd\""
Sep 09 14:34:55.205191 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.205143    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-c5e2d3\"/\"openshift-service-ca.crt\""
Sep 09 14:34:55.205263 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.205246    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-c5e2d3\"/\"sub-test-model-c5e2d3-kserve-self-signed-certs\""
Sep 09 14:34:55.211860 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.211837    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"]
Sep 09 14:34:55.322807 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.322772    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-model-cache\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.322807 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.322806    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63ca9cde-cbb8-46d2-87b1-288025ef0922-tls-certs\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.323003 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.322833    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-home\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.323003 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.322954    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqv8r\" (UniqueName: \"kubernetes.io/projected/63ca9cde-cbb8-46d2-87b1-288025ef0922-kube-api-access-xqv8r\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.323080 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.323022    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-tmp-dir\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.323080 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.323074    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-dshm\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.423696 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.423649    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-tmp-dir\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.423897 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.423747    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-dshm\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.423897 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.423786    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-model-cache\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.423897 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.423808    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63ca9cde-cbb8-46d2-87b1-288025ef0922-tls-certs\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.423897 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.423837    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-home\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.423897 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.423892    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqv8r\" (UniqueName: \"kubernetes.io/projected/63ca9cde-cbb8-46d2-87b1-288025ef0922-kube-api-access-xqv8r\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.424686 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.424657    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-tmp-dir\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.424991 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.424961    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-model-cache\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.425249 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.425226    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-home\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.427958 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.427856    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-dshm\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.428186 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.428146    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63ca9cde-cbb8-46d2-87b1-288025ef0922-tls-certs\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.434202 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.434170    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqv8r\" (UniqueName: \"kubernetes.io/projected/63ca9cde-cbb8-46d2-87b1-288025ef0922-kube-api-access-xqv8r\") pod \"sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.455461 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.455374    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h" event={"ID":"67585e41-2de4-49e3-af7c-09e3d4ac620b","Type":"ContainerStarted","Data":"b55603eb696cf0727771cf4dd4206b819a6e64c0f4c6c10cae2c7522ac0a60f3"}
Sep 09 14:34:55.512865 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.512821    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:34:55.803021 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:55.802994    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"]
Sep 09 14:34:55.804953 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:34:55.804921    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63ca9cde_cbb8_46d2_87b1_288025ef0922.slice/crio-63820179c11916b28c1a909ccb0cb7ed3210029eccb694a96eb0fd4a9601fcaa WatchSource:0}: Error finding container 63820179c11916b28c1a909ccb0cb7ed3210029eccb694a96eb0fd4a9601fcaa: Status 404 returned error can't find the container with id 63820179c11916b28c1a909ccb0cb7ed3210029eccb694a96eb0fd4a9601fcaa
Sep 09 14:34:56.137763 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:56.137609    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:34:56.137940 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:56.137857    2553 patch_prober.go:28] interesting pod/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 09 14:34:56.137940 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:56.137909    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h" podUID="67585e41-2de4-49e3-af7c-09e3d4ac620b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 09 14:34:56.466125 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:56.466074    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd" event={"ID":"63ca9cde-cbb8-46d2-87b1-288025ef0922","Type":"ContainerStarted","Data":"4c095c168e2f00feebbe02012199164b408717ea5163deb5f72750adc79eb2ec"}
Sep 09 14:34:56.466125 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:56.466128    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd" event={"ID":"63ca9cde-cbb8-46d2-87b1-288025ef0922","Type":"ContainerStarted","Data":"63820179c11916b28c1a909ccb0cb7ed3210029eccb694a96eb0fd4a9601fcaa"}
Sep 09 14:34:56.483486 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:56.483432    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd" podStartSLOduration=1.483416217 podStartE2EDuration="1.483416217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:34:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:34:56.482045162 +0000 UTC m=+1447.286028166" watchObservedRunningTime="2026-09-09 14:34:56.483416217 +0000 UTC m=+1447.287399219"
Sep 09 14:34:57.138516 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:57.138473    2553 patch_prober.go:28] interesting pod/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 09 14:34:57.138752 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:57.138546    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h" podUID="67585e41-2de4-49e3-af7c-09e3d4ac620b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 09 14:34:58.138258 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:58.138221    2553 patch_prober.go:28] interesting pod/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 09 14:34:58.138874 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:58.138842    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h" podUID="67585e41-2de4-49e3-af7c-09e3d4ac620b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 09 14:34:59.138319 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:59.138284    2553 patch_prober.go:28] interesting pod/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 09 14:34:59.138928 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:34:59.138895    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h" podUID="67585e41-2de4-49e3-af7c-09e3d4ac620b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 09 14:35:00.138094 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:00.138045    2553 patch_prober.go:28] interesting pod/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 09 14:35:00.138306 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:00.138118    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h" podUID="67585e41-2de4-49e3-af7c-09e3d4ac620b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 09 14:35:01.236557 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:01.236516    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:35:01.237065 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:01.236978    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:35:01.237945 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:01.237918    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:35:02.697139 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:02.697097    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:35:05.513848 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:05.513819    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:35:05.514353 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:05.514101    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:35:05.526423 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:05.526392    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:35:06.529629 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:06.529599    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:35:16.813473 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:16.813435    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"]
Sep 09 14:35:16.814070 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:16.813720    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj" podUID="837de529-20ce-407b-88c1-86de19399f1d" containerName="maas-api" containerID="cri-o://9bc52447a3b3510d956b6afbb2cba1879586081b7d930ccc6089d0d1245b3979" gracePeriod=30
Sep 09 14:35:17.050601 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.050576    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:35:17.236878 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.236846    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/837de529-20ce-407b-88c1-86de19399f1d-openshift-service-ca\") pod \"837de529-20ce-407b-88c1-86de19399f1d\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") "
Sep 09 14:35:17.237094 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.236950    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b45rb\" (UniqueName: \"kubernetes.io/projected/837de529-20ce-407b-88c1-86de19399f1d-kube-api-access-b45rb\") pod \"837de529-20ce-407b-88c1-86de19399f1d\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") "
Sep 09 14:35:17.237094 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.236994    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/837de529-20ce-407b-88c1-86de19399f1d-maas-api-tls\") pod \"837de529-20ce-407b-88c1-86de19399f1d\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") "
Sep 09 14:35:17.237094 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.237058    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837de529-20ce-407b-88c1-86de19399f1d-metrics-certs\") pod \"837de529-20ce-407b-88c1-86de19399f1d\" (UID: \"837de529-20ce-407b-88c1-86de19399f1d\") "
Sep 09 14:35:17.237295 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.237263    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/837de529-20ce-407b-88c1-86de19399f1d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "837de529-20ce-407b-88c1-86de19399f1d" (UID: "837de529-20ce-407b-88c1-86de19399f1d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:35:17.237396 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.237376    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/837de529-20ce-407b-88c1-86de19399f1d-openshift-service-ca\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:17.239115 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.239090    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/837de529-20ce-407b-88c1-86de19399f1d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "837de529-20ce-407b-88c1-86de19399f1d" (UID: "837de529-20ce-407b-88c1-86de19399f1d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:35:17.239196 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.239155    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/837de529-20ce-407b-88c1-86de19399f1d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "837de529-20ce-407b-88c1-86de19399f1d" (UID: "837de529-20ce-407b-88c1-86de19399f1d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:35:17.239196 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.239166    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/837de529-20ce-407b-88c1-86de19399f1d-kube-api-access-b45rb" (OuterVolumeSpecName: "kube-api-access-b45rb") pod "837de529-20ce-407b-88c1-86de19399f1d" (UID: "837de529-20ce-407b-88c1-86de19399f1d"). InnerVolumeSpecName "kube-api-access-b45rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:35:17.337844 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.337818    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b45rb\" (UniqueName: \"kubernetes.io/projected/837de529-20ce-407b-88c1-86de19399f1d-kube-api-access-b45rb\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:17.337844 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.337840    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/837de529-20ce-407b-88c1-86de19399f1d-maas-api-tls\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:17.337983 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.337850    2553 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837de529-20ce-407b-88c1-86de19399f1d-metrics-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:17.575163 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.575083    2553 generic.go:356] "Generic (PLEG): container finished" podID="837de529-20ce-407b-88c1-86de19399f1d" containerID="9bc52447a3b3510d956b6afbb2cba1879586081b7d930ccc6089d0d1245b3979" exitCode=0
Sep 09 14:35:17.575163 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.575125    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"
Sep 09 14:35:17.575163 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.575151    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj" event={"ID":"837de529-20ce-407b-88c1-86de19399f1d","Type":"ContainerDied","Data":"9bc52447a3b3510d956b6afbb2cba1879586081b7d930ccc6089d0d1245b3979"}
Sep 09 14:35:17.575362 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.575201    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj" event={"ID":"837de529-20ce-407b-88c1-86de19399f1d","Type":"ContainerDied","Data":"421bffc30019453a69276f4ce572aa999db130d89fbc050af2156538a399a7b9"}
Sep 09 14:35:17.575362 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.575225    2553 scope.go:117] "RemoveContainer" containerID="9bc52447a3b3510d956b6afbb2cba1879586081b7d930ccc6089d0d1245b3979"
Sep 09 14:35:17.590147 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.590127    2553 scope.go:117] "RemoveContainer" containerID="9bc52447a3b3510d956b6afbb2cba1879586081b7d930ccc6089d0d1245b3979"
Sep 09 14:35:17.590444 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:35:17.590422    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bc52447a3b3510d956b6afbb2cba1879586081b7d930ccc6089d0d1245b3979\": container with ID starting with 9bc52447a3b3510d956b6afbb2cba1879586081b7d930ccc6089d0d1245b3979 not found: ID does not exist" containerID="9bc52447a3b3510d956b6afbb2cba1879586081b7d930ccc6089d0d1245b3979"
Sep 09 14:35:17.590502 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.590452    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bc52447a3b3510d956b6afbb2cba1879586081b7d930ccc6089d0d1245b3979"} err="failed to get container status \"9bc52447a3b3510d956b6afbb2cba1879586081b7d930ccc6089d0d1245b3979\": rpc error: code = NotFound desc = could not find container \"9bc52447a3b3510d956b6afbb2cba1879586081b7d930ccc6089d0d1245b3979\": container with ID starting with 9bc52447a3b3510d956b6afbb2cba1879586081b7d930ccc6089d0d1245b3979 not found: ID does not exist"
Sep 09 14:35:17.602918 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.602895    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"]
Sep 09 14:35:17.607072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.607051    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4b83c2-645845b474-k55hj"]
Sep 09 14:35:17.645948 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.645923    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="837de529-20ce-407b-88c1-86de19399f1d" path="/var/lib/kubelet/pods/837de529-20ce-407b-88c1-86de19399f1d/volumes"
Sep 09 14:35:17.793751 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:17.793725    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:35:37.895606 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:37.895557    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:35:39.719398 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:39.719365    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"]
Sep 09 14:35:46.845755 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:46.845713    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"]
Sep 09 14:35:46.846268 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:46.845915    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h" podUID="67585e41-2de4-49e3-af7c-09e3d4ac620b" containerName="istio-proxy" containerID="cri-o://b55603eb696cf0727771cf4dd4206b819a6e64c0f4c6c10cae2c7522ac0a60f3" gracePeriod=30
Sep 09 14:35:49.798182 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:49.798151    2553 scope.go:117] "RemoveContainer" containerID="10b273e83531a7d7c3807e23e9dfdcc928e88d4f4f8ea2b3aad44d2bf8945915"
Sep 09 14:35:51.320592 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:51.320548    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:35:52.102272 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.102250    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:35:52.249017 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.248990    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-credential-socket\") pod \"67585e41-2de4-49e3-af7c-09e3d4ac620b\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") "
Sep 09 14:35:52.249163 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.249041    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-token\") pod \"67585e41-2de4-49e3-af7c-09e3d4ac620b\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") "
Sep 09 14:35:52.249163 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.249060    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rw4q\" (UniqueName: \"kubernetes.io/projected/67585e41-2de4-49e3-af7c-09e3d4ac620b-kube-api-access-4rw4q\") pod \"67585e41-2de4-49e3-af7c-09e3d4ac620b\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") "
Sep 09 14:35:52.249248 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.249168    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-data\") pod \"67585e41-2de4-49e3-af7c-09e3d4ac620b\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") "
Sep 09 14:35:52.249248 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.249221    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-envoy\") pod \"67585e41-2de4-49e3-af7c-09e3d4ac620b\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") "
Sep 09 14:35:52.249248 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.249245    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-workload-certs\") pod \"67585e41-2de4-49e3-af7c-09e3d4ac620b\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") "
Sep 09 14:35:52.249403 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.249260    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "67585e41-2de4-49e3-af7c-09e3d4ac620b" (UID: "67585e41-2de4-49e3-af7c-09e3d4ac620b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:35:52.249403 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.249290    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-podinfo\") pod \"67585e41-2de4-49e3-af7c-09e3d4ac620b\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") "
Sep 09 14:35:52.249403 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.249309    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-workload-socket\") pod \"67585e41-2de4-49e3-af7c-09e3d4ac620b\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") "
Sep 09 14:35:52.249403 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.249351    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67585e41-2de4-49e3-af7c-09e3d4ac620b-istiod-ca-cert\") pod \"67585e41-2de4-49e3-af7c-09e3d4ac620b\" (UID: \"67585e41-2de4-49e3-af7c-09e3d4ac620b\") "
Sep 09 14:35:52.249670 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.249428    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-data" (OuterVolumeSpecName: "istio-data") pod "67585e41-2de4-49e3-af7c-09e3d4ac620b" (UID: "67585e41-2de4-49e3-af7c-09e3d4ac620b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:35:52.249761 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.249736    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-credential-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:52.249882 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.249764    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-data\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:52.249882 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.249742    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67585e41-2de4-49e3-af7c-09e3d4ac620b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "67585e41-2de4-49e3-af7c-09e3d4ac620b" (UID: "67585e41-2de4-49e3-af7c-09e3d4ac620b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:35:52.249882 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.249806    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "67585e41-2de4-49e3-af7c-09e3d4ac620b" (UID: "67585e41-2de4-49e3-af7c-09e3d4ac620b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:35:52.250066 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.249883    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "67585e41-2de4-49e3-af7c-09e3d4ac620b" (UID: "67585e41-2de4-49e3-af7c-09e3d4ac620b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:35:52.251248 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.251212    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-token" (OuterVolumeSpecName: "istio-token") pod "67585e41-2de4-49e3-af7c-09e3d4ac620b" (UID: "67585e41-2de4-49e3-af7c-09e3d4ac620b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:35:52.251360 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.251244    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "67585e41-2de4-49e3-af7c-09e3d4ac620b" (UID: "67585e41-2de4-49e3-af7c-09e3d4ac620b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:35:52.251360 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.251269    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67585e41-2de4-49e3-af7c-09e3d4ac620b-kube-api-access-4rw4q" (OuterVolumeSpecName: "kube-api-access-4rw4q") pod "67585e41-2de4-49e3-af7c-09e3d4ac620b" (UID: "67585e41-2de4-49e3-af7c-09e3d4ac620b"). InnerVolumeSpecName "kube-api-access-4rw4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:35:52.251452 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.251442    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "67585e41-2de4-49e3-af7c-09e3d4ac620b" (UID: "67585e41-2de4-49e3-af7c-09e3d4ac620b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:35:52.350412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.350384    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-envoy\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:52.350412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.350409    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-workload-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:52.350412 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.350418    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-podinfo\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:52.350821 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.350426    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67585e41-2de4-49e3-af7c-09e3d4ac620b-workload-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:52.350821 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.350434    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67585e41-2de4-49e3-af7c-09e3d4ac620b-istiod-ca-cert\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:52.350821 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.350442    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67585e41-2de4-49e3-af7c-09e3d4ac620b-istio-token\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:52.350821 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.350450    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rw4q\" (UniqueName: \"kubernetes.io/projected/67585e41-2de4-49e3-af7c-09e3d4ac620b-kube-api-access-4rw4q\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:52.754437 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.754407    2553 generic.go:356] "Generic (PLEG): container finished" podID="67585e41-2de4-49e3-af7c-09e3d4ac620b" containerID="b55603eb696cf0727771cf4dd4206b819a6e64c0f4c6c10cae2c7522ac0a60f3" exitCode=0
Sep 09 14:35:52.754650 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.754460    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"
Sep 09 14:35:52.754650 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.754493    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h" event={"ID":"67585e41-2de4-49e3-af7c-09e3d4ac620b","Type":"ContainerDied","Data":"b55603eb696cf0727771cf4dd4206b819a6e64c0f4c6c10cae2c7522ac0a60f3"}
Sep 09 14:35:52.754650 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.754544    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h" event={"ID":"67585e41-2de4-49e3-af7c-09e3d4ac620b","Type":"ContainerDied","Data":"2f7095b86db48471c217cb1c3f0eccbfd1027ae18f27d24eb8d06a9080e25f75"}
Sep 09 14:35:52.754650 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.754585    2553 scope.go:117] "RemoveContainer" containerID="b55603eb696cf0727771cf4dd4206b819a6e64c0f4c6c10cae2c7522ac0a60f3"
Sep 09 14:35:52.765798 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.765780    2553 scope.go:117] "RemoveContainer" containerID="3fadd693811e5d70ba76f0b6983f9fc3c0aefd2ee61a332af0a4a242552c5dde"
Sep 09 14:35:52.773684 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.773667    2553 scope.go:117] "RemoveContainer" containerID="b55603eb696cf0727771cf4dd4206b819a6e64c0f4c6c10cae2c7522ac0a60f3"
Sep 09 14:35:52.773939 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:35:52.773921    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b55603eb696cf0727771cf4dd4206b819a6e64c0f4c6c10cae2c7522ac0a60f3\": container with ID starting with b55603eb696cf0727771cf4dd4206b819a6e64c0f4c6c10cae2c7522ac0a60f3 not found: ID does not exist" containerID="b55603eb696cf0727771cf4dd4206b819a6e64c0f4c6c10cae2c7522ac0a60f3"
Sep 09 14:35:52.773994 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.773947    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b55603eb696cf0727771cf4dd4206b819a6e64c0f4c6c10cae2c7522ac0a60f3"} err="failed to get container status \"b55603eb696cf0727771cf4dd4206b819a6e64c0f4c6c10cae2c7522ac0a60f3\": rpc error: code = NotFound desc = could not find container \"b55603eb696cf0727771cf4dd4206b819a6e64c0f4c6c10cae2c7522ac0a60f3\": container with ID starting with b55603eb696cf0727771cf4dd4206b819a6e64c0f4c6c10cae2c7522ac0a60f3 not found: ID does not exist"
Sep 09 14:35:52.773994 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.773964    2553 scope.go:117] "RemoveContainer" containerID="3fadd693811e5d70ba76f0b6983f9fc3c0aefd2ee61a332af0a4a242552c5dde"
Sep 09 14:35:52.774198 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:35:52.774179    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fadd693811e5d70ba76f0b6983f9fc3c0aefd2ee61a332af0a4a242552c5dde\": container with ID starting with 3fadd693811e5d70ba76f0b6983f9fc3c0aefd2ee61a332af0a4a242552c5dde not found: ID does not exist" containerID="3fadd693811e5d70ba76f0b6983f9fc3c0aefd2ee61a332af0a4a242552c5dde"
Sep 09 14:35:52.774254 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.774208    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fadd693811e5d70ba76f0b6983f9fc3c0aefd2ee61a332af0a4a242552c5dde"} err="failed to get container status \"3fadd693811e5d70ba76f0b6983f9fc3c0aefd2ee61a332af0a4a242552c5dde\": rpc error: code = NotFound desc = could not find container \"3fadd693811e5d70ba76f0b6983f9fc3c0aefd2ee61a332af0a4a242552c5dde\": container with ID starting with 3fadd693811e5d70ba76f0b6983f9fc3c0aefd2ee61a332af0a4a242552c5dde not found: ID does not exist"
Sep 09 14:35:52.779924 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.779900    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"]
Sep 09 14:35:52.783459 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:52.783434    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-a959bc-openshift-default-69f4dccc5b-rnh7h"]
Sep 09 14:35:53.647267 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:53.647237    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67585e41-2de4-49e3-af7c-09e3d4ac620b" path="/var/lib/kubelet/pods/67585e41-2de4-49e3-af7c-09e3d4ac620b/volumes"
Sep 09 14:35:54.739214 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:54.739179    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd" podUID="63ca9cde-cbb8-46d2-87b1-288025ef0922" containerName="main" containerID="cri-o://4c095c168e2f00feebbe02012199164b408717ea5163deb5f72750adc79eb2ec" gracePeriod=45
Sep 09 14:35:54.980409 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:54.980384    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:35:55.075215 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.075128    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqv8r\" (UniqueName: \"kubernetes.io/projected/63ca9cde-cbb8-46d2-87b1-288025ef0922-kube-api-access-xqv8r\") pod \"63ca9cde-cbb8-46d2-87b1-288025ef0922\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") "
Sep 09 14:35:55.075215 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.075189    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-model-cache\") pod \"63ca9cde-cbb8-46d2-87b1-288025ef0922\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") "
Sep 09 14:35:55.075215 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.075212    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63ca9cde-cbb8-46d2-87b1-288025ef0922-tls-certs\") pod \"63ca9cde-cbb8-46d2-87b1-288025ef0922\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") "
Sep 09 14:35:55.075492 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.075241    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-dshm\") pod \"63ca9cde-cbb8-46d2-87b1-288025ef0922\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") "
Sep 09 14:35:55.075492 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.075261    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-home\") pod \"63ca9cde-cbb8-46d2-87b1-288025ef0922\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") "
Sep 09 14:35:55.075492 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.075348    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-tmp-dir\") pod \"63ca9cde-cbb8-46d2-87b1-288025ef0922\" (UID: \"63ca9cde-cbb8-46d2-87b1-288025ef0922\") "
Sep 09 14:35:55.075701 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.075539    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-model-cache" (OuterVolumeSpecName: "model-cache") pod "63ca9cde-cbb8-46d2-87b1-288025ef0922" (UID: "63ca9cde-cbb8-46d2-87b1-288025ef0922"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:35:55.075701 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.075609    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-home" (OuterVolumeSpecName: "home") pod "63ca9cde-cbb8-46d2-87b1-288025ef0922" (UID: "63ca9cde-cbb8-46d2-87b1-288025ef0922"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:35:55.075701 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.075679    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "63ca9cde-cbb8-46d2-87b1-288025ef0922" (UID: "63ca9cde-cbb8-46d2-87b1-288025ef0922"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:35:55.077269 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.077249    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63ca9cde-cbb8-46d2-87b1-288025ef0922-kube-api-access-xqv8r" (OuterVolumeSpecName: "kube-api-access-xqv8r") pod "63ca9cde-cbb8-46d2-87b1-288025ef0922" (UID: "63ca9cde-cbb8-46d2-87b1-288025ef0922"). InnerVolumeSpecName "kube-api-access-xqv8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:35:55.077796 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.077774    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-dshm" (OuterVolumeSpecName: "dshm") pod "63ca9cde-cbb8-46d2-87b1-288025ef0922" (UID: "63ca9cde-cbb8-46d2-87b1-288025ef0922"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:35:55.077876 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.077775    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63ca9cde-cbb8-46d2-87b1-288025ef0922-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "63ca9cde-cbb8-46d2-87b1-288025ef0922" (UID: "63ca9cde-cbb8-46d2-87b1-288025ef0922"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:35:55.176365 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.176332    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-model-cache\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:55.176365 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.176359    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63ca9cde-cbb8-46d2-87b1-288025ef0922-tls-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:55.176365 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.176368    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-dshm\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:55.176365 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.176375    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-home\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:55.176648 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.176383    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63ca9cde-cbb8-46d2-87b1-288025ef0922-tmp-dir\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:55.176648 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.176391    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqv8r\" (UniqueName: \"kubernetes.io/projected/63ca9cde-cbb8-46d2-87b1-288025ef0922-kube-api-access-xqv8r\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:35:55.771993 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.771955    2553 generic.go:356] "Generic (PLEG): container finished" podID="63ca9cde-cbb8-46d2-87b1-288025ef0922" containerID="4c095c168e2f00feebbe02012199164b408717ea5163deb5f72750adc79eb2ec" exitCode=0
Sep 09 14:35:55.772413 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.772000    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd" event={"ID":"63ca9cde-cbb8-46d2-87b1-288025ef0922","Type":"ContainerDied","Data":"4c095c168e2f00feebbe02012199164b408717ea5163deb5f72750adc79eb2ec"}
Sep 09 14:35:55.772413 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.772024    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"
Sep 09 14:35:55.772413 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.772038    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd" event={"ID":"63ca9cde-cbb8-46d2-87b1-288025ef0922","Type":"ContainerDied","Data":"63820179c11916b28c1a909ccb0cb7ed3210029eccb694a96eb0fd4a9601fcaa"}
Sep 09 14:35:55.772413 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.772059    2553 scope.go:117] "RemoveContainer" containerID="4c095c168e2f00feebbe02012199164b408717ea5163deb5f72750adc79eb2ec"
Sep 09 14:35:55.780720 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.780661    2553 scope.go:117] "RemoveContainer" containerID="4c095c168e2f00feebbe02012199164b408717ea5163deb5f72750adc79eb2ec"
Sep 09 14:35:55.780952 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:35:55.780931    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c095c168e2f00feebbe02012199164b408717ea5163deb5f72750adc79eb2ec\": container with ID starting with 4c095c168e2f00feebbe02012199164b408717ea5163deb5f72750adc79eb2ec not found: ID does not exist" containerID="4c095c168e2f00feebbe02012199164b408717ea5163deb5f72750adc79eb2ec"
Sep 09 14:35:55.781020 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.780960    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c095c168e2f00feebbe02012199164b408717ea5163deb5f72750adc79eb2ec"} err="failed to get container status \"4c095c168e2f00feebbe02012199164b408717ea5163deb5f72750adc79eb2ec\": rpc error: code = NotFound desc = could not find container \"4c095c168e2f00feebbe02012199164b408717ea5163deb5f72750adc79eb2ec\": container with ID starting with 4c095c168e2f00feebbe02012199164b408717ea5163deb5f72750adc79eb2ec not found: ID does not exist"
Sep 09 14:35:55.795062 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.795034    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"]
Sep 09 14:35:55.809212 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:55.809171    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/sub-test-model-c5e2d3-kserve-759c8f944c-rj5wd"]
Sep 09 14:35:57.647244 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:57.647207    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63ca9cde-cbb8-46d2-87b1-288025ef0922" path="/var/lib/kubelet/pods/63ca9cde-cbb8-46d2-87b1-288025ef0922/volumes"
Sep 09 14:35:57.653180 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:57.653149    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-cbb7fb-29816070-nr97d"]
Sep 09 14:35:57.655168 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:57.655148    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-cbb7fb-29816070-nr97d"]
Sep 09 14:35:59.645977 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:35:59.645942    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4267fe47-b6e6-4acd-9378-e61f44a0d40d" path="/var/lib/kubelet/pods/4267fe47-b6e6-4acd-9378-e61f44a0d40d/volumes"
Sep 09 14:36:04.418376 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:04.418342    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"]
Sep 09 14:36:04.418862 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:04.418585    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn" podUID="b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" containerName="istio-proxy" containerID="cri-o://c16d6913ce0c323c1415bff6c4f4a72d58556e208a0f27ca67df3fbcb8dd83d2" gracePeriod=30
Sep 09 14:36:07.593711 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:07.593676    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:36:09.669805 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.669779    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:36:09.704696 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.704672    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-envoy\") pod \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") "
Sep 09 14:36:09.704834 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.704779    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-podinfo\") pod \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") "
Sep 09 14:36:09.704834 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.704808    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-data\") pod \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") "
Sep 09 14:36:09.704834 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.704823    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-token\") pod \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") "
Sep 09 14:36:09.704996 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.704840    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-workload-socket\") pod \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") "
Sep 09 14:36:09.704996 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.704921    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istiod-ca-cert\") pod \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") "
Sep 09 14:36:09.705100 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.704994    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-credential-socket\") pod \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") "
Sep 09 14:36:09.705100 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.705037    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-workload-certs\") pod \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") "
Sep 09 14:36:09.705100 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.705064    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctx8f\" (UniqueName: \"kubernetes.io/projected/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-kube-api-access-ctx8f\") pod \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\" (UID: \"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3\") "
Sep 09 14:36:09.705279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.705109    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" (UID: "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:36:09.705279 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.705137    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-data" (OuterVolumeSpecName: "istio-data") pod "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" (UID: "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:36:09.705382 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.705329    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" (UID: "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:36:09.705484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.705462    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-data\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:09.705693 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.705676    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-workload-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:09.705804 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.705791    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-workload-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:09.705920 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.705291    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" (UID: "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:36:09.705920 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.705787    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" (UID: "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:36:09.707207 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.707182    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" (UID: "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:36:09.707480 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.707454    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-kube-api-access-ctx8f" (OuterVolumeSpecName: "kube-api-access-ctx8f") pod "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" (UID: "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3"). InnerVolumeSpecName "kube-api-access-ctx8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:36:09.707583 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.707494    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" (UID: "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:36:09.707583 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.707513    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-token" (OuterVolumeSpecName: "istio-token") pod "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" (UID: "b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:36:09.806590 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.806554    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-credential-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:09.806590 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.806591    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctx8f\" (UniqueName: \"kubernetes.io/projected/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-kube-api-access-ctx8f\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:09.806722 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.806603    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-envoy\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:09.806722 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.806612    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-podinfo\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:09.806722 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.806619    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istio-token\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:09.806722 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.806627    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3-istiod-ca-cert\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:09.847033 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.847011    2553 generic.go:356] "Generic (PLEG): container finished" podID="b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" containerID="c16d6913ce0c323c1415bff6c4f4a72d58556e208a0f27ca67df3fbcb8dd83d2" exitCode=0
Sep 09 14:36:09.847116 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.847057    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"
Sep 09 14:36:09.847116 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.847073    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn" event={"ID":"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3","Type":"ContainerDied","Data":"c16d6913ce0c323c1415bff6c4f4a72d58556e208a0f27ca67df3fbcb8dd83d2"}
Sep 09 14:36:09.847208 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.847120    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn" event={"ID":"b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3","Type":"ContainerDied","Data":"45da79af26f6cc8e52e9c2817ac3d9455b54f745728f31cfc2752abb9c38d1f5"}
Sep 09 14:36:09.847208 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.847143    2553 scope.go:117] "RemoveContainer" containerID="c16d6913ce0c323c1415bff6c4f4a72d58556e208a0f27ca67df3fbcb8dd83d2"
Sep 09 14:36:09.856068 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.856053    2553 scope.go:117] "RemoveContainer" containerID="b0b901b4ad724b342ec3fe353614eb276d6f4a27db92d11fb54aa96cf0f3075e"
Sep 09 14:36:09.863769 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.863754    2553 scope.go:117] "RemoveContainer" containerID="c16d6913ce0c323c1415bff6c4f4a72d58556e208a0f27ca67df3fbcb8dd83d2"
Sep 09 14:36:09.864023 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:36:09.864004    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c16d6913ce0c323c1415bff6c4f4a72d58556e208a0f27ca67df3fbcb8dd83d2\": container with ID starting with c16d6913ce0c323c1415bff6c4f4a72d58556e208a0f27ca67df3fbcb8dd83d2 not found: ID does not exist" containerID="c16d6913ce0c323c1415bff6c4f4a72d58556e208a0f27ca67df3fbcb8dd83d2"
Sep 09 14:36:09.864096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.864034    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c16d6913ce0c323c1415bff6c4f4a72d58556e208a0f27ca67df3fbcb8dd83d2"} err="failed to get container status \"c16d6913ce0c323c1415bff6c4f4a72d58556e208a0f27ca67df3fbcb8dd83d2\": rpc error: code = NotFound desc = could not find container \"c16d6913ce0c323c1415bff6c4f4a72d58556e208a0f27ca67df3fbcb8dd83d2\": container with ID starting with c16d6913ce0c323c1415bff6c4f4a72d58556e208a0f27ca67df3fbcb8dd83d2 not found: ID does not exist"
Sep 09 14:36:09.864096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.864057    2553 scope.go:117] "RemoveContainer" containerID="b0b901b4ad724b342ec3fe353614eb276d6f4a27db92d11fb54aa96cf0f3075e"
Sep 09 14:36:09.864309 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:36:09.864284    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0b901b4ad724b342ec3fe353614eb276d6f4a27db92d11fb54aa96cf0f3075e\": container with ID starting with b0b901b4ad724b342ec3fe353614eb276d6f4a27db92d11fb54aa96cf0f3075e not found: ID does not exist" containerID="b0b901b4ad724b342ec3fe353614eb276d6f4a27db92d11fb54aa96cf0f3075e"
Sep 09 14:36:09.864361 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.864307    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0b901b4ad724b342ec3fe353614eb276d6f4a27db92d11fb54aa96cf0f3075e"} err="failed to get container status \"b0b901b4ad724b342ec3fe353614eb276d6f4a27db92d11fb54aa96cf0f3075e\": rpc error: code = NotFound desc = could not find container \"b0b901b4ad724b342ec3fe353614eb276d6f4a27db92d11fb54aa96cf0f3075e\": container with ID starting with b0b901b4ad724b342ec3fe353614eb276d6f4a27db92d11fb54aa96cf0f3075e not found: ID does not exist"
Sep 09 14:36:09.868425 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.868404    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"]
Sep 09 14:36:09.872063 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:09.872043    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-cbb7fb-openshift-default-58997646f4-8t8vn"]
Sep 09 14:36:10.690739 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.690708    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"]
Sep 09 14:36:10.691107 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691034    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67585e41-2de4-49e3-af7c-09e3d4ac620b" containerName="istio-proxy"
Sep 09 14:36:10.691107 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691046    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="67585e41-2de4-49e3-af7c-09e3d4ac620b" containerName="istio-proxy"
Sep 09 14:36:10.691107 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691059    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67585e41-2de4-49e3-af7c-09e3d4ac620b" containerName="istio-proxy"
Sep 09 14:36:10.691107 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691068    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="67585e41-2de4-49e3-af7c-09e3d4ac620b" containerName="istio-proxy"
Sep 09 14:36:10.691107 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691081    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="837de529-20ce-407b-88c1-86de19399f1d" containerName="maas-api"
Sep 09 14:36:10.691107 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691088    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="837de529-20ce-407b-88c1-86de19399f1d" containerName="maas-api"
Sep 09 14:36:10.691107 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691095    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" containerName="istio-proxy"
Sep 09 14:36:10.691107 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691101    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" containerName="istio-proxy"
Sep 09 14:36:10.691107 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691106    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ca9cde-cbb8-46d2-87b1-288025ef0922" containerName="main"
Sep 09 14:36:10.691107 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691112    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ca9cde-cbb8-46d2-87b1-288025ef0922" containerName="main"
Sep 09 14:36:10.691537 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691121    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" containerName="istio-proxy"
Sep 09 14:36:10.691537 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691126    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" containerName="istio-proxy"
Sep 09 14:36:10.691537 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691187    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="837de529-20ce-407b-88c1-86de19399f1d" containerName="maas-api"
Sep 09 14:36:10.691537 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691196    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="67585e41-2de4-49e3-af7c-09e3d4ac620b" containerName="istio-proxy"
Sep 09 14:36:10.691537 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691204    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" containerName="istio-proxy"
Sep 09 14:36:10.691537 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691209    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" containerName="istio-proxy"
Sep 09 14:36:10.691537 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.691215    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="63ca9cde-cbb8-46d2-87b1-288025ef0922" containerName="main"
Sep 09 14:36:10.695740 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.695720    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.698859 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.698831    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-c5e2d3\"/\"rate-test-model-c5e2d3-kserve-self-signed-certs\""
Sep 09 14:36:10.698970 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.698877    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-c5e2d3\"/\"kube-root-ca.crt\""
Sep 09 14:36:10.698970 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.698926    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-c5e2d3\"/\"openshift-service-ca.crt\""
Sep 09 14:36:10.698970 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.698949    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-c5e2d3\"/\"default-dockercfg-6dpwd\""
Sep 09 14:36:10.705005 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.704983    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"]
Sep 09 14:36:10.713715 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.713689    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-dshm\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.713807 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.713729    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-model-cache\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.713807 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.713760    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e63b603-5455-4d6a-88f5-7b8a4a746a19-tls-certs\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.713884 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.713848    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-home\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.713917 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.713903    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-tmp-dir\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.713965 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.713950    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99kg5\" (UniqueName: \"kubernetes.io/projected/0e63b603-5455-4d6a-88f5-7b8a4a746a19-kube-api-access-99kg5\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.815239 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.815211    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-dshm\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.815239 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.815241    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-model-cache\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.815443 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.815261    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e63b603-5455-4d6a-88f5-7b8a4a746a19-tls-certs\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.815443 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.815286    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-home\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.815443 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.815306    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-tmp-dir\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.815443 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.815342    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99kg5\" (UniqueName: \"kubernetes.io/projected/0e63b603-5455-4d6a-88f5-7b8a4a746a19-kube-api-access-99kg5\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.815692 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.815671    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-model-cache\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.815783 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.815759    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-home\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.815849 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.815790    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-tmp-dir\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.817651 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.817624    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-dshm\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.817833 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.817814    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e63b603-5455-4d6a-88f5-7b8a4a746a19-tls-certs\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:10.823480 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:10.823460    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99kg5\" (UniqueName: \"kubernetes.io/projected/0e63b603-5455-4d6a-88f5-7b8a4a746a19-kube-api-access-99kg5\") pod \"rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") " pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:11.005424 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:11.005390    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:11.277472 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:11.277442    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"]
Sep 09 14:36:11.279310 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:36:11.279281    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e63b603_5455_4d6a_88f5_7b8a4a746a19.slice/crio-ddb13190987853870e1ac9cf92ae85607cf73f2963d27a6cc16d3cc0434896df WatchSource:0}: Error finding container ddb13190987853870e1ac9cf92ae85607cf73f2963d27a6cc16d3cc0434896df: Status 404 returned error can't find the container with id ddb13190987853870e1ac9cf92ae85607cf73f2963d27a6cc16d3cc0434896df
Sep 09 14:36:11.646343 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:11.646262    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3" path="/var/lib/kubelet/pods/b4b1adf6-7f98-4e1c-a4cd-ee9a58cf30e3/volumes"
Sep 09 14:36:11.859464 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:11.859428    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb" event={"ID":"0e63b603-5455-4d6a-88f5-7b8a4a746a19","Type":"ContainerStarted","Data":"06e6416b420b0ca1324fa8c788e4a6f003f5dc1f7857c6d91bcae2d518c859e8"}
Sep 09 14:36:11.859464 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:11.859469    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb" event={"ID":"0e63b603-5455-4d6a-88f5-7b8a4a746a19","Type":"ContainerStarted","Data":"ddb13190987853870e1ac9cf92ae85607cf73f2963d27a6cc16d3cc0434896df"}
Sep 09 14:36:11.877389 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:11.877340    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb" podStartSLOduration=1.8773241600000001 podStartE2EDuration="1.87732416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:36:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:36:11.875657367 +0000 UTC m=+1522.679640371" watchObservedRunningTime="2026-09-09 14:36:11.87732416 +0000 UTC m=+1522.681307162"
Sep 09 14:36:15.449548 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:15.449450    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-fecaf9-29816070-qg6tj"]
Sep 09 14:36:15.451856 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:15.451828    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-fecaf9-29816070-qg6tj"]
Sep 09 14:36:15.646556 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:15.646525    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfa6c3ac-b16f-4d5f-8439-e0b3d12ebf7b" path="/var/lib/kubelet/pods/cfa6c3ac-b16f-4d5f-8439-e0b3d12ebf7b/volumes"
Sep 09 14:36:21.006513 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:21.006482    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:21.006513 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:21.006523    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:21.019255 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:21.019231    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:21.700819 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:21.700784    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:36:21.921059 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:21.921031    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:36:22.432408 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:22.432335    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"]
Sep 09 14:36:22.432901 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:22.432556    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r" podUID="5649edb4-ea1f-436a-b822-aed83d685a29" containerName="istio-proxy" containerID="cri-o://9835adaf8035420ab815e2ac064df0befec97594a8054126d53ce21c4adb6387" gracePeriod=30
Sep 09 14:36:27.678524 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.678493    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:36:27.756052 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.755989    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5649edb4-ea1f-436a-b822-aed83d685a29-istio-podinfo\") pod \"5649edb4-ea1f-436a-b822-aed83d685a29\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") "
Sep 09 14:36:27.756052 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.756037    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-workload-certs\") pod \"5649edb4-ea1f-436a-b822-aed83d685a29\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") "
Sep 09 14:36:27.756225 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.756063    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-istio-envoy\") pod \"5649edb4-ea1f-436a-b822-aed83d685a29\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") "
Sep 09 14:36:27.756225 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.756092    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdqnd\" (UniqueName: \"kubernetes.io/projected/5649edb4-ea1f-436a-b822-aed83d685a29-kube-api-access-qdqnd\") pod \"5649edb4-ea1f-436a-b822-aed83d685a29\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") "
Sep 09 14:36:27.756225 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.756123    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5649edb4-ea1f-436a-b822-aed83d685a29-istio-token\") pod \"5649edb4-ea1f-436a-b822-aed83d685a29\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") "
Sep 09 14:36:27.756225 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.756164    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-credential-socket\") pod \"5649edb4-ea1f-436a-b822-aed83d685a29\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") "
Sep 09 14:36:27.756225 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.756199    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5649edb4-ea1f-436a-b822-aed83d685a29-istiod-ca-cert\") pod \"5649edb4-ea1f-436a-b822-aed83d685a29\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") "
Sep 09 14:36:27.756484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.756238    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-workload-socket\") pod \"5649edb4-ea1f-436a-b822-aed83d685a29\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") "
Sep 09 14:36:27.756484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.756267    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-istio-data\") pod \"5649edb4-ea1f-436a-b822-aed83d685a29\" (UID: \"5649edb4-ea1f-436a-b822-aed83d685a29\") "
Sep 09 14:36:27.756626 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.756258    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5649edb4-ea1f-436a-b822-aed83d685a29" (UID: "5649edb4-ea1f-436a-b822-aed83d685a29"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:36:27.756693 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.756639    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5649edb4-ea1f-436a-b822-aed83d685a29" (UID: "5649edb4-ea1f-436a-b822-aed83d685a29"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:36:27.756693 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.756669    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5649edb4-ea1f-436a-b822-aed83d685a29-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5649edb4-ea1f-436a-b822-aed83d685a29" (UID: "5649edb4-ea1f-436a-b822-aed83d685a29"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:36:27.756801 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.756708    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5649edb4-ea1f-436a-b822-aed83d685a29" (UID: "5649edb4-ea1f-436a-b822-aed83d685a29"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:36:27.756858 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.756799    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-istio-data" (OuterVolumeSpecName: "istio-data") pod "5649edb4-ea1f-436a-b822-aed83d685a29" (UID: "5649edb4-ea1f-436a-b822-aed83d685a29"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:36:27.758274 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.758245    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5649edb4-ea1f-436a-b822-aed83d685a29-kube-api-access-qdqnd" (OuterVolumeSpecName: "kube-api-access-qdqnd") pod "5649edb4-ea1f-436a-b822-aed83d685a29" (UID: "5649edb4-ea1f-436a-b822-aed83d685a29"). InnerVolumeSpecName "kube-api-access-qdqnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:36:27.758378 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.758271    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5649edb4-ea1f-436a-b822-aed83d685a29-istio-token" (OuterVolumeSpecName: "istio-token") pod "5649edb4-ea1f-436a-b822-aed83d685a29" (UID: "5649edb4-ea1f-436a-b822-aed83d685a29"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:36:27.758378 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.758336    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5649edb4-ea1f-436a-b822-aed83d685a29" (UID: "5649edb4-ea1f-436a-b822-aed83d685a29"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:36:27.758378 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.758342    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5649edb4-ea1f-436a-b822-aed83d685a29-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5649edb4-ea1f-436a-b822-aed83d685a29" (UID: "5649edb4-ea1f-436a-b822-aed83d685a29"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:36:27.857018 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.856994    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-workload-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:27.857018 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.857015    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-istio-envoy\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:27.857146 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.857024    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdqnd\" (UniqueName: \"kubernetes.io/projected/5649edb4-ea1f-436a-b822-aed83d685a29-kube-api-access-qdqnd\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:27.857146 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.857032    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5649edb4-ea1f-436a-b822-aed83d685a29-istio-token\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:27.857146 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.857042    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-credential-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:27.857146 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.857050    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5649edb4-ea1f-436a-b822-aed83d685a29-istiod-ca-cert\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:27.857146 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.857058    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-workload-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:27.857146 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.857065    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5649edb4-ea1f-436a-b822-aed83d685a29-istio-data\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:27.857146 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.857073    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5649edb4-ea1f-436a-b822-aed83d685a29-istio-podinfo\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:36:27.941875 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.941844    2553 generic.go:356] "Generic (PLEG): container finished" podID="5649edb4-ea1f-436a-b822-aed83d685a29" containerID="9835adaf8035420ab815e2ac064df0befec97594a8054126d53ce21c4adb6387" exitCode=0
Sep 09 14:36:27.941998 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.941892    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"
Sep 09 14:36:27.941998 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.941934    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r" event={"ID":"5649edb4-ea1f-436a-b822-aed83d685a29","Type":"ContainerDied","Data":"9835adaf8035420ab815e2ac064df0befec97594a8054126d53ce21c4adb6387"}
Sep 09 14:36:27.941998 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.941986    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r" event={"ID":"5649edb4-ea1f-436a-b822-aed83d685a29","Type":"ContainerDied","Data":"6eef226ed501cb49d9e3dba3e19f09686a1a5e0e82939e80ae8ff4bfc8c28c9c"}
Sep 09 14:36:27.942125 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.942009    2553 scope.go:117] "RemoveContainer" containerID="9835adaf8035420ab815e2ac064df0befec97594a8054126d53ce21c4adb6387"
Sep 09 14:36:27.950601 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.950581    2553 scope.go:117] "RemoveContainer" containerID="3c17760ab4707389025ce4552cb808bbe96a6e3f8e52a4d2160759cef787b929"
Sep 09 14:36:27.958813 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.958795    2553 scope.go:117] "RemoveContainer" containerID="9835adaf8035420ab815e2ac064df0befec97594a8054126d53ce21c4adb6387"
Sep 09 14:36:27.959066 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:36:27.959046    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9835adaf8035420ab815e2ac064df0befec97594a8054126d53ce21c4adb6387\": container with ID starting with 9835adaf8035420ab815e2ac064df0befec97594a8054126d53ce21c4adb6387 not found: ID does not exist" containerID="9835adaf8035420ab815e2ac064df0befec97594a8054126d53ce21c4adb6387"
Sep 09 14:36:27.959145 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.959078    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9835adaf8035420ab815e2ac064df0befec97594a8054126d53ce21c4adb6387"} err="failed to get container status \"9835adaf8035420ab815e2ac064df0befec97594a8054126d53ce21c4adb6387\": rpc error: code = NotFound desc = could not find container \"9835adaf8035420ab815e2ac064df0befec97594a8054126d53ce21c4adb6387\": container with ID starting with 9835adaf8035420ab815e2ac064df0befec97594a8054126d53ce21c4adb6387 not found: ID does not exist"
Sep 09 14:36:27.959145 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.959102    2553 scope.go:117] "RemoveContainer" containerID="3c17760ab4707389025ce4552cb808bbe96a6e3f8e52a4d2160759cef787b929"
Sep 09 14:36:27.959361 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:36:27.959343    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c17760ab4707389025ce4552cb808bbe96a6e3f8e52a4d2160759cef787b929\": container with ID starting with 3c17760ab4707389025ce4552cb808bbe96a6e3f8e52a4d2160759cef787b929 not found: ID does not exist" containerID="3c17760ab4707389025ce4552cb808bbe96a6e3f8e52a4d2160759cef787b929"
Sep 09 14:36:27.959405 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.959366    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c17760ab4707389025ce4552cb808bbe96a6e3f8e52a4d2160759cef787b929"} err="failed to get container status \"3c17760ab4707389025ce4552cb808bbe96a6e3f8e52a4d2160759cef787b929\": rpc error: code = NotFound desc = could not find container \"3c17760ab4707389025ce4552cb808bbe96a6e3f8e52a4d2160759cef787b929\": container with ID starting with 3c17760ab4707389025ce4552cb808bbe96a6e3f8e52a4d2160759cef787b929 not found: ID does not exist"
Sep 09 14:36:27.963668 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.963647    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"]
Sep 09 14:36:27.967326 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:27.967307    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-fecaf9-openshift-default-69d7cd5fd4-njq4r"]
Sep 09 14:36:29.651763 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:29.651729    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5649edb4-ea1f-436a-b822-aed83d685a29" path="/var/lib/kubelet/pods/5649edb4-ea1f-436a-b822-aed83d685a29/volumes"
Sep 09 14:36:33.196011 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:33.195972    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:36:43.204464 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:43.204425    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:36:49.513243 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:49.513205    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"]
Sep 09 14:36:49.819856 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:49.819772    2553 scope.go:117] "RemoveContainer" containerID="1905c855d7e82e05de00b3a7acd096c44d244088baff1f2f9cf40c6df5989a01"
Sep 09 14:36:49.827734 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:49.827715    2553 scope.go:117] "RemoveContainer" containerID="9c4656fa94e9a09b4e50d7a527dbe995ef4337bf0c0fbc93c504db7ba877b9c0"
Sep 09 14:36:58.294752 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:36:58.294717    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:37:04.532509 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.532447    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb" podUID="0e63b603-5455-4d6a-88f5-7b8a4a746a19" containerName="main" containerID="cri-o://06e6416b420b0ca1324fa8c788e4a6f003f5dc1f7857c6d91bcae2d518c859e8" gracePeriod=45
Sep 09 14:37:04.773025 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.772995    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:37:04.872664 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.872587    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e63b603-5455-4d6a-88f5-7b8a4a746a19-tls-certs\") pod \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") "
Sep 09 14:37:04.872664 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.872628    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-tmp-dir\") pod \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") "
Sep 09 14:37:04.872884 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.872679    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-dshm\") pod \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") "
Sep 09 14:37:04.872884 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.872703    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-model-cache\") pod \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") "
Sep 09 14:37:04.872884 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.872734    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-home\") pod \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") "
Sep 09 14:37:04.872884 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.872779    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99kg5\" (UniqueName: \"kubernetes.io/projected/0e63b603-5455-4d6a-88f5-7b8a4a746a19-kube-api-access-99kg5\") pod \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\" (UID: \"0e63b603-5455-4d6a-88f5-7b8a4a746a19\") "
Sep 09 14:37:04.873085 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.872940    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0e63b603-5455-4d6a-88f5-7b8a4a746a19" (UID: "0e63b603-5455-4d6a-88f5-7b8a4a746a19"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:37:04.873085 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.872981    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-model-cache" (OuterVolumeSpecName: "model-cache") pod "0e63b603-5455-4d6a-88f5-7b8a4a746a19" (UID: "0e63b603-5455-4d6a-88f5-7b8a4a746a19"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:37:04.873085 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.873056    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-home" (OuterVolumeSpecName: "home") pod "0e63b603-5455-4d6a-88f5-7b8a4a746a19" (UID: "0e63b603-5455-4d6a-88f5-7b8a4a746a19"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:37:04.873200 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.873103    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-model-cache\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:37:04.873200 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.873121    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-tmp-dir\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:37:04.874789 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.874767    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e63b603-5455-4d6a-88f5-7b8a4a746a19-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0e63b603-5455-4d6a-88f5-7b8a4a746a19" (UID: "0e63b603-5455-4d6a-88f5-7b8a4a746a19"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:37:04.874879 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.874792    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-dshm" (OuterVolumeSpecName: "dshm") pod "0e63b603-5455-4d6a-88f5-7b8a4a746a19" (UID: "0e63b603-5455-4d6a-88f5-7b8a4a746a19"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:37:04.874879 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.874826    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e63b603-5455-4d6a-88f5-7b8a4a746a19-kube-api-access-99kg5" (OuterVolumeSpecName: "kube-api-access-99kg5") pod "0e63b603-5455-4d6a-88f5-7b8a4a746a19" (UID: "0e63b603-5455-4d6a-88f5-7b8a4a746a19"). InnerVolumeSpecName "kube-api-access-99kg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:37:04.974093 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.974061    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-dshm\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:37:04.974093 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.974086    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e63b603-5455-4d6a-88f5-7b8a4a746a19-home\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:37:04.974093 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.974096    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99kg5\" (UniqueName: \"kubernetes.io/projected/0e63b603-5455-4d6a-88f5-7b8a4a746a19-kube-api-access-99kg5\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:37:04.974312 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:04.974106    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e63b603-5455-4d6a-88f5-7b8a4a746a19-tls-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:37:05.127781 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:05.127698    2553 generic.go:356] "Generic (PLEG): container finished" podID="0e63b603-5455-4d6a-88f5-7b8a4a746a19" containerID="06e6416b420b0ca1324fa8c788e4a6f003f5dc1f7857c6d91bcae2d518c859e8" exitCode=0
Sep 09 14:37:05.127781 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:05.127746    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"
Sep 09 14:37:05.127957 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:05.127771    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb" event={"ID":"0e63b603-5455-4d6a-88f5-7b8a4a746a19","Type":"ContainerDied","Data":"06e6416b420b0ca1324fa8c788e4a6f003f5dc1f7857c6d91bcae2d518c859e8"}
Sep 09 14:37:05.127957 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:05.127818    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb" event={"ID":"0e63b603-5455-4d6a-88f5-7b8a4a746a19","Type":"ContainerDied","Data":"ddb13190987853870e1ac9cf92ae85607cf73f2963d27a6cc16d3cc0434896df"}
Sep 09 14:37:05.127957 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:05.127836    2553 scope.go:117] "RemoveContainer" containerID="06e6416b420b0ca1324fa8c788e4a6f003f5dc1f7857c6d91bcae2d518c859e8"
Sep 09 14:37:05.136474 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:05.136457    2553 scope.go:117] "RemoveContainer" containerID="06e6416b420b0ca1324fa8c788e4a6f003f5dc1f7857c6d91bcae2d518c859e8"
Sep 09 14:37:05.136747 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:37:05.136728    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06e6416b420b0ca1324fa8c788e4a6f003f5dc1f7857c6d91bcae2d518c859e8\": container with ID starting with 06e6416b420b0ca1324fa8c788e4a6f003f5dc1f7857c6d91bcae2d518c859e8 not found: ID does not exist" containerID="06e6416b420b0ca1324fa8c788e4a6f003f5dc1f7857c6d91bcae2d518c859e8"
Sep 09 14:37:05.136825 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:05.136754    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06e6416b420b0ca1324fa8c788e4a6f003f5dc1f7857c6d91bcae2d518c859e8"} err="failed to get container status \"06e6416b420b0ca1324fa8c788e4a6f003f5dc1f7857c6d91bcae2d518c859e8\": rpc error: code = NotFound desc = could not find container \"06e6416b420b0ca1324fa8c788e4a6f003f5dc1f7857c6d91bcae2d518c859e8\": container with ID starting with 06e6416b420b0ca1324fa8c788e4a6f003f5dc1f7857c6d91bcae2d518c859e8 not found: ID does not exist"
Sep 09 14:37:05.148195 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:05.148175    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"]
Sep 09 14:37:05.152177 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:05.152152    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-c5e2d3/rate-test-model-c5e2d3-kserve-bbdfbbb4c-5msfb"]
Sep 09 14:37:05.645899 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:05.645869    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e63b603-5455-4d6a-88f5-7b8a4a746a19" path="/var/lib/kubelet/pods/0e63b603-5455-4d6a-88f5-7b8a4a746a19/volumes"
Sep 09 14:37:19.316169 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.316135    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"]
Sep 09 14:37:19.316634 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.316617    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5649edb4-ea1f-436a-b822-aed83d685a29" containerName="istio-proxy"
Sep 09 14:37:19.316719 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.316637    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5649edb4-ea1f-436a-b822-aed83d685a29" containerName="istio-proxy"
Sep 09 14:37:19.316719 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.316669    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e63b603-5455-4d6a-88f5-7b8a4a746a19" containerName="main"
Sep 09 14:37:19.316719 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.316678    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e63b603-5455-4d6a-88f5-7b8a4a746a19" containerName="main"
Sep 09 14:37:19.316835 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.316759    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="67585e41-2de4-49e3-af7c-09e3d4ac620b" containerName="istio-proxy"
Sep 09 14:37:19.316835 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.316775    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e63b603-5455-4d6a-88f5-7b8a4a746a19" containerName="main"
Sep 09 14:37:19.316835 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.316787    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5649edb4-ea1f-436a-b822-aed83d685a29" containerName="istio-proxy"
Sep 09 14:37:19.321216 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.321194    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.323488 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.323466    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-f583d9-openshift-default-dockercfg-kf5dg\""
Sep 09 14:37:19.332439 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.332413    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"]
Sep 09 14:37:19.394218 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.394193    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b498k\" (UniqueName: \"kubernetes.io/projected/8eddeea7-0253-4f87-90b7-b51b81bd147d-kube-api-access-b498k\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.394336 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.394230    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-token\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.394395 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.394367    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-workload-socket\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.394447 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.394414    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-envoy\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.394485 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.394444    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-credential-socket\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.394532 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.394505    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-podinfo\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.394581 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.394552    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-workload-certs\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.394626 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.394608    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-data\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.394673 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.394651    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8eddeea7-0253-4f87-90b7-b51b81bd147d-istiod-ca-cert\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.496195 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.496155    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-workload-socket\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.496378 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.496209    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-envoy\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.496378 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.496238    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-credential-socket\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.496378 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.496281    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-podinfo\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.496378 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.496314    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-workload-certs\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.496378 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.496345    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-data\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.496378 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.496376    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8eddeea7-0253-4f87-90b7-b51b81bd147d-istiod-ca-cert\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.496722 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.496645    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-workload-socket\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.496722 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.496715    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-data\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.496843 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.496768    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-workload-certs\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.496843 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.496784    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b498k\" (UniqueName: \"kubernetes.io/projected/8eddeea7-0253-4f87-90b7-b51b81bd147d-kube-api-access-b498k\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.496843 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.496829    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-credential-socket\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.497114 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.497093    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-token\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.497181 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.497128    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8eddeea7-0253-4f87-90b7-b51b81bd147d-istiod-ca-cert\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.498522 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.498501    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-envoy\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.498770 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.498753    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-podinfo\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.504848 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.504826    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-token\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.505341 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.505320    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b498k\" (UniqueName: \"kubernetes.io/projected/8eddeea7-0253-4f87-90b7-b51b81bd147d-kube-api-access-b498k\") pod \"e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") " pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.634122 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.633772    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:19.910397 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.910373    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"]
Sep 09 14:37:19.912058 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:37:19.912030    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eddeea7_0253_4f87_90b7_b51b81bd147d.slice/crio-6b7d33189407e83de8792f3e3c1b0080401b08d14ea5794d3f1c6ccd5a25aa8f WatchSource:0}: Error finding container 6b7d33189407e83de8792f3e3c1b0080401b08d14ea5794d3f1c6ccd5a25aa8f: Status 404 returned error can't find the container with id 6b7d33189407e83de8792f3e3c1b0080401b08d14ea5794d3f1c6ccd5a25aa8f
Sep 09 14:37:19.914483 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.914452    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:37:19.914581 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.914517    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:37:19.914581 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:19.914545    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:37:20.202227 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:20.202194    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf" event={"ID":"8eddeea7-0253-4f87-90b7-b51b81bd147d","Type":"ContainerStarted","Data":"b9f4c0b37d2e4056a36f9104ce053422c4f930552f18db91556e3c3449817aee"}
Sep 09 14:37:20.202395 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:20.202257    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf" event={"ID":"8eddeea7-0253-4f87-90b7-b51b81bd147d","Type":"ContainerStarted","Data":"6b7d33189407e83de8792f3e3c1b0080401b08d14ea5794d3f1c6ccd5a25aa8f"}
Sep 09 14:37:20.224886 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:20.224845    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf" podStartSLOduration=1.224828791 podStartE2EDuration="1.224828791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:37:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:37:20.222816952 +0000 UTC m=+1591.026799953" watchObservedRunningTime="2026-09-09 14:37:20.224828791 +0000 UTC m=+1591.028811793"
Sep 09 14:37:20.634801 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:20.634711    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:20.639793 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:20.639767    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:21.207173 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:21.207132    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:21.208157 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:21.208138    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:23.255998 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.255958    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"]
Sep 09 14:37:23.256442 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.256343    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5649edb4-ea1f-436a-b822-aed83d685a29" containerName="istio-proxy"
Sep 09 14:37:23.256442 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.256356    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5649edb4-ea1f-436a-b822-aed83d685a29" containerName="istio-proxy"
Sep 09 14:37:23.256442 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.256431    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5649edb4-ea1f-436a-b822-aed83d685a29" containerName="istio-proxy"
Sep 09 14:37:23.259419 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.259398    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:37:23.261888 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.261866    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-f583d9-serving-cert\""
Sep 09 14:37:23.272801 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.272775    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"]
Sep 09 14:37:23.329790 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.329757    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f3e1d77-a498-49ea-910c-dbc506d70df8-metrics-certs\") pod \"maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6\" (UID: \"1f3e1d77-a498-49ea-910c-dbc506d70df8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:37:23.329975 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.329806    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3e1d77-a498-49ea-910c-dbc506d70df8-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6\" (UID: \"1f3e1d77-a498-49ea-910c-dbc506d70df8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:37:23.329975 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.329883    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f3e1d77-a498-49ea-910c-dbc506d70df8-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6\" (UID: \"1f3e1d77-a498-49ea-910c-dbc506d70df8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:37:23.330060 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.329982    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pdpf\" (UniqueName: \"kubernetes.io/projected/1f3e1d77-a498-49ea-910c-dbc506d70df8-kube-api-access-2pdpf\") pod \"maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6\" (UID: \"1f3e1d77-a498-49ea-910c-dbc506d70df8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:37:23.431121 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.431078    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f3e1d77-a498-49ea-910c-dbc506d70df8-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6\" (UID: \"1f3e1d77-a498-49ea-910c-dbc506d70df8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:37:23.431346 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.431173    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pdpf\" (UniqueName: \"kubernetes.io/projected/1f3e1d77-a498-49ea-910c-dbc506d70df8-kube-api-access-2pdpf\") pod \"maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6\" (UID: \"1f3e1d77-a498-49ea-910c-dbc506d70df8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:37:23.431346 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.431267    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f3e1d77-a498-49ea-910c-dbc506d70df8-metrics-certs\") pod \"maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6\" (UID: \"1f3e1d77-a498-49ea-910c-dbc506d70df8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:37:23.431346 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.431315    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3e1d77-a498-49ea-910c-dbc506d70df8-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6\" (UID: \"1f3e1d77-a498-49ea-910c-dbc506d70df8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:37:23.431977 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.431950    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3e1d77-a498-49ea-910c-dbc506d70df8-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6\" (UID: \"1f3e1d77-a498-49ea-910c-dbc506d70df8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:37:23.433577 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.433543    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f3e1d77-a498-49ea-910c-dbc506d70df8-metrics-certs\") pod \"maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6\" (UID: \"1f3e1d77-a498-49ea-910c-dbc506d70df8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:37:23.433667 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.433609    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f3e1d77-a498-49ea-910c-dbc506d70df8-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6\" (UID: \"1f3e1d77-a498-49ea-910c-dbc506d70df8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:37:23.440069 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.440045    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pdpf\" (UniqueName: \"kubernetes.io/projected/1f3e1d77-a498-49ea-910c-dbc506d70df8-kube-api-access-2pdpf\") pod \"maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6\" (UID: \"1f3e1d77-a498-49ea-910c-dbc506d70df8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:37:23.574508 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.574425    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:37:23.849687 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:23.849658    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"]
Sep 09 14:37:23.852464 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:37:23.852436    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f3e1d77_a498_49ea_910c_dbc506d70df8.slice/crio-3b8419fa1c1a52d7eec945d0236a0bd6a765513a61516f621a313505b46f23c0 WatchSource:0}: Error finding container 3b8419fa1c1a52d7eec945d0236a0bd6a765513a61516f621a313505b46f23c0: Status 404 returned error can't find the container with id 3b8419fa1c1a52d7eec945d0236a0bd6a765513a61516f621a313505b46f23c0
Sep 09 14:37:24.222392 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:24.222360    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6" event={"ID":"1f3e1d77-a498-49ea-910c-dbc506d70df8","Type":"ContainerStarted","Data":"3b8419fa1c1a52d7eec945d0236a0bd6a765513a61516f621a313505b46f23c0"}
Sep 09 14:37:25.229484 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:25.229450    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6" event={"ID":"1f3e1d77-a498-49ea-910c-dbc506d70df8","Type":"ContainerStarted","Data":"f4e93e84f8685f0aa129ec5e102f6f9983d11fcf4dc9b8e967691fea4bc315ef"}
Sep 09 14:37:25.229925 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:25.229601    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:37:25.250354 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:25.250308    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6" podStartSLOduration=1.897961402 podStartE2EDuration="2.250291312s" totalImagesPullingTime="352.32991ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:37:25.248706575 +0000 UTC m=+1596.052689580" watchObservedRunningTime="2026-09-09 14:37:25.250291312 +0000 UTC m=+1596.054274354"
Sep 09 14:37:29.700053 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:29.700019    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:37:31.244873 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:31.244834    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:37:40.306437 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:40.306403    2553 generic.go:356] "Generic (PLEG): container finished" podID="8eddeea7-0253-4f87-90b7-b51b81bd147d" containerID="b9f4c0b37d2e4056a36f9104ce053422c4f930552f18db91556e3c3449817aee" exitCode=0
Sep 09 14:37:40.306878 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:40.306477    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf" event={"ID":"8eddeea7-0253-4f87-90b7-b51b81bd147d","Type":"ContainerDied","Data":"b9f4c0b37d2e4056a36f9104ce053422c4f930552f18db91556e3c3449817aee"}
Sep 09 14:37:40.306878 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:40.306844    2553 scope.go:117] "RemoveContainer" containerID="b9f4c0b37d2e4056a36f9104ce053422c4f930552f18db91556e3c3449817aee"
Sep 09 14:37:40.307930 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:40.307901    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:37:40.307998 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:40.307975    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:37:40.308035 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:40.308005    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 09 14:37:41.313501 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:41.313465    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf" event={"ID":"8eddeea7-0253-4f87-90b7-b51b81bd147d","Type":"ContainerStarted","Data":"f02cb8f497dc2b42abcab185463b38f87e8bdf4743cb7f0495404e3771c22b93"}
Sep 09 14:37:41.634686 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:41.634597    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:41.634869 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:41.634848    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 09 14:37:41.634914 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:41.634896    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf" podUID="8eddeea7-0253-4f87-90b7-b51b81bd147d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 09 14:37:42.635345 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:42.635261    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 09 14:37:42.635345 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:42.635314    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf" podUID="8eddeea7-0253-4f87-90b7-b51b81bd147d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 09 14:37:43.634471 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:43.634435    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 09 14:37:43.634699 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:43.634506    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf" podUID="8eddeea7-0253-4f87-90b7-b51b81bd147d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 09 14:37:44.634885 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:44.634842    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 09 14:37:44.635356 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:44.634904    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf" podUID="8eddeea7-0253-4f87-90b7-b51b81bd147d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 09 14:37:45.635065 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:45.635023    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 09 14:37:45.635536 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:45.635084    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf" podUID="8eddeea7-0253-4f87-90b7-b51b81bd147d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 09 14:37:46.679121 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:46.679085    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:46.679618 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:46.679596    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:37:46.680300 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:37:46.680272    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:38:01.699788 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.699756    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"]
Sep 09 14:38:01.703286 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.703267    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.706893 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.706870    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-ea13e2\"/\"default-dockercfg-44vzb\""
Sep 09 14:38:01.707029 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.706896    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-ea13e2\"/\"kube-root-ca.crt\""
Sep 09 14:38:01.707029 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.706868    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-ea13e2\"/\"openshift-service-ca.crt\""
Sep 09 14:38:01.707029 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.706874    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-ea13e2\"/\"ipp-route-ea13e2-kserve-self-signed-certs\""
Sep 09 14:38:01.716399 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.716376    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"]
Sep 09 14:38:01.760963 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.760927    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-tmp-dir\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.760963 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.760965    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-home\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.761217 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.761036    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/423a7899-182c-467f-9a66-e1065547455b-tls-certs\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.761217 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.761070    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-dshm\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.761217 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.761122    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pll54\" (UniqueName: \"kubernetes.io/projected/423a7899-182c-467f-9a66-e1065547455b-kube-api-access-pll54\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.761217 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.761203    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-model-cache\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.862072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.862019    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pll54\" (UniqueName: \"kubernetes.io/projected/423a7899-182c-467f-9a66-e1065547455b-kube-api-access-pll54\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.862287 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.862101    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-model-cache\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.862287 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.862140    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-tmp-dir\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.862287 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.862157    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-home\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.862287 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.862183    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/423a7899-182c-467f-9a66-e1065547455b-tls-certs\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.862287 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.862207    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-dshm\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.862614 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.862590    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-model-cache\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.862614 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.862606    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-home\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.862696 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.862658    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-tmp-dir\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.864476 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.864454    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-dshm\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.864765 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.864745    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/423a7899-182c-467f-9a66-e1065547455b-tls-certs\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:01.871916 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:01.871888    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pll54\" (UniqueName: \"kubernetes.io/projected/423a7899-182c-467f-9a66-e1065547455b-kube-api-access-pll54\") pod \"ipp-route-ea13e2-kserve-75bf74d77f-6f9kk\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") " pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:02.013981 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:02.013883    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:02.286109 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:02.286080    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"]
Sep 09 14:38:02.288371 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:38:02.288345    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod423a7899_182c_467f_9a66_e1065547455b.slice/crio-1b0835d07040617f3d5e4dca0750021198f20a44e6bad9e953d7e45427139129 WatchSource:0}: Error finding container 1b0835d07040617f3d5e4dca0750021198f20a44e6bad9e953d7e45427139129: Status 404 returned error can't find the container with id 1b0835d07040617f3d5e4dca0750021198f20a44e6bad9e953d7e45427139129
Sep 09 14:38:02.415728 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:02.415686    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk" event={"ID":"423a7899-182c-467f-9a66-e1065547455b","Type":"ContainerStarted","Data":"5665f2ade040288fc52545ba79dcc6eaf04f1d3a11100ae5762ffa298c00088a"}
Sep 09 14:38:02.415890 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:02.415740    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk" event={"ID":"423a7899-182c-467f-9a66-e1065547455b","Type":"ContainerStarted","Data":"1b0835d07040617f3d5e4dca0750021198f20a44e6bad9e953d7e45427139129"}
Sep 09 14:38:02.434653 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:02.434600    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk" podStartSLOduration=1.434583431 podStartE2EDuration="1.434583431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:38:02.432872246 +0000 UTC m=+1633.236855248" watchObservedRunningTime="2026-09-09 14:38:02.434583431 +0000 UTC m=+1633.238566425"
Sep 09 14:38:05.800241 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:05.800203    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:38:12.014651 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:12.014615    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:12.014651 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:12.014661    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:12.027040 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:12.027010    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:12.476410 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:12.476375    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:38:32.096225 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:32.096189    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:38:51.402317 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:38:51.402280    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:39:18.392209 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:39:18.392118    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:39:38.400881 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:39:38.400843    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:39:46.361095 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:39:46.361057    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"]
Sep 09 14:39:50.705122 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:39:50.705090    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:40:01.380923 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.380880    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk" podUID="423a7899-182c-467f-9a66-e1065547455b" containerName="main" containerID="cri-o://5665f2ade040288fc52545ba79dcc6eaf04f1d3a11100ae5762ffa298c00088a" gracePeriod=45
Sep 09 14:40:01.629680 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.629655    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:40:01.709280 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.709243    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/423a7899-182c-467f-9a66-e1065547455b-tls-certs\") pod \"423a7899-182c-467f-9a66-e1065547455b\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") "
Sep 09 14:40:01.709426 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.709319    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-tmp-dir\") pod \"423a7899-182c-467f-9a66-e1065547455b\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") "
Sep 09 14:40:01.709426 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.709345    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-model-cache\") pod \"423a7899-182c-467f-9a66-e1065547455b\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") "
Sep 09 14:40:01.709426 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.709389    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pll54\" (UniqueName: \"kubernetes.io/projected/423a7899-182c-467f-9a66-e1065547455b-kube-api-access-pll54\") pod \"423a7899-182c-467f-9a66-e1065547455b\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") "
Sep 09 14:40:01.709556 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.709503    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-dshm\") pod \"423a7899-182c-467f-9a66-e1065547455b\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") "
Sep 09 14:40:01.709556 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.709531    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-home\") pod \"423a7899-182c-467f-9a66-e1065547455b\" (UID: \"423a7899-182c-467f-9a66-e1065547455b\") "
Sep 09 14:40:01.709688 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.709620    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-model-cache" (OuterVolumeSpecName: "model-cache") pod "423a7899-182c-467f-9a66-e1065547455b" (UID: "423a7899-182c-467f-9a66-e1065547455b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:40:01.709688 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.709640    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "423a7899-182c-467f-9a66-e1065547455b" (UID: "423a7899-182c-467f-9a66-e1065547455b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:40:01.709818 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.709798    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-home" (OuterVolumeSpecName: "home") pod "423a7899-182c-467f-9a66-e1065547455b" (UID: "423a7899-182c-467f-9a66-e1065547455b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:40:01.709879 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.709855    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-home\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:01.709879 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.709868    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-tmp-dir\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:01.709959 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.709881    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-model-cache\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:01.711608 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.711556    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/423a7899-182c-467f-9a66-e1065547455b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "423a7899-182c-467f-9a66-e1065547455b" (UID: "423a7899-182c-467f-9a66-e1065547455b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:40:01.711684 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.711607    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/423a7899-182c-467f-9a66-e1065547455b-kube-api-access-pll54" (OuterVolumeSpecName: "kube-api-access-pll54") pod "423a7899-182c-467f-9a66-e1065547455b" (UID: "423a7899-182c-467f-9a66-e1065547455b"). InnerVolumeSpecName "kube-api-access-pll54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:40:01.711684 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.711560    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-dshm" (OuterVolumeSpecName: "dshm") pod "423a7899-182c-467f-9a66-e1065547455b" (UID: "423a7899-182c-467f-9a66-e1065547455b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:40:01.810399 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.810357    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pll54\" (UniqueName: \"kubernetes.io/projected/423a7899-182c-467f-9a66-e1065547455b-kube-api-access-pll54\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:01.810399 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.810396    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/423a7899-182c-467f-9a66-e1065547455b-dshm\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:01.810645 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:01.810409    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/423a7899-182c-467f-9a66-e1065547455b-tls-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:02.005441 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:02.005352    2553 generic.go:356] "Generic (PLEG): container finished" podID="423a7899-182c-467f-9a66-e1065547455b" containerID="5665f2ade040288fc52545ba79dcc6eaf04f1d3a11100ae5762ffa298c00088a" exitCode=0
Sep 09 14:40:02.005441 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:02.005391    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"
Sep 09 14:40:02.005441 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:02.005430    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk" event={"ID":"423a7899-182c-467f-9a66-e1065547455b","Type":"ContainerDied","Data":"5665f2ade040288fc52545ba79dcc6eaf04f1d3a11100ae5762ffa298c00088a"}
Sep 09 14:40:02.005684 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:02.005465    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk" event={"ID":"423a7899-182c-467f-9a66-e1065547455b","Type":"ContainerDied","Data":"1b0835d07040617f3d5e4dca0750021198f20a44e6bad9e953d7e45427139129"}
Sep 09 14:40:02.005684 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:02.005484    2553 scope.go:117] "RemoveContainer" containerID="5665f2ade040288fc52545ba79dcc6eaf04f1d3a11100ae5762ffa298c00088a"
Sep 09 14:40:02.014461 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:02.014441    2553 scope.go:117] "RemoveContainer" containerID="5665f2ade040288fc52545ba79dcc6eaf04f1d3a11100ae5762ffa298c00088a"
Sep 09 14:40:02.014766 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:40:02.014747    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5665f2ade040288fc52545ba79dcc6eaf04f1d3a11100ae5762ffa298c00088a\": container with ID starting with 5665f2ade040288fc52545ba79dcc6eaf04f1d3a11100ae5762ffa298c00088a not found: ID does not exist" containerID="5665f2ade040288fc52545ba79dcc6eaf04f1d3a11100ae5762ffa298c00088a"
Sep 09 14:40:02.014814 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:02.014777    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5665f2ade040288fc52545ba79dcc6eaf04f1d3a11100ae5762ffa298c00088a"} err="failed to get container status \"5665f2ade040288fc52545ba79dcc6eaf04f1d3a11100ae5762ffa298c00088a\": rpc error: code = NotFound desc = could not find container \"5665f2ade040288fc52545ba79dcc6eaf04f1d3a11100ae5762ffa298c00088a\": container with ID starting with 5665f2ade040288fc52545ba79dcc6eaf04f1d3a11100ae5762ffa298c00088a not found: ID does not exist"
Sep 09 14:40:02.026032 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:02.025999    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"]
Sep 09 14:40:02.029471 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:02.029444    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-ea13e2/ipp-route-ea13e2-kserve-75bf74d77f-6f9kk"]
Sep 09 14:40:03.645807 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:03.645774    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="423a7899-182c-467f-9a66-e1065547455b" path="/var/lib/kubelet/pods/423a7899-182c-467f-9a66-e1065547455b/volumes"
Sep 09 14:40:46.552868 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:46.552794    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"]
Sep 09 14:40:46.553348 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:46.552984    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6" podUID="1f3e1d77-a498-49ea-910c-dbc506d70df8" containerName="maas-api" containerID="cri-o://f4e93e84f8685f0aa129ec5e102f6f9983d11fcf4dc9b8e967691fea4bc315ef" gracePeriod=30
Sep 09 14:40:46.805016 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:46.804958    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:40:46.906107 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:46.906068    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f3e1d77-a498-49ea-910c-dbc506d70df8-metrics-certs\") pod \"1f3e1d77-a498-49ea-910c-dbc506d70df8\" (UID: \"1f3e1d77-a498-49ea-910c-dbc506d70df8\") "
Sep 09 14:40:46.906265 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:46.906136    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3e1d77-a498-49ea-910c-dbc506d70df8-openshift-service-ca\") pod \"1f3e1d77-a498-49ea-910c-dbc506d70df8\" (UID: \"1f3e1d77-a498-49ea-910c-dbc506d70df8\") "
Sep 09 14:40:46.906265 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:46.906189    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f3e1d77-a498-49ea-910c-dbc506d70df8-maas-api-tls\") pod \"1f3e1d77-a498-49ea-910c-dbc506d70df8\" (UID: \"1f3e1d77-a498-49ea-910c-dbc506d70df8\") "
Sep 09 14:40:46.906265 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:46.906207    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pdpf\" (UniqueName: \"kubernetes.io/projected/1f3e1d77-a498-49ea-910c-dbc506d70df8-kube-api-access-2pdpf\") pod \"1f3e1d77-a498-49ea-910c-dbc506d70df8\" (UID: \"1f3e1d77-a498-49ea-910c-dbc506d70df8\") "
Sep 09 14:40:46.906521 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:46.906494    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f3e1d77-a498-49ea-910c-dbc506d70df8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1f3e1d77-a498-49ea-910c-dbc506d70df8" (UID: "1f3e1d77-a498-49ea-910c-dbc506d70df8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:40:46.908086 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:46.908061    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f3e1d77-a498-49ea-910c-dbc506d70df8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1f3e1d77-a498-49ea-910c-dbc506d70df8" (UID: "1f3e1d77-a498-49ea-910c-dbc506d70df8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:40:46.908162 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:46.908084    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f3e1d77-a498-49ea-910c-dbc506d70df8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1f3e1d77-a498-49ea-910c-dbc506d70df8" (UID: "1f3e1d77-a498-49ea-910c-dbc506d70df8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:40:46.908162 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:46.908148    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f3e1d77-a498-49ea-910c-dbc506d70df8-kube-api-access-2pdpf" (OuterVolumeSpecName: "kube-api-access-2pdpf") pod "1f3e1d77-a498-49ea-910c-dbc506d70df8" (UID: "1f3e1d77-a498-49ea-910c-dbc506d70df8"). InnerVolumeSpecName "kube-api-access-2pdpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:40:47.007607 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:47.007559    2553 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f3e1d77-a498-49ea-910c-dbc506d70df8-metrics-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:47.007607 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:47.007603    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3e1d77-a498-49ea-910c-dbc506d70df8-openshift-service-ca\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:47.007607 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:47.007614    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f3e1d77-a498-49ea-910c-dbc506d70df8-maas-api-tls\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:47.008053 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:47.007624    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pdpf\" (UniqueName: \"kubernetes.io/projected/1f3e1d77-a498-49ea-910c-dbc506d70df8-kube-api-access-2pdpf\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:47.230664 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:47.230633    2553 generic.go:356] "Generic (PLEG): container finished" podID="1f3e1d77-a498-49ea-910c-dbc506d70df8" containerID="f4e93e84f8685f0aa129ec5e102f6f9983d11fcf4dc9b8e967691fea4bc315ef" exitCode=0
Sep 09 14:40:47.230824 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:47.230680    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"
Sep 09 14:40:47.230824 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:47.230715    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6" event={"ID":"1f3e1d77-a498-49ea-910c-dbc506d70df8","Type":"ContainerDied","Data":"f4e93e84f8685f0aa129ec5e102f6f9983d11fcf4dc9b8e967691fea4bc315ef"}
Sep 09 14:40:47.230824 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:47.230769    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6" event={"ID":"1f3e1d77-a498-49ea-910c-dbc506d70df8","Type":"ContainerDied","Data":"3b8419fa1c1a52d7eec945d0236a0bd6a765513a61516f621a313505b46f23c0"}
Sep 09 14:40:47.230824 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:47.230793    2553 scope.go:117] "RemoveContainer" containerID="f4e93e84f8685f0aa129ec5e102f6f9983d11fcf4dc9b8e967691fea4bc315ef"
Sep 09 14:40:47.246045 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:47.246016    2553 scope.go:117] "RemoveContainer" containerID="f4e93e84f8685f0aa129ec5e102f6f9983d11fcf4dc9b8e967691fea4bc315ef"
Sep 09 14:40:47.246457 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:40:47.246421    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4e93e84f8685f0aa129ec5e102f6f9983d11fcf4dc9b8e967691fea4bc315ef\": container with ID starting with f4e93e84f8685f0aa129ec5e102f6f9983d11fcf4dc9b8e967691fea4bc315ef not found: ID does not exist" containerID="f4e93e84f8685f0aa129ec5e102f6f9983d11fcf4dc9b8e967691fea4bc315ef"
Sep 09 14:40:47.246548 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:47.246474    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e93e84f8685f0aa129ec5e102f6f9983d11fcf4dc9b8e967691fea4bc315ef"} err="failed to get container status \"f4e93e84f8685f0aa129ec5e102f6f9983d11fcf4dc9b8e967691fea4bc315ef\": rpc error: code = NotFound desc = could not find container \"f4e93e84f8685f0aa129ec5e102f6f9983d11fcf4dc9b8e967691fea4bc315ef\": container with ID starting with f4e93e84f8685f0aa129ec5e102f6f9983d11fcf4dc9b8e967691fea4bc315ef not found: ID does not exist"
Sep 09 14:40:47.262089 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:47.262026    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"]
Sep 09 14:40:47.264398 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:47.264376    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f583d9-5655c7f85f-xrtt6"]
Sep 09 14:40:47.646224 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:47.646151    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f3e1d77-a498-49ea-910c-dbc506d70df8" path="/var/lib/kubelet/pods/1f3e1d77-a498-49ea-910c-dbc506d70df8/volumes"
Sep 09 14:40:49.796224 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:49.796191    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:40:53.900134 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:53.900094    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"]
Sep 09 14:40:53.900730 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:53.900366    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf" podUID="8eddeea7-0253-4f87-90b7-b51b81bd147d" containerName="istio-proxy" containerID="cri-o://f02cb8f497dc2b42abcab185463b38f87e8bdf4743cb7f0495404e3771c22b93" gracePeriod=30
Sep 09 14:40:59.153708 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.153685    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:40:59.291827 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.291795    2553 generic.go:356] "Generic (PLEG): container finished" podID="8eddeea7-0253-4f87-90b7-b51b81bd147d" containerID="f02cb8f497dc2b42abcab185463b38f87e8bdf4743cb7f0495404e3771c22b93" exitCode=0
Sep 09 14:40:59.291988 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.291844    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"
Sep 09 14:40:59.291988 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.291880    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf" event={"ID":"8eddeea7-0253-4f87-90b7-b51b81bd147d","Type":"ContainerDied","Data":"f02cb8f497dc2b42abcab185463b38f87e8bdf4743cb7f0495404e3771c22b93"}
Sep 09 14:40:59.291988 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.291938    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf" event={"ID":"8eddeea7-0253-4f87-90b7-b51b81bd147d","Type":"ContainerDied","Data":"6b7d33189407e83de8792f3e3c1b0080401b08d14ea5794d3f1c6ccd5a25aa8f"}
Sep 09 14:40:59.291988 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.291961    2553 scope.go:117] "RemoveContainer" containerID="f02cb8f497dc2b42abcab185463b38f87e8bdf4743cb7f0495404e3771c22b93"
Sep 09 14:40:59.300124 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.300108    2553 scope.go:117] "RemoveContainer" containerID="b9f4c0b37d2e4056a36f9104ce053422c4f930552f18db91556e3c3449817aee"
Sep 09 14:40:59.309844 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.309816    2553 scope.go:117] "RemoveContainer" containerID="f02cb8f497dc2b42abcab185463b38f87e8bdf4743cb7f0495404e3771c22b93"
Sep 09 14:40:59.310014 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.309994    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8eddeea7-0253-4f87-90b7-b51b81bd147d-istiod-ca-cert\") pod \"8eddeea7-0253-4f87-90b7-b51b81bd147d\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") "
Sep 09 14:40:59.310073 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310041    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-credential-socket\") pod \"8eddeea7-0253-4f87-90b7-b51b81bd147d\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") "
Sep 09 14:40:59.310073 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310069    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-data\") pod \"8eddeea7-0253-4f87-90b7-b51b81bd147d\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") "
Sep 09 14:40:59.310186 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310105    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-token\") pod \"8eddeea7-0253-4f87-90b7-b51b81bd147d\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") "
Sep 09 14:40:59.310186 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310144    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-podinfo\") pod \"8eddeea7-0253-4f87-90b7-b51b81bd147d\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") "
Sep 09 14:40:59.310186 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:40:59.310143    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f02cb8f497dc2b42abcab185463b38f87e8bdf4743cb7f0495404e3771c22b93\": container with ID starting with f02cb8f497dc2b42abcab185463b38f87e8bdf4743cb7f0495404e3771c22b93 not found: ID does not exist" containerID="f02cb8f497dc2b42abcab185463b38f87e8bdf4743cb7f0495404e3771c22b93"
Sep 09 14:40:59.310597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310177    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f02cb8f497dc2b42abcab185463b38f87e8bdf4743cb7f0495404e3771c22b93"} err="failed to get container status \"f02cb8f497dc2b42abcab185463b38f87e8bdf4743cb7f0495404e3771c22b93\": rpc error: code = NotFound desc = could not find container \"f02cb8f497dc2b42abcab185463b38f87e8bdf4743cb7f0495404e3771c22b93\": container with ID starting with f02cb8f497dc2b42abcab185463b38f87e8bdf4743cb7f0495404e3771c22b93 not found: ID does not exist"
Sep 09 14:40:59.310597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310188    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-workload-socket\") pod \"8eddeea7-0253-4f87-90b7-b51b81bd147d\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") "
Sep 09 14:40:59.310597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310200    2553 scope.go:117] "RemoveContainer" containerID="b9f4c0b37d2e4056a36f9104ce053422c4f930552f18db91556e3c3449817aee"
Sep 09 14:40:59.310597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310218    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-envoy\") pod \"8eddeea7-0253-4f87-90b7-b51b81bd147d\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") "
Sep 09 14:40:59.310597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310255    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-workload-certs\") pod \"8eddeea7-0253-4f87-90b7-b51b81bd147d\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") "
Sep 09 14:40:59.310597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310298    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b498k\" (UniqueName: \"kubernetes.io/projected/8eddeea7-0253-4f87-90b7-b51b81bd147d-kube-api-access-b498k\") pod \"8eddeea7-0253-4f87-90b7-b51b81bd147d\" (UID: \"8eddeea7-0253-4f87-90b7-b51b81bd147d\") "
Sep 09 14:40:59.310597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310308    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8eddeea7-0253-4f87-90b7-b51b81bd147d" (UID: "8eddeea7-0253-4f87-90b7-b51b81bd147d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:40:59.310597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310391    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-data" (OuterVolumeSpecName: "istio-data") pod "8eddeea7-0253-4f87-90b7-b51b81bd147d" (UID: "8eddeea7-0253-4f87-90b7-b51b81bd147d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:40:59.310597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310471    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8eddeea7-0253-4f87-90b7-b51b81bd147d" (UID: "8eddeea7-0253-4f87-90b7-b51b81bd147d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:40:59.310597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310516    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eddeea7-0253-4f87-90b7-b51b81bd147d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8eddeea7-0253-4f87-90b7-b51b81bd147d" (UID: "8eddeea7-0253-4f87-90b7-b51b81bd147d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:40:59.310597 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310597    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-workload-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:59.311096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310616    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8eddeea7-0253-4f87-90b7-b51b81bd147d-istiod-ca-cert\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:59.311096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310631    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-credential-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:59.311096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310644    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-data\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:59.311096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310798    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8eddeea7-0253-4f87-90b7-b51b81bd147d" (UID: "8eddeea7-0253-4f87-90b7-b51b81bd147d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:40:59.311096 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:40:59.310970    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9f4c0b37d2e4056a36f9104ce053422c4f930552f18db91556e3c3449817aee\": container with ID starting with b9f4c0b37d2e4056a36f9104ce053422c4f930552f18db91556e3c3449817aee not found: ID does not exist" containerID="b9f4c0b37d2e4056a36f9104ce053422c4f930552f18db91556e3c3449817aee"
Sep 09 14:40:59.311096 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.310999    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f4c0b37d2e4056a36f9104ce053422c4f930552f18db91556e3c3449817aee"} err="failed to get container status \"b9f4c0b37d2e4056a36f9104ce053422c4f930552f18db91556e3c3449817aee\": rpc error: code = NotFound desc = could not find container \"b9f4c0b37d2e4056a36f9104ce053422c4f930552f18db91556e3c3449817aee\": container with ID starting with b9f4c0b37d2e4056a36f9104ce053422c4f930552f18db91556e3c3449817aee not found: ID does not exist"
Sep 09 14:40:59.312406 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.312379    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eddeea7-0253-4f87-90b7-b51b81bd147d-kube-api-access-b498k" (OuterVolumeSpecName: "kube-api-access-b498k") pod "8eddeea7-0253-4f87-90b7-b51b81bd147d" (UID: "8eddeea7-0253-4f87-90b7-b51b81bd147d"). InnerVolumeSpecName "kube-api-access-b498k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:40:59.312510 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.312454    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8eddeea7-0253-4f87-90b7-b51b81bd147d" (UID: "8eddeea7-0253-4f87-90b7-b51b81bd147d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:40:59.312759 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.312734    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-token" (OuterVolumeSpecName: "istio-token") pod "8eddeea7-0253-4f87-90b7-b51b81bd147d" (UID: "8eddeea7-0253-4f87-90b7-b51b81bd147d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:40:59.312856 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.312734    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8eddeea7-0253-4f87-90b7-b51b81bd147d" (UID: "8eddeea7-0253-4f87-90b7-b51b81bd147d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:40:59.411274 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.411243    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-podinfo\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:59.411274 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.411275    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-envoy\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:59.411410 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.411286    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8eddeea7-0253-4f87-90b7-b51b81bd147d-workload-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:59.411410 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.411295    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b498k\" (UniqueName: \"kubernetes.io/projected/8eddeea7-0253-4f87-90b7-b51b81bd147d-kube-api-access-b498k\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:59.411410 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.411306    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8eddeea7-0253-4f87-90b7-b51b81bd147d-istio-token\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:40:59.615239 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.615213    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"]
Sep 09 14:40:59.619614 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.619588    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-f583d9-openshift-default-b5dc745c8-zdbpf"]
Sep 09 14:40:59.646113 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:40:59.646088    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eddeea7-0253-4f87-90b7-b51b81bd147d" path="/var/lib/kubelet/pods/8eddeea7-0253-4f87-90b7-b51b81bd147d/volumes"
Sep 09 14:41:04.862335 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:04.862296    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"]
Sep 09 14:41:04.862817 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:04.862597    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4" podUID="41931dd1-0134-445b-ab7e-ab55cb88219b" containerName="maas-api" containerID="cri-o://ed805313b26f9c7fc0c3daadb6d40b879269ca57e4b80350e744d3bb06379e78" gracePeriod=30
Sep 09 14:41:05.107913 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.107888    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:41:05.160546 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.160447    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41931dd1-0134-445b-ab7e-ab55cb88219b-metrics-certs\") pod \"41931dd1-0134-445b-ab7e-ab55cb88219b\" (UID: \"41931dd1-0134-445b-ab7e-ab55cb88219b\") "
Sep 09 14:41:05.160546 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.160494    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9cqr\" (UniqueName: \"kubernetes.io/projected/41931dd1-0134-445b-ab7e-ab55cb88219b-kube-api-access-c9cqr\") pod \"41931dd1-0134-445b-ab7e-ab55cb88219b\" (UID: \"41931dd1-0134-445b-ab7e-ab55cb88219b\") "
Sep 09 14:41:05.160794 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.160699    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41931dd1-0134-445b-ab7e-ab55cb88219b-openshift-service-ca\") pod \"41931dd1-0134-445b-ab7e-ab55cb88219b\" (UID: \"41931dd1-0134-445b-ab7e-ab55cb88219b\") "
Sep 09 14:41:05.160858 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.160792    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41931dd1-0134-445b-ab7e-ab55cb88219b-maas-api-tls\") pod \"41931dd1-0134-445b-ab7e-ab55cb88219b\" (UID: \"41931dd1-0134-445b-ab7e-ab55cb88219b\") "
Sep 09 14:41:05.161103 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.161072    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41931dd1-0134-445b-ab7e-ab55cb88219b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "41931dd1-0134-445b-ab7e-ab55cb88219b" (UID: "41931dd1-0134-445b-ab7e-ab55cb88219b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:41:05.162864 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.162838    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41931dd1-0134-445b-ab7e-ab55cb88219b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "41931dd1-0134-445b-ab7e-ab55cb88219b" (UID: "41931dd1-0134-445b-ab7e-ab55cb88219b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:41:05.163184 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.163155    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41931dd1-0134-445b-ab7e-ab55cb88219b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "41931dd1-0134-445b-ab7e-ab55cb88219b" (UID: "41931dd1-0134-445b-ab7e-ab55cb88219b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:41:05.163184 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.163169    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41931dd1-0134-445b-ab7e-ab55cb88219b-kube-api-access-c9cqr" (OuterVolumeSpecName: "kube-api-access-c9cqr") pod "41931dd1-0134-445b-ab7e-ab55cb88219b" (UID: "41931dd1-0134-445b-ab7e-ab55cb88219b"). InnerVolumeSpecName "kube-api-access-c9cqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:41:05.261894 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.261861    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41931dd1-0134-445b-ab7e-ab55cb88219b-maas-api-tls\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:41:05.261894 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.261887    2553 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41931dd1-0134-445b-ab7e-ab55cb88219b-metrics-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:41:05.261894 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.261899    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9cqr\" (UniqueName: \"kubernetes.io/projected/41931dd1-0134-445b-ab7e-ab55cb88219b-kube-api-access-c9cqr\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:41:05.262123 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.261909    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41931dd1-0134-445b-ab7e-ab55cb88219b-openshift-service-ca\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:41:05.321039 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.321006    2553 generic.go:356] "Generic (PLEG): container finished" podID="41931dd1-0134-445b-ab7e-ab55cb88219b" containerID="ed805313b26f9c7fc0c3daadb6d40b879269ca57e4b80350e744d3bb06379e78" exitCode=0
Sep 09 14:41:05.321187 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.321054    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"
Sep 09 14:41:05.321187 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.321097    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4" event={"ID":"41931dd1-0134-445b-ab7e-ab55cb88219b","Type":"ContainerDied","Data":"ed805313b26f9c7fc0c3daadb6d40b879269ca57e4b80350e744d3bb06379e78"}
Sep 09 14:41:05.321187 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.321154    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4" event={"ID":"41931dd1-0134-445b-ab7e-ab55cb88219b","Type":"ContainerDied","Data":"19d02bc0a27ee79f26817abe8e69c79cb9a38e34c536e757aa464710dd992be6"}
Sep 09 14:41:05.321187 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.321178    2553 scope.go:117] "RemoveContainer" containerID="ed805313b26f9c7fc0c3daadb6d40b879269ca57e4b80350e744d3bb06379e78"
Sep 09 14:41:05.330186 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.330169    2553 scope.go:117] "RemoveContainer" containerID="ed805313b26f9c7fc0c3daadb6d40b879269ca57e4b80350e744d3bb06379e78"
Sep 09 14:41:05.330443 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:41:05.330426    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed805313b26f9c7fc0c3daadb6d40b879269ca57e4b80350e744d3bb06379e78\": container with ID starting with ed805313b26f9c7fc0c3daadb6d40b879269ca57e4b80350e744d3bb06379e78 not found: ID does not exist" containerID="ed805313b26f9c7fc0c3daadb6d40b879269ca57e4b80350e744d3bb06379e78"
Sep 09 14:41:05.330490 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.330450    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed805313b26f9c7fc0c3daadb6d40b879269ca57e4b80350e744d3bb06379e78"} err="failed to get container status \"ed805313b26f9c7fc0c3daadb6d40b879269ca57e4b80350e744d3bb06379e78\": rpc error: code = NotFound desc = could not find container \"ed805313b26f9c7fc0c3daadb6d40b879269ca57e4b80350e744d3bb06379e78\": container with ID starting with ed805313b26f9c7fc0c3daadb6d40b879269ca57e4b80350e744d3bb06379e78 not found: ID does not exist"
Sep 09 14:41:05.343356 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.343333    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"]
Sep 09 14:41:05.346184 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.346162    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e565aa-76d4f7bf4f-jvwj4"]
Sep 09 14:41:05.647058 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:05.647022    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41931dd1-0134-445b-ab7e-ab55cb88219b" path="/var/lib/kubelet/pods/41931dd1-0134-445b-ab7e-ab55cb88219b/volumes"
Sep 09 14:41:07.699587 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:07.699530    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:41:12.602223 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.602185    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4"]
Sep 09 14:41:12.602637 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.602498    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eddeea7-0253-4f87-90b7-b51b81bd147d" containerName="istio-proxy"
Sep 09 14:41:12.602637 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.602509    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eddeea7-0253-4f87-90b7-b51b81bd147d" containerName="istio-proxy"
Sep 09 14:41:12.602637 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.602518    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eddeea7-0253-4f87-90b7-b51b81bd147d" containerName="istio-proxy"
Sep 09 14:41:12.602637 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.602524    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eddeea7-0253-4f87-90b7-b51b81bd147d" containerName="istio-proxy"
Sep 09 14:41:12.602637 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.602531    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="423a7899-182c-467f-9a66-e1065547455b" containerName="main"
Sep 09 14:41:12.602637 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.602537    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="423a7899-182c-467f-9a66-e1065547455b" containerName="main"
Sep 09 14:41:12.602637 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.602545    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f3e1d77-a498-49ea-910c-dbc506d70df8" containerName="maas-api"
Sep 09 14:41:12.602637 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.602550    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f3e1d77-a498-49ea-910c-dbc506d70df8" containerName="maas-api"
Sep 09 14:41:12.602637 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.602560    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41931dd1-0134-445b-ab7e-ab55cb88219b" containerName="maas-api"
Sep 09 14:41:12.602637 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.602578    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="41931dd1-0134-445b-ab7e-ab55cb88219b" containerName="maas-api"
Sep 09 14:41:12.602637 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.602637    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="41931dd1-0134-445b-ab7e-ab55cb88219b" containerName="maas-api"
Sep 09 14:41:12.602637 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.602644    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="423a7899-182c-467f-9a66-e1065547455b" containerName="main"
Sep 09 14:41:12.603061 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.602652    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eddeea7-0253-4f87-90b7-b51b81bd147d" containerName="istio-proxy"
Sep 09 14:41:12.603061 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.602658    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f3e1d77-a498-49ea-910c-dbc506d70df8" containerName="maas-api"
Sep 09 14:41:12.606909 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.606888    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4"
Sep 09 14:41:12.609757 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.609737    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:41:12.609850 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.609741    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:41:12.613413 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.613389    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4"]
Sep 09 14:41:12.621445 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.621422    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/743d402a-e905-4201-b15c-120153f353e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4\" (UID: \"743d402a-e905-4201-b15c-120153f353e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4"
Sep 09 14:41:12.722652 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.722593    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/743d402a-e905-4201-b15c-120153f353e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4\" (UID: \"743d402a-e905-4201-b15c-120153f353e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4"
Sep 09 14:41:12.723247 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.723224    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/743d402a-e905-4201-b15c-120153f353e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4\" (UID: \"743d402a-e905-4201-b15c-120153f353e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4"
Sep 09 14:41:12.918826 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:12.918744    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4"
Sep 09 14:41:13.186899 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:13.186871    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4"]
Sep 09 14:41:13.188537 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:41:13.188511    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod743d402a_e905_4201_b15c_120153f353e0.slice/crio-66fd6219fbff13772f3bfc82c1839ad095581b8185db65ef62c0b91e5749bb62 WatchSource:0}: Error finding container 66fd6219fbff13772f3bfc82c1839ad095581b8185db65ef62c0b91e5749bb62: Status 404 returned error can't find the container with id 66fd6219fbff13772f3bfc82c1839ad095581b8185db65ef62c0b91e5749bb62
Sep 09 14:41:13.359683 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:13.359653    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4" event={"ID":"743d402a-e905-4201-b15c-120153f353e0","Type":"ContainerStarted","Data":"66fd6219fbff13772f3bfc82c1839ad095581b8185db65ef62c0b91e5749bb62"}
Sep 09 14:41:14.365270 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:14.365229    2553 generic.go:356] "Generic (PLEG): container finished" podID="743d402a-e905-4201-b15c-120153f353e0" containerID="dca4c37a4f863e48086cfaed2d88c71351de4d3afe5481edc2d07abbd85ea003" exitCode=0
Sep 09 14:41:14.365649 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:14.365310    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4" event={"ID":"743d402a-e905-4201-b15c-120153f353e0","Type":"ContainerDied","Data":"dca4c37a4f863e48086cfaed2d88c71351de4d3afe5481edc2d07abbd85ea003"}
Sep 09 14:41:15.499107 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:15.499083    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4"
Sep 09 14:41:15.542822 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:15.542794    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/743d402a-e905-4201-b15c-120153f353e0-maas-api-service-ca\") pod \"743d402a-e905-4201-b15c-120153f353e0\" (UID: \"743d402a-e905-4201-b15c-120153f353e0\") "
Sep 09 14:41:15.543126 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:15.543104    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/743d402a-e905-4201-b15c-120153f353e0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "743d402a-e905-4201-b15c-120153f353e0" (UID: "743d402a-e905-4201-b15c-120153f353e0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:41:15.643859 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:15.643791    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/743d402a-e905-4201-b15c-120153f353e0-maas-api-service-ca\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:41:16.375917 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:16.375887    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4"
Sep 09 14:41:16.375917 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:16.375895    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4" event={"ID":"743d402a-e905-4201-b15c-120153f353e0","Type":"ContainerDied","Data":"66fd6219fbff13772f3bfc82c1839ad095581b8185db65ef62c0b91e5749bb62"}
Sep 09 14:41:16.376127 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:16.375943    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66fd6219fbff13772f3bfc82c1839ad095581b8185db65ef62c0b91e5749bb62"
Sep 09 14:41:23.267469 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:23.267431    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4"]
Sep 09 14:41:23.272809 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:23.272778    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c5e2d3-r7wk4"]
Sep 09 14:41:23.646414 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:23.646332    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="743d402a-e905-4201-b15c-120153f353e0" path="/var/lib/kubelet/pods/743d402a-e905-4201-b15c-120153f353e0/volumes"
Sep 09 14:41:25.988485 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:25.988446    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:41:30.344479 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:30.344450    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"]
Sep 09 14:41:30.344899 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:30.344685    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp" podUID="3869a2b6-b582-4256-949e-08457b3f98c7" containerName="istio-proxy" containerID="cri-o://e97af55f1f53b678e6d3a36660dc7d122ceb104e8e62bd065752dd6636c88abc" gracePeriod=30
Sep 09 14:41:32.880936 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:32.880890    2553 patch_prober.go:28] interesting pod/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 14:41:32.881306 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:32.880972    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp" podUID="3869a2b6-b582-4256-949e-08457b3f98c7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 14:41:34.997772 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:34.997736    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:41:35.474617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.474534    2553 generic.go:356] "Generic (PLEG): container finished" podID="3869a2b6-b582-4256-949e-08457b3f98c7" containerID="e97af55f1f53b678e6d3a36660dc7d122ceb104e8e62bd065752dd6636c88abc" exitCode=0
Sep 09 14:41:35.474617 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.474597    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp" event={"ID":"3869a2b6-b582-4256-949e-08457b3f98c7","Type":"ContainerDied","Data":"e97af55f1f53b678e6d3a36660dc7d122ceb104e8e62bd065752dd6636c88abc"}
Sep 09 14:41:35.474799 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.474661    2553 scope.go:117] "RemoveContainer" containerID="0627efe6a869c81774f7725c2ed67470672ce38167aa09354ebcbbec573e1c17"
Sep 09 14:41:35.594656 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.594634    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:41:35.708263 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.708236    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3869a2b6-b582-4256-949e-08457b3f98c7-istiod-ca-cert\") pod \"3869a2b6-b582-4256-949e-08457b3f98c7\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") "
Sep 09 14:41:35.708431 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.708276    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-credential-socket\") pod \"3869a2b6-b582-4256-949e-08457b3f98c7\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") "
Sep 09 14:41:35.708431 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.708302    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2g8v\" (UniqueName: \"kubernetes.io/projected/3869a2b6-b582-4256-949e-08457b3f98c7-kube-api-access-q2g8v\") pod \"3869a2b6-b582-4256-949e-08457b3f98c7\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") "
Sep 09 14:41:35.708558 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.708463    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-workload-socket\") pod \"3869a2b6-b582-4256-949e-08457b3f98c7\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") "
Sep 09 14:41:35.708558 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.708512    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-istio-envoy\") pod \"3869a2b6-b582-4256-949e-08457b3f98c7\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") "
Sep 09 14:41:35.708558 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.708540    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3869a2b6-b582-4256-949e-08457b3f98c7-istio-token\") pod \"3869a2b6-b582-4256-949e-08457b3f98c7\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") "
Sep 09 14:41:35.708558 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.708560    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-istio-data\") pod \"3869a2b6-b582-4256-949e-08457b3f98c7\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") "
Sep 09 14:41:35.708809 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.708589    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3869a2b6-b582-4256-949e-08457b3f98c7" (UID: "3869a2b6-b582-4256-949e-08457b3f98c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:41:35.708809 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.708611    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3869a2b6-b582-4256-949e-08457b3f98c7-istio-podinfo\") pod \"3869a2b6-b582-4256-949e-08457b3f98c7\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") "
Sep 09 14:41:35.708809 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.708647    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3869a2b6-b582-4256-949e-08457b3f98c7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3869a2b6-b582-4256-949e-08457b3f98c7" (UID: "3869a2b6-b582-4256-949e-08457b3f98c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:41:35.708809 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.708666    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-workload-certs\") pod \"3869a2b6-b582-4256-949e-08457b3f98c7\" (UID: \"3869a2b6-b582-4256-949e-08457b3f98c7\") "
Sep 09 14:41:35.708809 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.708722    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3869a2b6-b582-4256-949e-08457b3f98c7" (UID: "3869a2b6-b582-4256-949e-08457b3f98c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:41:35.709083 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.708883    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-istio-data" (OuterVolumeSpecName: "istio-data") pod "3869a2b6-b582-4256-949e-08457b3f98c7" (UID: "3869a2b6-b582-4256-949e-08457b3f98c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:41:35.709083 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.708930    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3869a2b6-b582-4256-949e-08457b3f98c7" (UID: "3869a2b6-b582-4256-949e-08457b3f98c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:41:35.709083 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.709031    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-istio-data\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:41:35.709083 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.709050    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-workload-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:41:35.709083 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.709064    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3869a2b6-b582-4256-949e-08457b3f98c7-istiod-ca-cert\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:41:35.709083 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.709076    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-credential-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:41:35.709337 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.709090    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-workload-socket\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:41:35.710664 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.710633    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3869a2b6-b582-4256-949e-08457b3f98c7-kube-api-access-q2g8v" (OuterVolumeSpecName: "kube-api-access-q2g8v") pod "3869a2b6-b582-4256-949e-08457b3f98c7" (UID: "3869a2b6-b582-4256-949e-08457b3f98c7"). InnerVolumeSpecName "kube-api-access-q2g8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:41:35.710778 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.710688    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3869a2b6-b582-4256-949e-08457b3f98c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "3869a2b6-b582-4256-949e-08457b3f98c7" (UID: "3869a2b6-b582-4256-949e-08457b3f98c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:41:35.711053 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.711024    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3869a2b6-b582-4256-949e-08457b3f98c7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3869a2b6-b582-4256-949e-08457b3f98c7" (UID: "3869a2b6-b582-4256-949e-08457b3f98c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:41:35.711053 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.711028    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3869a2b6-b582-4256-949e-08457b3f98c7" (UID: "3869a2b6-b582-4256-949e-08457b3f98c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:41:35.810040 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.810019    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3869a2b6-b582-4256-949e-08457b3f98c7-istio-envoy\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:41:35.810040 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.810039    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3869a2b6-b582-4256-949e-08457b3f98c7-istio-token\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:41:35.810272 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.810048    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3869a2b6-b582-4256-949e-08457b3f98c7-istio-podinfo\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:41:35.810272 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:35.810056    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2g8v\" (UniqueName: \"kubernetes.io/projected/3869a2b6-b582-4256-949e-08457b3f98c7-kube-api-access-q2g8v\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:41:36.480967 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:36.480938    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"
Sep 09 14:41:36.480967 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:36.480961    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp" event={"ID":"3869a2b6-b582-4256-949e-08457b3f98c7","Type":"ContainerDied","Data":"457661b7b7b0f5d45115f3bee9f825c2da6f777ffb94882cfd77736a72885260"}
Sep 09 14:41:36.481520 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:36.481013    2553 scope.go:117] "RemoveContainer" containerID="e97af55f1f53b678e6d3a36660dc7d122ceb104e8e62bd065752dd6636c88abc"
Sep 09 14:41:36.509475 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:36.509439    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"]
Sep 09 14:41:36.509639 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:36.509494    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-c5e2d3-openshift-default-f648d5cb6-4mmpp"]
Sep 09 14:41:37.645178 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:41:37.645142    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3869a2b6-b582-4256-949e-08457b3f98c7" path="/var/lib/kubelet/pods/3869a2b6-b582-4256-949e-08457b3f98c7/volumes"
Sep 09 14:42:57.496529 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:42:57.496485    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:43:26.186687 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:43:26.186652    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:43:33.996105 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:43:33.996066    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:43:40.996350 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:43:40.996309    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:43:48.389430 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:43:48.389334    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:44:02.690299 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:44:02.690257    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:44:10.994627 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:44:10.994581    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:45:41.493916 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:45:41.493877    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:45:47.991510 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:45:47.991474    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:45:55.704733 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:45:55.704701    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:46:13.198166 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:46:13.198128    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:46:51.089481 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:46:51.089397    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:47:00.293954 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:00.293917    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:47:06.995787 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:06.995746    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-85cbb79749-66pds"]
Sep 09 14:47:06.996236 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:06.996214    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="743d402a-e905-4201-b15c-120153f353e0" containerName="revoke-keys"
Sep 09 14:47:06.996285 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:06.996242    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="743d402a-e905-4201-b15c-120153f353e0" containerName="revoke-keys"
Sep 09 14:47:06.996285 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:06.996258    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3869a2b6-b582-4256-949e-08457b3f98c7" containerName="istio-proxy"
Sep 09 14:47:06.996285 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:06.996268    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3869a2b6-b582-4256-949e-08457b3f98c7" containerName="istio-proxy"
Sep 09 14:47:06.996381 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:06.996305    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3869a2b6-b582-4256-949e-08457b3f98c7" containerName="istio-proxy"
Sep 09 14:47:06.996381 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:06.996315    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3869a2b6-b582-4256-949e-08457b3f98c7" containerName="istio-proxy"
Sep 09 14:47:06.996448 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:06.996401    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="743d402a-e905-4201-b15c-120153f353e0" containerName="revoke-keys"
Sep 09 14:47:06.996448 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:06.996415    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eddeea7-0253-4f87-90b7-b51b81bd147d" containerName="istio-proxy"
Sep 09 14:47:06.996448 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:06.996427    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="3869a2b6-b582-4256-949e-08457b3f98c7" containerName="istio-proxy"
Sep 09 14:47:06.996448 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:06.996436    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="3869a2b6-b582-4256-949e-08457b3f98c7" containerName="istio-proxy"
Sep 09 14:47:06.999668 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:06.999651    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:07.001988 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.001966    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 14:47:07.002288 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.002266    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:47:07.002374 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.002357    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 14:47:07.002488 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.002470    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fkrmg\""
Sep 09 14:47:07.002628 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.002610    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 14:47:07.009178 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.009158    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cbb79749-66pds"]
Sep 09 14:47:07.064133 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.064104    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bba7509-167e-49ba-832a-99685c2736d0-metrics-certs\") pod \"maas-api-85cbb79749-66pds\" (UID: \"9bba7509-167e-49ba-832a-99685c2736d0\") " pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:07.064133 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.064138    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bba7509-167e-49ba-832a-99685c2736d0-maas-api-tls\") pod \"maas-api-85cbb79749-66pds\" (UID: \"9bba7509-167e-49ba-832a-99685c2736d0\") " pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:07.064351 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.064188    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mlb5\" (UniqueName: \"kubernetes.io/projected/9bba7509-167e-49ba-832a-99685c2736d0-kube-api-access-8mlb5\") pod \"maas-api-85cbb79749-66pds\" (UID: \"9bba7509-167e-49ba-832a-99685c2736d0\") " pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:07.064351 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.064214    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bba7509-167e-49ba-832a-99685c2736d0-openshift-service-ca\") pod \"maas-api-85cbb79749-66pds\" (UID: \"9bba7509-167e-49ba-832a-99685c2736d0\") " pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:07.094056 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.094022    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:47:07.164906 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.164874    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mlb5\" (UniqueName: \"kubernetes.io/projected/9bba7509-167e-49ba-832a-99685c2736d0-kube-api-access-8mlb5\") pod \"maas-api-85cbb79749-66pds\" (UID: \"9bba7509-167e-49ba-832a-99685c2736d0\") " pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:07.165059 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.164914    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bba7509-167e-49ba-832a-99685c2736d0-openshift-service-ca\") pod \"maas-api-85cbb79749-66pds\" (UID: \"9bba7509-167e-49ba-832a-99685c2736d0\") " pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:07.165119 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.165092    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bba7509-167e-49ba-832a-99685c2736d0-metrics-certs\") pod \"maas-api-85cbb79749-66pds\" (UID: \"9bba7509-167e-49ba-832a-99685c2736d0\") " pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:07.165175 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.165128    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bba7509-167e-49ba-832a-99685c2736d0-maas-api-tls\") pod \"maas-api-85cbb79749-66pds\" (UID: \"9bba7509-167e-49ba-832a-99685c2736d0\") " pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:07.165712 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.165673    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bba7509-167e-49ba-832a-99685c2736d0-openshift-service-ca\") pod \"maas-api-85cbb79749-66pds\" (UID: \"9bba7509-167e-49ba-832a-99685c2736d0\") " pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:07.167605 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.167580    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bba7509-167e-49ba-832a-99685c2736d0-maas-api-tls\") pod \"maas-api-85cbb79749-66pds\" (UID: \"9bba7509-167e-49ba-832a-99685c2736d0\") " pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:07.167693 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.167589    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bba7509-167e-49ba-832a-99685c2736d0-metrics-certs\") pod \"maas-api-85cbb79749-66pds\" (UID: \"9bba7509-167e-49ba-832a-99685c2736d0\") " pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:07.172037 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.172013    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mlb5\" (UniqueName: \"kubernetes.io/projected/9bba7509-167e-49ba-832a-99685c2736d0-kube-api-access-8mlb5\") pod \"maas-api-85cbb79749-66pds\" (UID: \"9bba7509-167e-49ba-832a-99685c2736d0\") " pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:07.312137 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.312059    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:07.583149 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.583117    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cbb79749-66pds"]
Sep 09 14:47:07.585240 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:47:07.585203    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bba7509_167e_49ba_832a_99685c2736d0.slice/crio-c5a0c58372666aebb5599736103a690e4d390c97c6909b03abf636b0f9418f23 WatchSource:0}: Error finding container c5a0c58372666aebb5599736103a690e4d390c97c6909b03abf636b0f9418f23: Status 404 returned error can't find the container with id c5a0c58372666aebb5599736103a690e4d390c97c6909b03abf636b0f9418f23
Sep 09 14:47:07.586576 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:07.586548    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 14:47:08.026938 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:08.026909    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds" event={"ID":"9bba7509-167e-49ba-832a-99685c2736d0","Type":"ContainerStarted","Data":"c5a0c58372666aebb5599736103a690e4d390c97c6909b03abf636b0f9418f23"}
Sep 09 14:47:09.034785 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:09.034748    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds" event={"ID":"9bba7509-167e-49ba-832a-99685c2736d0","Type":"ContainerStarted","Data":"808d489ffb9430158ab07f637f20ce3fccde9bd696921c8dbe19c72b53f2739c"}
Sep 09 14:47:09.035162 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:09.034833    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:09.051657 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:09.051611    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds" podStartSLOduration=2.488785242 podStartE2EDuration="3.051596758s" totalImagesPullingTime="562.811516ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:47:09.05067243 +0000 UTC m=+2179.854655438" watchObservedRunningTime="2026-09-09 14:47:09.051596758 +0000 UTC m=+2179.855579760"
Sep 09 14:47:14.190870 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:14.190831    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:47:15.045134 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:15.045105    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:16.813727 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:16.813691    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"]
Sep 09 14:47:16.817078 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:16.817060    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"
Sep 09 14:47:16.827854 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:16.827828    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"]
Sep 09 14:47:16.939510 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:16.939476    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da3745c6-48b5-4f89-a72e-c6821f659a29-maas-api-tls\") pod \"maas-api-6fcbb6857c-xcnzm\" (UID: \"da3745c6-48b5-4f89-a72e-c6821f659a29\") " pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"
Sep 09 14:47:16.939510 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:16.939512    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da3745c6-48b5-4f89-a72e-c6821f659a29-openshift-service-ca\") pod \"maas-api-6fcbb6857c-xcnzm\" (UID: \"da3745c6-48b5-4f89-a72e-c6821f659a29\") " pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"
Sep 09 14:47:16.939719 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:16.939537    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da3745c6-48b5-4f89-a72e-c6821f659a29-metrics-certs\") pod \"maas-api-6fcbb6857c-xcnzm\" (UID: \"da3745c6-48b5-4f89-a72e-c6821f659a29\") " pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"
Sep 09 14:47:16.939719 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:16.939638    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54dxd\" (UniqueName: \"kubernetes.io/projected/da3745c6-48b5-4f89-a72e-c6821f659a29-kube-api-access-54dxd\") pod \"maas-api-6fcbb6857c-xcnzm\" (UID: \"da3745c6-48b5-4f89-a72e-c6821f659a29\") " pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"
Sep 09 14:47:17.040639 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:17.040602    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54dxd\" (UniqueName: \"kubernetes.io/projected/da3745c6-48b5-4f89-a72e-c6821f659a29-kube-api-access-54dxd\") pod \"maas-api-6fcbb6857c-xcnzm\" (UID: \"da3745c6-48b5-4f89-a72e-c6821f659a29\") " pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"
Sep 09 14:47:17.040829 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:17.040703    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da3745c6-48b5-4f89-a72e-c6821f659a29-maas-api-tls\") pod \"maas-api-6fcbb6857c-xcnzm\" (UID: \"da3745c6-48b5-4f89-a72e-c6821f659a29\") " pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"
Sep 09 14:47:17.040829 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:17.040732    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da3745c6-48b5-4f89-a72e-c6821f659a29-openshift-service-ca\") pod \"maas-api-6fcbb6857c-xcnzm\" (UID: \"da3745c6-48b5-4f89-a72e-c6821f659a29\") " pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"
Sep 09 14:47:17.040829 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:17.040756    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da3745c6-48b5-4f89-a72e-c6821f659a29-metrics-certs\") pod \"maas-api-6fcbb6857c-xcnzm\" (UID: \"da3745c6-48b5-4f89-a72e-c6821f659a29\") " pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"
Sep 09 14:47:17.041414 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:17.041384    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da3745c6-48b5-4f89-a72e-c6821f659a29-openshift-service-ca\") pod \"maas-api-6fcbb6857c-xcnzm\" (UID: \"da3745c6-48b5-4f89-a72e-c6821f659a29\") " pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"
Sep 09 14:47:17.043191 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:17.043173    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da3745c6-48b5-4f89-a72e-c6821f659a29-metrics-certs\") pod \"maas-api-6fcbb6857c-xcnzm\" (UID: \"da3745c6-48b5-4f89-a72e-c6821f659a29\") " pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"
Sep 09 14:47:17.043263 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:17.043231    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da3745c6-48b5-4f89-a72e-c6821f659a29-maas-api-tls\") pod \"maas-api-6fcbb6857c-xcnzm\" (UID: \"da3745c6-48b5-4f89-a72e-c6821f659a29\") " pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"
Sep 09 14:47:17.048606 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:17.048578    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54dxd\" (UniqueName: \"kubernetes.io/projected/da3745c6-48b5-4f89-a72e-c6821f659a29-kube-api-access-54dxd\") pod \"maas-api-6fcbb6857c-xcnzm\" (UID: \"da3745c6-48b5-4f89-a72e-c6821f659a29\") " pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"
Sep 09 14:47:17.128139 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:17.128072    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"
Sep 09 14:47:17.398509 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:17.398484    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"]
Sep 09 14:47:17.400540 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:47:17.400510    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda3745c6_48b5_4f89_a72e_c6821f659a29.slice/crio-2dc988ab6aa1b4fe2115e65a7ddc68157bf704ab5c0908143f47b5f3837e769b WatchSource:0}: Error finding container 2dc988ab6aa1b4fe2115e65a7ddc68157bf704ab5c0908143f47b5f3837e769b: Status 404 returned error can't find the container with id 2dc988ab6aa1b4fe2115e65a7ddc68157bf704ab5c0908143f47b5f3837e769b
Sep 09 14:47:18.083696 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:18.083620    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm" event={"ID":"da3745c6-48b5-4f89-a72e-c6821f659a29","Type":"ContainerStarted","Data":"983f76f57369a56cec651fd42c8c6037b2b4fcb29f5072bba475a1bb60254379"}
Sep 09 14:47:18.083696 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:18.083684    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm" event={"ID":"da3745c6-48b5-4f89-a72e-c6821f659a29","Type":"ContainerStarted","Data":"2dc988ab6aa1b4fe2115e65a7ddc68157bf704ab5c0908143f47b5f3837e769b"}
Sep 09 14:47:18.084102 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:18.083706    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"
Sep 09 14:47:18.101524 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:18.101477    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm" podStartSLOduration=1.764405744 podStartE2EDuration="2.101460705s" totalImagesPullingTime="337.054961ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:47:18.100309805 +0000 UTC m=+2188.904292811" watchObservedRunningTime="2026-09-09 14:47:18.101460705 +0000 UTC m=+2188.905443708"
Sep 09 14:47:21.192733 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:21.192701    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:47:24.094377 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:24.094347    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6fcbb6857c-xcnzm"
Sep 09 14:47:24.172490 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:24.172451    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cbb79749-66pds"]
Sep 09 14:47:24.172738 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:24.172692    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds" podUID="9bba7509-167e-49ba-832a-99685c2736d0" containerName="maas-api" containerID="cri-o://808d489ffb9430158ab07f637f20ce3fccde9bd696921c8dbe19c72b53f2739c" gracePeriod=30
Sep 09 14:47:25.040529 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:25.040491    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds" podUID="9bba7509-167e-49ba-832a-99685c2736d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.61:8443/health\": dial tcp 10.133.0.61:8443: connect: connection refused"
Sep 09 14:47:25.416168 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:25.416144    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:25.508809 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:25.508776    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bba7509-167e-49ba-832a-99685c2736d0-maas-api-tls\") pod \"9bba7509-167e-49ba-832a-99685c2736d0\" (UID: \"9bba7509-167e-49ba-832a-99685c2736d0\") "
Sep 09 14:47:25.508976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:25.508817    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bba7509-167e-49ba-832a-99685c2736d0-openshift-service-ca\") pod \"9bba7509-167e-49ba-832a-99685c2736d0\" (UID: \"9bba7509-167e-49ba-832a-99685c2736d0\") "
Sep 09 14:47:25.508976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:25.508849    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mlb5\" (UniqueName: \"kubernetes.io/projected/9bba7509-167e-49ba-832a-99685c2736d0-kube-api-access-8mlb5\") pod \"9bba7509-167e-49ba-832a-99685c2736d0\" (UID: \"9bba7509-167e-49ba-832a-99685c2736d0\") "
Sep 09 14:47:25.508976 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:25.508886    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bba7509-167e-49ba-832a-99685c2736d0-metrics-certs\") pod \"9bba7509-167e-49ba-832a-99685c2736d0\" (UID: \"9bba7509-167e-49ba-832a-99685c2736d0\") "
Sep 09 14:47:25.509203 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:25.509175    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bba7509-167e-49ba-832a-99685c2736d0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9bba7509-167e-49ba-832a-99685c2736d0" (UID: "9bba7509-167e-49ba-832a-99685c2736d0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:47:25.510914 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:25.510881    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bba7509-167e-49ba-832a-99685c2736d0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9bba7509-167e-49ba-832a-99685c2736d0" (UID: "9bba7509-167e-49ba-832a-99685c2736d0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:47:25.511014 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:25.510944    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bba7509-167e-49ba-832a-99685c2736d0-kube-api-access-8mlb5" (OuterVolumeSpecName: "kube-api-access-8mlb5") pod "9bba7509-167e-49ba-832a-99685c2736d0" (UID: "9bba7509-167e-49ba-832a-99685c2736d0"). InnerVolumeSpecName "kube-api-access-8mlb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:47:25.511014 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:25.510962    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bba7509-167e-49ba-832a-99685c2736d0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9bba7509-167e-49ba-832a-99685c2736d0" (UID: "9bba7509-167e-49ba-832a-99685c2736d0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:47:25.609837 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:25.609776    2553 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bba7509-167e-49ba-832a-99685c2736d0-metrics-certs\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:47:25.609837 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:25.609801    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bba7509-167e-49ba-832a-99685c2736d0-maas-api-tls\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:47:25.609837 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:25.609812    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bba7509-167e-49ba-832a-99685c2736d0-openshift-service-ca\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:47:25.609837 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:25.609820    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mlb5\" (UniqueName: \"kubernetes.io/projected/9bba7509-167e-49ba-832a-99685c2736d0-kube-api-access-8mlb5\") on node \"ip-10-0-142-209.ec2.internal\" DevicePath \"\""
Sep 09 14:47:26.123097 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:26.123051    2553 generic.go:356] "Generic (PLEG): container finished" podID="9bba7509-167e-49ba-832a-99685c2736d0" containerID="808d489ffb9430158ab07f637f20ce3fccde9bd696921c8dbe19c72b53f2739c" exitCode=0
Sep 09 14:47:26.123097 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:26.123099    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds"
Sep 09 14:47:26.123313 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:26.123136    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds" event={"ID":"9bba7509-167e-49ba-832a-99685c2736d0","Type":"ContainerDied","Data":"808d489ffb9430158ab07f637f20ce3fccde9bd696921c8dbe19c72b53f2739c"}
Sep 09 14:47:26.123313 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:26.123188    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85cbb79749-66pds" event={"ID":"9bba7509-167e-49ba-832a-99685c2736d0","Type":"ContainerDied","Data":"c5a0c58372666aebb5599736103a690e4d390c97c6909b03abf636b0f9418f23"}
Sep 09 14:47:26.123313 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:26.123212    2553 scope.go:117] "RemoveContainer" containerID="808d489ffb9430158ab07f637f20ce3fccde9bd696921c8dbe19c72b53f2739c"
Sep 09 14:47:26.132118 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:26.132103    2553 scope.go:117] "RemoveContainer" containerID="808d489ffb9430158ab07f637f20ce3fccde9bd696921c8dbe19c72b53f2739c"
Sep 09 14:47:26.132376 ip-10-0-142-209 kubenswrapper[2553]: E0909 14:47:26.132355    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"808d489ffb9430158ab07f637f20ce3fccde9bd696921c8dbe19c72b53f2739c\": container with ID starting with 808d489ffb9430158ab07f637f20ce3fccde9bd696921c8dbe19c72b53f2739c not found: ID does not exist" containerID="808d489ffb9430158ab07f637f20ce3fccde9bd696921c8dbe19c72b53f2739c"
Sep 09 14:47:26.132443 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:26.132384    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"808d489ffb9430158ab07f637f20ce3fccde9bd696921c8dbe19c72b53f2739c"} err="failed to get container status \"808d489ffb9430158ab07f637f20ce3fccde9bd696921c8dbe19c72b53f2739c\": rpc error: code = NotFound desc = could not find container \"808d489ffb9430158ab07f637f20ce3fccde9bd696921c8dbe19c72b53f2739c\": container with ID starting with 808d489ffb9430158ab07f637f20ce3fccde9bd696921c8dbe19c72b53f2739c not found: ID does not exist"
Sep 09 14:47:26.139691 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:26.139669    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cbb79749-66pds"]
Sep 09 14:47:26.141426 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:26.141408    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cbb79749-66pds"]
Sep 09 14:47:26.695539 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:26.695503    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:47:27.645654 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:27.645622    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bba7509-167e-49ba-832a-99685c2736d0" path="/var/lib/kubelet/pods/9bba7509-167e-49ba-832a-99685c2736d0/volumes"
Sep 09 14:47:33.791402 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:33.791366    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-gnvxp"]
Sep 09 14:47:42.742250 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:42.742215    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dk6hd_c1e6084f-74a6-4dde-9d52-2540ef6c85f1/manager/0.log"
Sep 09 14:47:42.991678 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:42.991650    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-686db84dc8-rl28t_7f968c7a-a31e-4e9d-b89f-5060e272709b/copy-manifests/0.log"
Sep 09 14:47:42.998052 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:42.997992    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-686db84dc8-rl28t_7f968c7a-a31e-4e9d-b89f-5060e272709b/manager/0.log"
Sep 09 14:47:43.622418 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:43.622389    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6fcbb6857c-xcnzm_da3745c6-48b5-4f89-a72e-c6821f659a29/maas-api/0.log"
Sep 09 14:47:44.904809 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:44.904781    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-kjsx2_0e48fba4-a267-409b-9e44-a06f9154b27c/manager/0.log"
Sep 09 14:47:45.023939 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:45.023912    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-mtq74_8d5a5f4d-6fc6-4d9c-95c7-0c1087a67855/manager/0.log"
Sep 09 14:47:45.380239 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:45.380206    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-gnvxp_d0d0473b-1e2a-468b-a1a7-e135322e1c21/limitador/0.log"
Sep 09 14:47:45.490837 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:45.490801    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-k4kt5_b89e443d-ac50-4d31-99c5-c5e9edeb6fa8/manager/0.log"
Sep 09 14:47:45.963890 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:45.963856    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s6dgs_7e398827-7da0-4b1c-aeef-f87d4237a426/discovery/0.log"
Sep 09 14:47:46.193302 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:46.193271    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dd84d6f45-tskfn_bb6c11bd-3304-43ed-8f01-c9cd8f701cb2/kube-auth-proxy/0.log"
Sep 09 14:47:47.127918 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:47.127890    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-44xsc_b8ce69fd-467f-4df4-a38c-0005975a7628/main/0.log"
Sep 09 14:47:47.235072 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:47.235039    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-pppfp_7bd5bf3c-10e7-4e9d-a155-76384ad6cb10/main/0.log"
Sep 09 14:47:47.578591 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:47.578542    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-xxckq_0530bd95-8d3a-4d96-9b6c-672900e7ac3c/main/0.log"
Sep 09 14:47:49.958744 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:49.958714    2553 scope.go:117] "RemoveContainer" containerID="dca4c37a4f863e48086cfaed2d88c71351de4d3afe5481edc2d07abbd85ea003"
Sep 09 14:47:56.268467 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:56.268437    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-22vlz_07b89a46-bf5c-4842-976f-ff7830f1c2ae/global-pull-secret-syncer/0.log"
Sep 09 14:47:56.418978 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:56.418939    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lp4m6_4f28d3ef-366f-4ea4-9f4d-faf5cb7b22a7/konnectivity-agent/0.log"
Sep 09 14:47:56.520085 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:47:56.519987    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-209.ec2.internal_41fcb2aaf86bde291d1277e410f2d123/haproxy/0.log"
Sep 09 14:48:01.529582 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:01.529530    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-kjsx2_0e48fba4-a267-409b-9e44-a06f9154b27c/manager/0.log"
Sep 09 14:48:01.564378 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:01.564352    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-mtq74_8d5a5f4d-6fc6-4d9c-95c7-0c1087a67855/manager/0.log"
Sep 09 14:48:01.687902 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:01.687873    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-gnvxp_d0d0473b-1e2a-468b-a1a7-e135322e1c21/limitador/0.log"
Sep 09 14:48:01.742087 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:01.742057    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-k4kt5_b89e443d-ac50-4d31-99c5-c5e9edeb6fa8/manager/0.log"
Sep 09 14:48:03.821926 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:03.821897    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c8vkw_388f24a1-da1a-4e04-96a2-9e4d9df31b2f/node-exporter/0.log"
Sep 09 14:48:03.839119 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:03.839098    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c8vkw_388f24a1-da1a-4e04-96a2-9e4d9df31b2f/kube-rbac-proxy/0.log"
Sep 09 14:48:03.858514 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:03.858496    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c8vkw_388f24a1-da1a-4e04-96a2-9e4d9df31b2f/init-textfile/0.log"
Sep 09 14:48:05.585253 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:05.585222    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-m5l72_7528c2f1-cc40-4f51-8c38-5b5e26a41df1/networking-console-plugin/0.log"
Sep 09 14:48:05.851624 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:05.851527    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"]
Sep 09 14:48:05.851912 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:05.851895    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bba7509-167e-49ba-832a-99685c2736d0" containerName="maas-api"
Sep 09 14:48:05.851975 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:05.851916    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bba7509-167e-49ba-832a-99685c2736d0" containerName="maas-api"
Sep 09 14:48:05.852035 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:05.851990    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bba7509-167e-49ba-832a-99685c2736d0" containerName="maas-api"
Sep 09 14:48:05.854913 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:05.854894    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:05.857151 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:05.857130    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tq4f9\"/\"kube-root-ca.crt\""
Sep 09 14:48:05.857860 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:05.857844    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tq4f9\"/\"openshift-service-ca.crt\""
Sep 09 14:48:05.857860 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:05.857852    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tq4f9\"/\"default-dockercfg-4q82f\""
Sep 09 14:48:05.865453 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:05.865431    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"]
Sep 09 14:48:05.932254 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:05.932222    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d9223bb-cdea-404f-8430-d0ce10bc297a-proc\") pod \"perf-node-gather-daemonset-v5xvt\" (UID: \"0d9223bb-cdea-404f-8430-d0ce10bc297a\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:05.932421 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:05.932258    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d9223bb-cdea-404f-8430-d0ce10bc297a-podres\") pod \"perf-node-gather-daemonset-v5xvt\" (UID: \"0d9223bb-cdea-404f-8430-d0ce10bc297a\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:05.932421 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:05.932289    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d9223bb-cdea-404f-8430-d0ce10bc297a-lib-modules\") pod \"perf-node-gather-daemonset-v5xvt\" (UID: \"0d9223bb-cdea-404f-8430-d0ce10bc297a\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:05.932421 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:05.932359    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d9223bb-cdea-404f-8430-d0ce10bc297a-sys\") pod \"perf-node-gather-daemonset-v5xvt\" (UID: \"0d9223bb-cdea-404f-8430-d0ce10bc297a\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:05.932558 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:05.932422    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6nfp\" (UniqueName: \"kubernetes.io/projected/0d9223bb-cdea-404f-8430-d0ce10bc297a-kube-api-access-w6nfp\") pod \"perf-node-gather-daemonset-v5xvt\" (UID: \"0d9223bb-cdea-404f-8430-d0ce10bc297a\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:06.032943 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:06.032908    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d9223bb-cdea-404f-8430-d0ce10bc297a-proc\") pod \"perf-node-gather-daemonset-v5xvt\" (UID: \"0d9223bb-cdea-404f-8430-d0ce10bc297a\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:06.032943 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:06.032943    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d9223bb-cdea-404f-8430-d0ce10bc297a-podres\") pod \"perf-node-gather-daemonset-v5xvt\" (UID: \"0d9223bb-cdea-404f-8430-d0ce10bc297a\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:06.033334 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:06.032967    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d9223bb-cdea-404f-8430-d0ce10bc297a-lib-modules\") pod \"perf-node-gather-daemonset-v5xvt\" (UID: \"0d9223bb-cdea-404f-8430-d0ce10bc297a\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:06.033334 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:06.033003    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d9223bb-cdea-404f-8430-d0ce10bc297a-sys\") pod \"perf-node-gather-daemonset-v5xvt\" (UID: \"0d9223bb-cdea-404f-8430-d0ce10bc297a\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:06.033334 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:06.033036    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d9223bb-cdea-404f-8430-d0ce10bc297a-proc\") pod \"perf-node-gather-daemonset-v5xvt\" (UID: \"0d9223bb-cdea-404f-8430-d0ce10bc297a\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:06.033334 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:06.033061    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6nfp\" (UniqueName: \"kubernetes.io/projected/0d9223bb-cdea-404f-8430-d0ce10bc297a-kube-api-access-w6nfp\") pod \"perf-node-gather-daemonset-v5xvt\" (UID: \"0d9223bb-cdea-404f-8430-d0ce10bc297a\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:06.033334 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:06.033101    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d9223bb-cdea-404f-8430-d0ce10bc297a-podres\") pod \"perf-node-gather-daemonset-v5xvt\" (UID: \"0d9223bb-cdea-404f-8430-d0ce10bc297a\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:06.033334 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:06.033103    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d9223bb-cdea-404f-8430-d0ce10bc297a-lib-modules\") pod \"perf-node-gather-daemonset-v5xvt\" (UID: \"0d9223bb-cdea-404f-8430-d0ce10bc297a\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:06.033334 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:06.033103    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d9223bb-cdea-404f-8430-d0ce10bc297a-sys\") pod \"perf-node-gather-daemonset-v5xvt\" (UID: \"0d9223bb-cdea-404f-8430-d0ce10bc297a\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:06.040658 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:06.040626    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6nfp\" (UniqueName: \"kubernetes.io/projected/0d9223bb-cdea-404f-8430-d0ce10bc297a-kube-api-access-w6nfp\") pod \"perf-node-gather-daemonset-v5xvt\" (UID: \"0d9223bb-cdea-404f-8430-d0ce10bc297a\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:06.166215 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:06.166134    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:06.437328 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:06.437304    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"]
Sep 09 14:48:06.439149 ip-10-0-142-209 kubenswrapper[2553]: W0909 14:48:06.439112    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0d9223bb_cdea_404f_8430_d0ce10bc297a.slice/crio-6cd6bc615ed2e9d36ee5bb53df02fbfb7d67a897822527c6e7a605477013baeb WatchSource:0}: Error finding container 6cd6bc615ed2e9d36ee5bb53df02fbfb7d67a897822527c6e7a605477013baeb: Status 404 returned error can't find the container with id 6cd6bc615ed2e9d36ee5bb53df02fbfb7d67a897822527c6e7a605477013baeb
Sep 09 14:48:07.328768 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:07.328731    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt" event={"ID":"0d9223bb-cdea-404f-8430-d0ce10bc297a","Type":"ContainerStarted","Data":"9615f815953482c0bd440ca7b037eac9c1d13b5b4c1aba470c69ae4e82597a36"}
Sep 09 14:48:07.329150 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:07.328791    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt" event={"ID":"0d9223bb-cdea-404f-8430-d0ce10bc297a","Type":"ContainerStarted","Data":"6cd6bc615ed2e9d36ee5bb53df02fbfb7d67a897822527c6e7a605477013baeb"}
Sep 09 14:48:07.329150 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:07.328817    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:07.343292 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:07.343245    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt" podStartSLOduration=2.343228581 podStartE2EDuration="2.343228581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:48:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:48:07.34287704 +0000 UTC m=+2238.146860044" watchObservedRunningTime="2026-09-09 14:48:07.343228581 +0000 UTC m=+2238.147211584"
Sep 09 14:48:08.477228 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:08.477194    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5n2ks_66ef8b31-2920-406a-84e8-ae1bb4cafa6b/dns/0.log"
Sep 09 14:48:08.511068 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:08.511044    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5n2ks_66ef8b31-2920-406a-84e8-ae1bb4cafa6b/kube-rbac-proxy/0.log"
Sep 09 14:48:08.643893 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:08.643866    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ldbss_0256961f-5a7f-4e42-b718-e430e65924fd/dns-node-resolver/0.log"
Sep 09 14:48:09.198920 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:09.198890    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5c5b5f6b4c-5fmdx_db783625-a7df-4aba-ad3a-3674d91f7807/registry/0.log"
Sep 09 14:48:09.306807 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:09.306779    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ww47d_7073d92b-77ab-46c2-98bd-ac827126c826/node-ca/0.log"
Sep 09 14:48:10.440221 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:10.440191    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s6dgs_7e398827-7da0-4b1c-aeef-f87d4237a426/discovery/0.log"
Sep 09 14:48:10.487876 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:10.487846    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dd84d6f45-tskfn_bb6c11bd-3304-43ed-8f01-c9cd8f701cb2/kube-auth-proxy/0.log"
Sep 09 14:48:11.457768 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:11.457739    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8frzt_6f9fbd6c-2e65-4700-a07c-2bf711bfab95/serve-healthcheck-canary/0.log"
Sep 09 14:48:12.207788 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:12.207713    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l4clj_19db262e-77ea-42bd-9c60-5589d939149c/kube-rbac-proxy/0.log"
Sep 09 14:48:12.225514 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:12.225492    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l4clj_19db262e-77ea-42bd-9c60-5589d939149c/exporter/0.log"
Sep 09 14:48:12.244536 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:12.244515    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l4clj_19db262e-77ea-42bd-9c60-5589d939149c/extractor/0.log"
Sep 09 14:48:13.342398 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:13.342372    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-v5xvt"
Sep 09 14:48:14.842199 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:14.842174    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dk6hd_c1e6084f-74a6-4dde-9d52-2540ef6c85f1/manager/0.log"
Sep 09 14:48:14.916159 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:14.916130    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-686db84dc8-rl28t_7f968c7a-a31e-4e9d-b89f-5060e272709b/manager/0.log"
Sep 09 14:48:14.939067 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:14.939044    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-686db84dc8-rl28t_7f968c7a-a31e-4e9d-b89f-5060e272709b/copy-manifests/0.log"
Sep 09 14:48:16.420040 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:16.420011    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vdpwf_fccf0af8-0396-417d-9006-6489beddc585/openshift-lws-operator/0.log"
Sep 09 14:48:16.440634 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:16.440614    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s6dgs_7e398827-7da0-4b1c-aeef-f87d4237a426/discovery/0.log"
Sep 09 14:48:16.473136 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:16.473115    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dd84d6f45-tskfn_bb6c11bd-3304-43ed-8f01-c9cd8f701cb2/kube-auth-proxy/0.log"
Sep 09 14:48:18.218840 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:18.218810    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s6dgs_7e398827-7da0-4b1c-aeef-f87d4237a426/discovery/0.log"
Sep 09 14:48:18.254691 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:18.254664    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dd84d6f45-tskfn_bb6c11bd-3304-43ed-8f01-c9cd8f701cb2/kube-auth-proxy/0.log"
Sep 09 14:48:22.852933 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:22.852904    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wxsqq_86fae8d0-b7af-4df3-98d0-ebb2719ecdbd/kube-multus-additional-cni-plugins/0.log"
Sep 09 14:48:22.872055 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:22.872025    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wxsqq_86fae8d0-b7af-4df3-98d0-ebb2719ecdbd/egress-router-binary-copy/0.log"
Sep 09 14:48:22.889748 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:22.889725    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wxsqq_86fae8d0-b7af-4df3-98d0-ebb2719ecdbd/cni-plugins/0.log"
Sep 09 14:48:22.906737 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:22.906719    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wxsqq_86fae8d0-b7af-4df3-98d0-ebb2719ecdbd/bond-cni-plugin/0.log"
Sep 09 14:48:22.924947 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:22.924929    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wxsqq_86fae8d0-b7af-4df3-98d0-ebb2719ecdbd/routeoverride-cni/0.log"
Sep 09 14:48:22.942757 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:22.942741    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wxsqq_86fae8d0-b7af-4df3-98d0-ebb2719ecdbd/whereabouts-cni-bincopy/0.log"
Sep 09 14:48:22.960909 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:22.960894    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wxsqq_86fae8d0-b7af-4df3-98d0-ebb2719ecdbd/whereabouts-cni/0.log"
Sep 09 14:48:23.104730 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:23.104660    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lzzk8_b9455b7b-bf7b-4b9b-bb97-0e744b913a6e/kube-multus/0.log"
Sep 09 14:48:23.124228 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:23.124201    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hgx77_464b2caf-067c-434c-ac2d-6b73c3855127/network-metrics-daemon/0.log"
Sep 09 14:48:23.140492 ip-10-0-142-209 kubenswrapper[2553]: I0909 14:48:23.140470    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hgx77_464b2caf-067c-434c-ac2d-6b73c3855127/kube-rbac-proxy/0.log"