Sep 10 23:36:39.849016 ip-10-0-139-147 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 23:36:40.281913 ip-10-0-139-147 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 23:36:40.281913 ip-10-0-139-147 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 23:36:40.281913 ip-10-0-139-147 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 23:36:40.281913 ip-10-0-139-147 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 23:36:40.281913 ip-10-0-139-147 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 23:36:40.282822 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.282735    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 23:36:40.287018 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.286996    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:36:40.287018 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287017    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:36:40.287018 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287021    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287024    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287027    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287030    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287033    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287035    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287039    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287042    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287044    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287047    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287050    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287053    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287056    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287059    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287062    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287064    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287067    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287070    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287072    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287075    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287077    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:36:40.287109 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287080    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287082    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287086    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287089    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287091    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287094    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287096    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287099    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287102    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287104    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287107    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287109    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287112    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287115    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287118    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287121    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287123    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287127    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287130    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287132    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:36:40.287653 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287134    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287137    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287140    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287142    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287145    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287148    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287150    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287152    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287155    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287158    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287160    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287162    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287165    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287167    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287171    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287174    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287176    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287179    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287181    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:36:40.288166 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287184    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287187    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287189    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287192    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287194    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287197    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287199    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287202    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287204    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287207    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287210    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287214    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287218    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287221    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287224    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287226    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287229    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287232    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287234    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:36:40.288696 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287237    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287239    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287243    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287247    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287250    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287253    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287256    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287259    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287263    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287266    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287269    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287272    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287276    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287279    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287282    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287285    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287287    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.287290    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288044    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:36:40.289451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288052    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288055    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288059    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288063    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288066    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288069    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288072    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288074    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288077    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288079    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288081    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288085    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288087    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288090    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288093    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288095    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288098    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288101    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288103    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288106    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:36:40.289995 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288109    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288113    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288117    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288120    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288123    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288126    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288128    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288131    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288134    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288136    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288139    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288142    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288144    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288146    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288149    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288152    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288154    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288156    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288159    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:36:40.290804 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288161    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288164    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288166    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288169    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288172    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288176    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288179    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288181    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288184    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288186    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288189    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288191    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288195    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288197    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288200    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288203    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288205    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288208    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288210    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288213    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:36:40.291306 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288215    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288218    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288220    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288223    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288225    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288227    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288230    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288232    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288235    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288237    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288240    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288242    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288245    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288247    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288250    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288252    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288254    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288257    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288260    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288262    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:36:40.291840 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288265    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288267    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288270    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288272    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288276    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288278    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288281    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288285    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288289    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288292    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288294    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288297    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288300    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288302    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288305    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288308    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288310    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288313    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.288316    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:36:40.292332 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290839    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290852    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290856    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290859    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290863    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290866    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290870    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290873    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290875    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290878    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290881    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290884    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290886    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290890    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290894    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290897    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290899    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290902    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290905    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:36:40.292931 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290907    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290910    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290913    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290915    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290917    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290920    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290923    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290926    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290928    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290931    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290934    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290936    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290939    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290941    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290944    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290947    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290950    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290953    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290955    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290958    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:36:40.293417 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290960    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290963    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290966    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290969    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290972    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290974    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290977    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290979    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290982    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290984    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290986    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290989    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290992    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290994    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290997    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.290999    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291001    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291004    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291007    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291009    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:36:40.293938 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291012    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291014    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291017    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291019    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291023    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291027    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291031    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291034    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291037    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291039    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291043    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291046    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291049    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291051    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291054    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291056    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291059    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291061    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291065    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:36:40.294418 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291068    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291070    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291073    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291075    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291078    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291081    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291084    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291086    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291088    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291091    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291093    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291096    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291098    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291101    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291103    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291106    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291108    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291111    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291113    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291117    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:36:40.294918 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291119    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291190    2581 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291229    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291236    2581 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291241    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291245    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291249    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291253    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291257    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291260    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291263    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291267    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291270    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291273    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291276    2581 flags.go:64] FLAG: --cgroup-root=""
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291279    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291282    2581 flags.go:64] FLAG: --client-ca-file=""
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291286    2581 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291288    2581 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291293    2581 flags.go:64] FLAG: --cluster-domain=""
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291296    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291299    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291302    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291305    2581 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 23:36:40.295399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291309    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291312    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291315    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291319    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291322    2581 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291325    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291328    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291333    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291336    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291341    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291344    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291347    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291350    2581 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291353    2581 flags.go:64] FLAG: --enable-server="true"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291356    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291360    2581 flags.go:64] FLAG: --event-burst="100"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291363    2581 flags.go:64] FLAG: --event-qps="50"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291366    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291369    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291371    2581 flags.go:64] FLAG: --eviction-hard=""
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291375    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291378    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291381    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291384    2581 flags.go:64] FLAG: --eviction-soft=""
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291387    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 23:36:40.296000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291390    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291393    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291396    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291399    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291402    2581 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291405    2581 flags.go:64] FLAG: --feature-gates=""
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291409    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291412    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291415    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291418    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291421    2581 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291424    2581 flags.go:64] FLAG: --help="false"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291427    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291430    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291433    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291436    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291439    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291442    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291445    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291448    2581 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291451    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291453    2581 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291456    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291459    2581 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 23:36:40.296658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291462    2581 flags.go:64] FLAG: --kube-reserved=""
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291465    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291467    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291470    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291473    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291475    2581 flags.go:64] FLAG: --lock-file=""
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291478    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291481    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291484    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291490    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291493    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291496    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291499    2581 flags.go:64] FLAG: --logging-format="text"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291502    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291505    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291508    2581 flags.go:64] FLAG: --manifest-url=""
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291510    2581 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291516    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291519    2581 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291523    2581 flags.go:64] FLAG: --max-pods="110"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291526    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291529    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291533    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291536    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291539    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 23:36:40.297321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291542    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291545    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291552    2581 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291555    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291558    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291561    2581 flags.go:64] FLAG: --pod-cidr=""
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291564    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291569    2581 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291572    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291575    2581 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291578    2581 flags.go:64] FLAG: --port="10250"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291581    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291585    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bdf4625854f5d49e"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291588    2581 flags.go:64] FLAG: --qos-reserved=""
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291591    2581 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291594    2581 flags.go:64] FLAG: --register-node="true"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291597    2581 flags.go:64] FLAG: --register-with-taints=""
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291601    2581 flags.go:64] FLAG: --registry-burst="10"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291604    2581 flags.go:64] FLAG: --registry-qps="5"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291607    2581 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291610    2581 flags.go:64] FLAG: --reserved-memory=""
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291613    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291617    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291619    2581 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291622    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 23:36:40.297940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291625    2581 flags.go:64] FLAG: --runonce="false"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291628    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291631    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291634    2581 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291637    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291640    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291643    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291646    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291649    2581 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291651    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291654    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291657    2581 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291659    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291662    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291687    2581 flags.go:64] FLAG: --system-cgroups=""
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291690    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291696    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291699    2581 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291702    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291707    2581 flags.go:64] FLAG: --tls-min-version=""
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291710    2581 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291712    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291716    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291719    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291722    2581 flags.go:64] FLAG: --v="2"
Sep 10 23:36:40.298556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291726    2581 flags.go:64] FLAG: --version="false"
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291731    2581 flags.go:64] FLAG: --vmodule=""
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291738    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.291741    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291859    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291863    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291866    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291869    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291872    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291875    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291878    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291881    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291883    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291886    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291889    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291891    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291894    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291896    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291900    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291902    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:36:40.299198 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291905    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291907    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291910    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291912    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291915    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291917    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291920    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291923    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291926    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291933    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291936    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291938    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291941    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291943    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291948    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291952    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291955    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291959    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291963    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291966    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:36:40.299752 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291969    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291972    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291976    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291979    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291981    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291984    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291987    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291989    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291992    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291995    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.291997    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292000    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292003    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292006    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292008    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292011    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292014    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292016    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292019    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292021    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:36:40.300295 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292024    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292027    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292030    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292032    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292035    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292037    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292040    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292043    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292045    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292048    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292051    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292053    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292056    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292059    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292063    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292066    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292069    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292072    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292074    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292077    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:36:40.300818 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292079    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292082    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292084    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292087    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292089    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292092    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292095    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292097    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292100    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292102    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292105    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292108    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292110    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292115    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292119    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292122    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292125    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292128    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292130    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292133    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:36:40.301325 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292136    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:36:40.301842 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292139    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:36:40.301842 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.292142    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:36:40.301842 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.292869    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 23:36:40.301842 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.301009    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 23:36:40.301842 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.301028    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 23:36:40.301842 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.301043    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 23:36:40.301842 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.301049    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 23:36:40.301842 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301109    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:36:40.301842 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301114    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:36:40.301842 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301118    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:36:40.301842 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301121    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:36:40.301842 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301124    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:36:40.301842 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301127    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:36:40.301842 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301130    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:36:40.301842 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301132    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301135    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301138    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301141    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301143    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301146    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301149    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301151    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301154    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301157    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301160    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301162    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301165    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301167    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301170    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301172    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301175    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301177    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301180    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301183    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:36:40.302219 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301185    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301188    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301194    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301196    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301199    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301201    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301204    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301206    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301209    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301212    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301215    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301217    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301219    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301222    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301224    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301227    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301230    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301232    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301235    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301237    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:36:40.302727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301241    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301243    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301246    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301248    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301251    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301253    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301256    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301258    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301261    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301264    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301267    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301269    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301272    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301275    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301278    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301282    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301285    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301287    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301292    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:36:40.303209 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301296    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301299    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301303    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301306    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301309    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301311    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301314    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301317    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301320    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301323    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301326    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301328    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301331    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301334    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301337    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301341    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301344    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301347    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301350    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301353    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:36:40.303727 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301357    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:36:40.304211 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301360    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:36:40.304211 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301362    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:36:40.304211 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301365    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:36:40.304211 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301368    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:36:40.304211 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301370    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:36:40.304211 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301373    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:36:40.304211 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301378    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:36:40.304211 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301382    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:36:40.304211 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301385    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:36:40.304211 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301388    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:36:40.304211 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301391    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:36:40.304211 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301393    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:36:40.304211 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.301398    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 23:36:40.304211 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301516    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301521    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301524    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301527    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301530    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301533    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301537    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301540    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301543    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301545    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301548    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301550    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301553    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301555    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301558    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301561    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301563    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301566    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301568    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301571    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:36:40.304564 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301574    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301577    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301579    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301582    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301584    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301587    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301590    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301592    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301596    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301598    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301601    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301604    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301606    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301608    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301611    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301613    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301616    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301618    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301622    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:36:40.305112 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301626    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301629    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301631    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301634    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301637    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301640    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301642    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301645    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301648    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301650    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301653    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301655    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301658    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301660    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301681    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301686    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301690    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301693    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301696    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301699    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:36:40.305567 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301702    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301705    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301709    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301712    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301715    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301717    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301720    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301722    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301725    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301727    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301730    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301732    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301735    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301737    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301740    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301743    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301745    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301747    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301750    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301752    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:36:40.306067 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301755    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301757    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301760    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301762    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301765    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301767    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301771    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301774    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301776    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301779    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301782    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301785    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301787    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301790    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301792    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301796    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301798    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301801    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301803    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:36:40.306551 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:40.301806    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:36:40.307048 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.301811    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 23:36:40.307048 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.301951    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 23:36:40.307048 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.305995    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 23:36:40.307130 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.307113    2581 server.go:1019] "Starting client certificate rotation"
Sep 10 23:36:40.307236 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.307215    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 23:36:40.307267 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.307256    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 23:36:40.310097 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.310081    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 23:36:40.311319 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.311298    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 23:36:40.318747 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.318659    2581 log.go:25] "Validated CRI v1 runtime API"
Sep 10 23:36:40.322061 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.322044    2581 log.go:25] "Validated CRI v1 image API"
Sep 10 23:36:40.323373 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.323349    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 23:36:40.328339 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.328309    2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c9c77db1-c45d-456e-8f26-02df000c73ca:/dev/nvme0n1p4 ca5b96e6-a122-40ac-9db4-36599da04b3e:/dev/nvme0n1p3]
Sep 10 23:36:40.328425 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.328339    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 23:36:40.333795 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.333659    2581 manager.go:216] Machine: {Timestamp:2026-09-10 23:36:40.332184374 +0000 UTC m=+0.373053670 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096453 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d4da80229527867dd976e839a0e94 SystemUUID:ec2d4da8-0229-5278-67dd-976e839a0e94 BootID:a1a837a2-87e7-4d22-903d-10439a28ab68 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ed:32:41:ae:df Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ed:32:41:ae:df Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:55:13:4f:3c:a2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 23:36:40.333795 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.333789    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 23:36:40.333958 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.333875    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 23:36:40.334742 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.334727    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 23:36:40.337233 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.337205    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 23:36:40.337383 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.337237    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-147.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 23:36:40.338840 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.338829    2581 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 23:36:40.338885 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.338843    2581 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 23:36:40.338885 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.338851    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 23:36:40.339591 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.339573    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 23:36:40.341386 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.341374    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 23:36:40.345368 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.345355    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 23:36:40.345491 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.345482    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 23:36:40.345527 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.345516    2581 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 23:36:40.345556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.345529    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 23:36:40.345556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.345543    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 23:36:40.345556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.345553    2581 kubelet.go:398] "Adding apiserver pod source"
Sep 10 23:36:40.345647 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.345561    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 23:36:40.345984 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.345972    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 23:36:40.346036 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.345994    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 23:36:40.348482 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.348463    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 23:36:40.351584 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.351564    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 23:36:40.351648 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.351601    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 23:36:40.353785 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.353764    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 23:36:40.353875 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.353821    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 23:36:40.353875 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.353835    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 23:36:40.353875 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.353847    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 23:36:40.353875 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.353860    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 23:36:40.353875 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.353867    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 23:36:40.354030 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.353883    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 23:36:40.354030 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.353891    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 23:36:40.354030 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.353900    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 23:36:40.354030 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.353906    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 23:36:40.354030 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.353924    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 23:36:40.354030 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.353930    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 23:36:40.354030 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.353953    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 23:36:40.354030 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.353958    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 23:36:40.355480 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.355441    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 23:36:40.355573 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.355523    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-147.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 23:36:40.355641 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.355625    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-147.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 23:36:40.358279 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.358263    2581 server.go:1268] "Started kubelet"
Sep 10 23:36:40.358588 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.358450    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 23:36:40.358821 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.358787    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 23:36:40.359239 ip-10-0-139-147 systemd[1]: Started Kubernetes Kubelet.
Sep 10 23:36:40.359496 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.359397    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 23:36:40.363491 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.363443    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 23:36:40.364645 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.364618    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-54g6g"
Sep 10 23:36:40.365111 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.365085    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 23:36:40.365509 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.365489    2581 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 23:36:40.367338 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.367315    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-54g6g"
Sep 10 23:36:40.369386 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.366190    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-147.ec2.internal.18d419dfa7e2a500  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-147.ec2.internal,UID:ip-10-0-139-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-147.ec2.internal,},FirstTimestamp:2026-09-10 23:36:40.357979392 +0000 UTC m=+0.398848687,LastTimestamp:2026-09-10 23:36:40.357979392 +0000 UTC m=+0.398848687,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-147.ec2.internal,}"
Sep 10 23:36:40.372198 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.372181    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 23:36:40.372923 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.372890    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 23:36:40.373081 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.373060    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found"
Sep 10 23:36:40.373637 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.373621    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 23:36:40.373637 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.373621    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 23:36:40.373785 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.373648    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 23:36:40.373785 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.373735    2581 factory.go:55] Registering systemd factory
Sep 10 23:36:40.373785 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.373750    2581 factory.go:223] Registration of the systemd container factory successfully
Sep 10 23:36:40.373923 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.373811    2581 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 23:36:40.373923 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.373824    2581 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 23:36:40.374045 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.373987    2581 factory.go:153] Registering CRI-O factory
Sep 10 23:36:40.374045 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.373999    2581 factory.go:223] Registration of the crio container factory successfully
Sep 10 23:36:40.374428 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.374052    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 23:36:40.374428 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.374071    2581 factory.go:103] Registering Raw factory
Sep 10 23:36:40.374428 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.374087    2581 manager.go:1196] Started watching for new ooms in manager
Sep 10 23:36:40.374568 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.374489    2581 manager.go:349] Starting recovery of all containers
Sep 10 23:36:40.383598 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.383569    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:36:40.386178 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.386153    2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-147.ec2.internal\" not found" node="ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.386507 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.386493    2581 manager.go:354] Recovery completed
Sep 10 23:36:40.390539 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.390526    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:36:40.392442 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.392426    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:36:40.392491 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.392456    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:36:40.392491 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.392466    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:36:40.393188 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.393172    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 23:36:40.393188 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.393185    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 23:36:40.393315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.393189    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:36:40.393315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.393207    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 23:36:40.394096 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.394079    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:36:40.394158 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.394107    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:36:40.394158 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.394120    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:36:40.394260 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.394240    2581 policy_none.go:49] "None policy: Start"
Sep 10 23:36:40.394260 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.394259    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 23:36:40.394355 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.394273    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 23:36:40.395228 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.395215    2581 policy_none.go:47] "Start"
Sep 10 23:36:40.433388 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.433370    2581 manager.go:337] "Starting Device Plugin manager"
Sep 10 23:36:40.447629 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.433413    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 23:36:40.447629 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.433424    2581 server.go:87] "Starting device plugin registration server"
Sep 10 23:36:40.447629 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.433693    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 23:36:40.447629 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.433704    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 23:36:40.447629 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.433784    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 23:36:40.447629 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.433872    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 23:36:40.447629 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.433881    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 23:36:40.447629 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.434529    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 23:36:40.447629 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.434576    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-147.ec2.internal\" not found"
Sep 10 23:36:40.475556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.475509    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 23:36:40.476875 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.476844    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 23:36:40.476943 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.476932    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 23:36:40.476981 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.476965    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 23:36:40.477034 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.477020    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 23:36:40.479208 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.479184    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:36:40.534256 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.534019    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:36:40.536215 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.536193    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:36:40.536353 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.536228    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:36:40.536353 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.536242    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:36:40.536353 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.536297    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.545680 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.545645    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.545737 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.545684    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-147.ec2.internal\": node \"ip-10-0-139-147.ec2.internal\" not found"
Sep 10 23:36:40.555684 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.555642    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found"
Sep 10 23:36:40.578097 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.578065    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal"]
Sep 10 23:36:40.578191 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.578155    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:36:40.579220 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.579202    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:36:40.579324 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.579230    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:36:40.579324 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.579240    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:36:40.581302 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.581289    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:36:40.581419 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.581405    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.581463 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.581437    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:36:40.582147 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.582131    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:36:40.582252 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.582158    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:36:40.582252 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.582172    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:36:40.582252 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.582181    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:36:40.582252 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.582199    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:36:40.582252 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.582209    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:36:40.584298 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.584282    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.584351 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.584310    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:36:40.585026 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.585011    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:36:40.585104 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.585032    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:36:40.585104 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.585042    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:36:40.597272 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.597252    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-147.ec2.internal\" not found" node="ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.601940 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.601922    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-147.ec2.internal\" not found" node="ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.655747 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.655717    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found"
Sep 10 23:36:40.675652 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.675626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bbf41b1140a7013c210a677ef110508a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal\" (UID: \"bbf41b1140a7013c210a677ef110508a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.675775 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.675658    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbf41b1140a7013c210a677ef110508a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal\" (UID: \"bbf41b1140a7013c210a677ef110508a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.675775 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.675693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71a0709018cb1fe9919f44a57d998256-config\") pod \"kube-apiserver-proxy-ip-10-0-139-147.ec2.internal\" (UID: \"71a0709018cb1fe9919f44a57d998256\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.755988 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.755948    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found"
Sep 10 23:36:40.776321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.776278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbf41b1140a7013c210a677ef110508a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal\" (UID: \"bbf41b1140a7013c210a677ef110508a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.776457 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.776332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71a0709018cb1fe9919f44a57d998256-config\") pod \"kube-apiserver-proxy-ip-10-0-139-147.ec2.internal\" (UID: \"71a0709018cb1fe9919f44a57d998256\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.776457 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.776358    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bbf41b1140a7013c210a677ef110508a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal\" (UID: \"bbf41b1140a7013c210a677ef110508a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.776457 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.776378    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbf41b1140a7013c210a677ef110508a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal\" (UID: \"bbf41b1140a7013c210a677ef110508a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.776457 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.776420    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bbf41b1140a7013c210a677ef110508a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal\" (UID: \"bbf41b1140a7013c210a677ef110508a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.776457 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.776431    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71a0709018cb1fe9919f44a57d998256-config\") pod \"kube-apiserver-proxy-ip-10-0-139-147.ec2.internal\" (UID: \"71a0709018cb1fe9919f44a57d998256\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.856785 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.856717    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found"
Sep 10 23:36:40.900248 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.900203    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.905112 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:40.904957    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal"
Sep 10 23:36:40.957315 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:40.957275    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found"
Sep 10 23:36:41.057883 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:41.057841    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found"
Sep 10 23:36:41.158438 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:41.158365    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found"
Sep 10 23:36:41.258939 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:41.258911    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found"
Sep 10 23:36:41.307398 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:41.307375    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 23:36:41.307833 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:41.307510    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 23:36:41.307833 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:41.307550    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 23:36:41.359560 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:41.359527    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found"
Sep 10 23:36:41.372590 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:41.372554    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 23:31:40 +0000 UTC" deadline="2028-05-02 01:05:51.91233022 +0000 UTC"
Sep 10 23:36:41.372590 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:41.372583    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14377h29m10.539750579s"
Sep 10 23:36:41.460705 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:41.460621    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found"
Sep 10 23:36:41.561359 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:41.561331    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found"
Sep 10 23:36:41.565451 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:41.565419    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a0709018cb1fe9919f44a57d998256.slice/crio-9109d7364b75a9288974990f2289141e79c1cf07e4021469342c114cf2a97036 WatchSource:0}: Error finding container 9109d7364b75a9288974990f2289141e79c1cf07e4021469342c114cf2a97036: Status 404 returned error can't find the container with id 9109d7364b75a9288974990f2289141e79c1cf07e4021469342c114cf2a97036
Sep 10 23:36:41.565654 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:41.565641    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf41b1140a7013c210a677ef110508a.slice/crio-bda72db393ca0f3ae56fa786c76439bfb684a8210a669010680392dabedcf7dd WatchSource:0}: Error finding container bda72db393ca0f3ae56fa786c76439bfb684a8210a669010680392dabedcf7dd: Status 404 returned error can't find the container with id bda72db393ca0f3ae56fa786c76439bfb684a8210a669010680392dabedcf7dd
Sep 10 23:36:41.572226 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:41.572204    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:36:41.610868 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:41.610837    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:36:41.649803 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:41.649776    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:36:41.674068 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:41.674042    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal"
Sep 10 23:36:41.684864 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:41.684837    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 23:36:41.686012 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:41.685997    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal"
Sep 10 23:36:41.692241 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:41.692223    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 23:36:42.284474 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.284385    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:36:42.346921 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.346870    2581 apiserver.go:52] "Watching apiserver"
Sep 10 23:36:42.357375 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.357342    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 23:36:42.359520 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.359052    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal","openshift-dns/node-resolver-cvkl5","openshift-image-registry/node-ca-h7g65","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal","openshift-multus/multus-zb552","openshift-multus/network-metrics-daemon-4gtf5","openshift-ovn-kubernetes/ovnkube-node-s9nk5","kube-system/global-pull-secret-syncer-wc9vw","kube-system/konnectivity-agent-7gdzf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8","openshift-cluster-node-tuning-operator/tuned-q8pv8","openshift-multus/multus-additional-cni-plugins-526tg","openshift-network-diagnostics/network-check-target-xjmkz","openshift-network-operator/iptables-alerter-hcf7p"]
Sep 10 23:36:42.361963 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.361934    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.364290 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.364262    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:36:42.364409 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:42.364374    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:36:42.364871 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.364849    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 23:36:42.364957 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.364891    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 23:36:42.364999 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.364849    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 23:36:42.365060 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.364854    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dzgfc\""
Sep 10 23:36:42.366743 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.366719    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h7g65"
Sep 10 23:36:42.368839 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.368814    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hcf7p"
Sep 10 23:36:42.369594 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.369571    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 23:36:42.369691 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.369663    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hf66z\""
Sep 10 23:36:42.369864 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.369838    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 23:36:42.370057 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.370041    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 23:36:42.371270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.370925    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 23:36:42.371270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.371092    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:36:42.371435 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.371369    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.371652 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.371621    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 23:36:42.372571 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.372130    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kfrhm\""
Sep 10 23:36:42.372680 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.372657    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 23:36:42.373733 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.373664    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 23:36:42.373859 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.373688    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 23:36:42.373959 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.373928    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:42.374018 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:42.374000    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:36:42.374789 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.374237    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 23:36:42.374789 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.374538    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tg2vs\""
Sep 10 23:36:42.374789 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.374243    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 23:36:42.383081 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.383055    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7gdzf"
Sep 10 23:36:42.385665 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.385642    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 23:36:42.385974 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.385955    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 23:36:42.386191 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.386172    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kt4jq\""
Sep 10 23:36:42.387153 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387131    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-var-lib-cni-bin\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.387248 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387161    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk6fd\" (UniqueName: \"kubernetes.io/projected/e3fccb42-7296-4d10-9efc-e4d2344f71b4-kube-api-access-lk6fd\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.387248 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387179    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-sys-fs\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.387248 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387202    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lptt4\" (UniqueName: \"kubernetes.io/projected/afe96c24-b384-431f-85db-44d132dde401-kube-api-access-lptt4\") pod \"network-metrics-daemon-4gtf5\" (UID: \"afe96c24-b384-431f-85db-44d132dde401\") " pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:42.387248 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387229    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-multus-socket-dir-parent\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.387471 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387256    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54ed315c-a8ea-457b-8795-b40ad51e0a01-serviceca\") pod \"node-ca-h7g65\" (UID: \"54ed315c-a8ea-457b-8795-b40ad51e0a01\") " pod="openshift-image-registry/node-ca-h7g65"
Sep 10 23:36:42.387471 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387283    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d0d5e641-cb68-4660-9972-c48a5cebdd51-host-slash\") pod \"iptables-alerter-hcf7p\" (UID: \"d0d5e641-cb68-4660-9972-c48a5cebdd51\") " pod="openshift-network-operator/iptables-alerter-hcf7p"
Sep 10 23:36:42.387471 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387310    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-socket-dir\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.387471 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387349    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-run-multus-certs\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.387471 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387376    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aef09d11-25b8-405f-8a39-68d1c7e17a46-konnectivity-ca\") pod \"konnectivity-agent-7gdzf\" (UID: \"aef09d11-25b8-405f-8a39-68d1c7e17a46\") " pod="kube-system/konnectivity-agent-7gdzf"
Sep 10 23:36:42.387471 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-registration-dir\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.387471 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-multus-cni-dir\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.387471 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387460    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-var-lib-kubelet\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.387906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387486    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-etc-kubernetes\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.387906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97jl9\" (UniqueName: \"kubernetes.io/projected/76711a65-1e10-49cd-bd62-f762bc02f6e4-kube-api-access-97jl9\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.387906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387545    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-system-cni-dir\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.387906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-run-netns\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.387906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387595    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-var-lib-cni-multus\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.387906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387629    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-hostroot\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.387906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387656    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-multus-conf-dir\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.387906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-device-dir\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.387906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387715    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.387906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387760    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-cnibin\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.387906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387786    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3fccb42-7296-4d10-9efc-e4d2344f71b4-multus-daemon-config\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.387906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387812    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aef09d11-25b8-405f-8a39-68d1c7e17a46-agent-certs\") pod \"konnectivity-agent-7gdzf\" (UID: \"aef09d11-25b8-405f-8a39-68d1c7e17a46\") " pod="kube-system/konnectivity-agent-7gdzf"
Sep 10 23:36:42.387906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387837    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs\") pod \"network-metrics-daemon-4gtf5\" (UID: \"afe96c24-b384-431f-85db-44d132dde401\") " pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:42.387906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387881    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmp24\" (UniqueName: \"kubernetes.io/projected/d0d5e641-cb68-4660-9972-c48a5cebdd51-kube-api-access-dmp24\") pod \"iptables-alerter-hcf7p\" (UID: \"d0d5e641-cb68-4660-9972-c48a5cebdd51\") " pod="openshift-network-operator/iptables-alerter-hcf7p"
Sep 10 23:36:42.387906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-run-k8s-cni-cncf-io\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.388645 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387939    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhnmc\" (UniqueName: \"kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc\") pod \"network-check-target-xjmkz\" (UID: \"21ece222-a646-4ff2-b0bd-34580d528de4\") " pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:36:42.388645 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387965    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3fccb42-7296-4d10-9efc-e4d2344f71b4-cni-binary-copy\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.388645 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.387990    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54ed315c-a8ea-457b-8795-b40ad51e0a01-host\") pod \"node-ca-h7g65\" (UID: \"54ed315c-a8ea-457b-8795-b40ad51e0a01\") " pod="openshift-image-registry/node-ca-h7g65"
Sep 10 23:36:42.388645 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.388020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkszs\" (UniqueName: \"kubernetes.io/projected/54ed315c-a8ea-457b-8795-b40ad51e0a01-kube-api-access-kkszs\") pod \"node-ca-h7g65\" (UID: \"54ed315c-a8ea-457b-8795-b40ad51e0a01\") " pod="openshift-image-registry/node-ca-h7g65"
Sep 10 23:36:42.388645 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.388037    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d0d5e641-cb68-4660-9972-c48a5cebdd51-iptables-alerter-script\") pod \"iptables-alerter-hcf7p\" (UID: \"d0d5e641-cb68-4660-9972-c48a5cebdd51\") " pod="openshift-network-operator/iptables-alerter-hcf7p"
Sep 10 23:36:42.388645 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.388052    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.389042 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.389021    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 23:36:42.390111 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.390092    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.392907 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.392560    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 23:36:42.392907 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.392884    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ktc65\""
Sep 10 23:36:42.394348 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.394121    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cvkl5"
Sep 10 23:36:42.394499 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.394477    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 23:36:42.394596 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.394579    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 23:36:42.398422 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.395018    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 23:36:42.398422 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.395427    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 23:36:42.398422 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.395622    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 23:36:42.400201 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.399656    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6lptc\""
Sep 10 23:36:42.400201 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.399989    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 23:36:42.400201 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.400039    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 23:36:42.400666 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.400646    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:42.400802 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:42.400751    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:36:42.403423 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.403398    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.405692 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.405675    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k77kt\""
Sep 10 23:36:42.406050 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.406032    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.406446 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.406428    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:36:42.406593 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.406432    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 23:36:42.408353 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.408330    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 23:36:42.408857 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.408837    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 23:36:42.408950 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.408886    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-28p27\""
Sep 10 23:36:42.415341 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.415311    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d6jds"
Sep 10 23:36:42.423748 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.423711    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d6jds"
Sep 10 23:36:42.475198 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.475168    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 23:36:42.482980 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.482807    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal" event={"ID":"71a0709018cb1fe9919f44a57d998256","Type":"ContainerStarted","Data":"9109d7364b75a9288974990f2289141e79c1cf07e4021469342c114cf2a97036"}
Sep 10 23:36:42.484495 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.484469    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" event={"ID":"bbf41b1140a7013c210a677ef110508a","Type":"ContainerStarted","Data":"bda72db393ca0f3ae56fa786c76439bfb684a8210a669010680392dabedcf7dd"}
Sep 10 23:36:42.488869 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.488839    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.489006 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.488887    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-log-socket\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.489006 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.488914    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-sys\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.489006 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.488946    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-var-lib-kubelet\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.489006 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.488972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzg6q\" (UniqueName: \"kubernetes.io/projected/32277bda-aca3-4ea0-8f27-a420c4d80a32-kube-api-access-hzg6q\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.489006 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.488997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-run-netns\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.489276 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-sys-fs\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.489276 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lptt4\" (UniqueName: \"kubernetes.io/projected/afe96c24-b384-431f-85db-44d132dde401-kube-api-access-lptt4\") pod \"network-metrics-daemon-4gtf5\" (UID: \"afe96c24-b384-431f-85db-44d132dde401\") " pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:42.489276 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489085    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/912d77fa-8dc2-459a-8469-be8706ce081d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.489276 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489113    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-node-log\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.489276 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-cni-netd\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.489276 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-sysconfig\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.489276 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489189    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54ed315c-a8ea-457b-8795-b40ad51e0a01-serviceca\") pod \"node-ca-h7g65\" (UID: \"54ed315c-a8ea-457b-8795-b40ad51e0a01\") " pod="openshift-image-registry/node-ca-h7g65"
Sep 10 23:36:42.489276 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489216    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d0d5e641-cb68-4660-9972-c48a5cebdd51-host-slash\") pod \"iptables-alerter-hcf7p\" (UID: \"d0d5e641-cb68-4660-9972-c48a5cebdd51\") " pod="openshift-network-operator/iptables-alerter-hcf7p"
Sep 10 23:36:42.489276 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32277bda-aca3-4ea0-8f27-a420c4d80a32-tmp\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.489276 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489268    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-run-multus-certs\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489296    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aef09d11-25b8-405f-8a39-68d1c7e17a46-konnectivity-ca\") pod \"konnectivity-agent-7gdzf\" (UID: \"aef09d11-25b8-405f-8a39-68d1c7e17a46\") " pod="kube-system/konnectivity-agent-7gdzf"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489338    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/197415e0-e604-40a0-af02-b22590f55c2e-hosts-file\") pod \"node-resolver-cvkl5\" (UID: \"197415e0-e604-40a0-af02-b22590f55c2e\") " pod="openshift-dns/node-resolver-cvkl5"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489376    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-run-ovn-kubernetes\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-var-lib-kubelet\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-etc-kubernetes\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489458    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/912d77fa-8dc2-459a-8469-be8706ce081d-cnibin\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489484    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-run-ovn\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489509    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-system-cni-dir\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489537    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-run-netns\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489563    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-var-lib-cni-multus\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489588    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-multus-conf-dir\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489625    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489702    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs\") pod \"network-metrics-daemon-4gtf5\" (UID: \"afe96c24-b384-431f-85db-44d132dde401\") " pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489728    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbsjh\" (UniqueName: \"kubernetes.io/projected/912d77fa-8dc2-459a-8469-be8706ce081d-kube-api-access-nbsjh\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489785    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/380d5f9c-5375-4728-a66b-461ec152a23b-kubelet-config\") pod \"global-pull-secret-syncer-wc9vw\" (UID: \"380d5f9c-5375-4728-a66b-461ec152a23b\") " pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:42.489847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhnmc\" (UniqueName: \"kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc\") pod \"network-check-target-xjmkz\" (UID: \"21ece222-a646-4ff2-b0bd-34580d528de4\") " pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489859    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-kubelet\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v45b4\" (UniqueName: \"kubernetes.io/projected/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-kube-api-access-v45b4\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-sysctl-conf\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489955    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-lib-modules\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.489982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3fccb42-7296-4d10-9efc-e4d2344f71b4-cni-binary-copy\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54ed315c-a8ea-457b-8795-b40ad51e0a01-host\") pod \"node-ca-h7g65\" (UID: \"54ed315c-a8ea-457b-8795-b40ad51e0a01\") " pod="openshift-image-registry/node-ca-h7g65"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490038    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkszs\" (UniqueName: \"kubernetes.io/projected/54ed315c-a8ea-457b-8795-b40ad51e0a01-kube-api-access-kkszs\") pod \"node-ca-h7g65\" (UID: \"54ed315c-a8ea-457b-8795-b40ad51e0a01\") " pod="openshift-image-registry/node-ca-h7g65"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490066    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-modprobe-d\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490090    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-tuned\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-var-lib-cni-bin\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490149    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk6fd\" (UniqueName: \"kubernetes.io/projected/e3fccb42-7296-4d10-9efc-e4d2344f71b4-kube-api-access-lk6fd\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/912d77fa-8dc2-459a-8469-be8706ce081d-system-cni-dir\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490206    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/912d77fa-8dc2-459a-8469-be8706ce081d-cni-binary-copy\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490232    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/912d77fa-8dc2-459a-8469-be8706ce081d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdgvh\" (UniqueName: \"kubernetes.io/projected/197415e0-e604-40a0-af02-b22590f55c2e-kube-api-access-kdgvh\") pod \"node-resolver-cvkl5\" (UID: \"197415e0-e604-40a0-af02-b22590f55c2e\") " pod="openshift-dns/node-resolver-cvkl5"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490290    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-sysctl-d\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.490853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490328    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-multus-socket-dir-parent\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-socket-dir\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-slash\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-ovnkube-config\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490448    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-ovnkube-script-lib\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490474    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-run\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490504    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-registration-dir\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490531    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-systemd-units\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490560    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-run-systemd\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490588    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-multus-cni-dir\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97jl9\" (UniqueName: \"kubernetes.io/projected/76711a65-1e10-49cd-bd62-f762bc02f6e4-kube-api-access-97jl9\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490653    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-etc-openvswitch\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490682    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-env-overrides\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490711    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret\") pod \"global-pull-secret-syncer-wc9vw\" (UID: \"380d5f9c-5375-4728-a66b-461ec152a23b\") " pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-hostroot\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-device-dir\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490822    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-var-lib-openvswitch\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.491703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490850    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-kubernetes\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-cnibin\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490945    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3fccb42-7296-4d10-9efc-e4d2344f71b4-multus-daemon-config\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.490975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aef09d11-25b8-405f-8a39-68d1c7e17a46-agent-certs\") pod \"konnectivity-agent-7gdzf\" (UID: \"aef09d11-25b8-405f-8a39-68d1c7e17a46\") " pod="kube-system/konnectivity-agent-7gdzf"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.491007    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/197415e0-e604-40a0-af02-b22590f55c2e-tmp-dir\") pod \"node-resolver-cvkl5\" (UID: \"197415e0-e604-40a0-af02-b22590f55c2e\") " pod="openshift-dns/node-resolver-cvkl5"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.491036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-ovn-node-metrics-cert\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.491072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/380d5f9c-5375-4728-a66b-461ec152a23b-dbus\") pod \"global-pull-secret-syncer-wc9vw\" (UID: \"380d5f9c-5375-4728-a66b-461ec152a23b\") " pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.491097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-host\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.491129    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmp24\" (UniqueName: \"kubernetes.io/projected/d0d5e641-cb68-4660-9972-c48a5cebdd51-kube-api-access-dmp24\") pod \"iptables-alerter-hcf7p\" (UID: \"d0d5e641-cb68-4660-9972-c48a5cebdd51\") " pod="openshift-network-operator/iptables-alerter-hcf7p"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.491159    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-run-k8s-cni-cncf-io\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.491191    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/912d77fa-8dc2-459a-8469-be8706ce081d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.491220    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-run-openvswitch\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.491249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-cni-bin\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.491278    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-systemd\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.491308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d0d5e641-cb68-4660-9972-c48a5cebdd51-iptables-alerter-script\") pod \"iptables-alerter-hcf7p\" (UID: \"d0d5e641-cb68-4660-9972-c48a5cebdd51\") " pod="openshift-network-operator/iptables-alerter-hcf7p"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.492044    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d0d5e641-cb68-4660-9972-c48a5cebdd51-iptables-alerter-script\") pod \"iptables-alerter-hcf7p\" (UID: \"d0d5e641-cb68-4660-9972-c48a5cebdd51\") " pod="openshift-network-operator/iptables-alerter-hcf7p"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.492160    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.492582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.492272    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-sys-fs\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.493524 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.493104    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54ed315c-a8ea-457b-8795-b40ad51e0a01-serviceca\") pod \"node-ca-h7g65\" (UID: \"54ed315c-a8ea-457b-8795-b40ad51e0a01\") " pod="openshift-image-registry/node-ca-h7g65"
Sep 10 23:36:42.493524 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.493179    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d0d5e641-cb68-4660-9972-c48a5cebdd51-host-slash\") pod \"iptables-alerter-hcf7p\" (UID: \"d0d5e641-cb68-4660-9972-c48a5cebdd51\") " pod="openshift-network-operator/iptables-alerter-hcf7p"
Sep 10 23:36:42.493524 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.493251    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-run-multus-certs\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.493896    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-run-netns\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.493904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-etc-kubernetes\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.493970    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-var-lib-cni-bin\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.493992    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-var-lib-cni-multus\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.494018    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54ed315c-a8ea-457b-8795-b40ad51e0a01-host\") pod \"node-ca-h7g65\" (UID: \"54ed315c-a8ea-457b-8795-b40ad51e0a01\") " pod="openshift-image-registry/node-ca-h7g65"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.494074    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-var-lib-kubelet\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.494113    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-multus-conf-dir\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.494147    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.494198    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-system-cni-dir\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.494259    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-device-dir\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.494387    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-multus-socket-dir-parent\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.494538    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3fccb42-7296-4d10-9efc-e4d2344f71b4-cni-binary-copy\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.494552    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-socket-dir\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.494864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-host-run-k8s-cni-cncf-io\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.494935    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/76711a65-1e10-49cd-bd62-f762bc02f6e4-registration-dir\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.494939    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.495001    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3fccb42-7296-4d10-9efc-e4d2344f71b4-multus-daemon-config\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.495293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.495045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-hostroot\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.496310 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.495048    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-multus-cni-dir\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.496310 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:42.495139    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:42.496310 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.495141    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3fccb42-7296-4d10-9efc-e4d2344f71b4-cnibin\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.496310 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:42.495260    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs podName:afe96c24-b384-431f-85db-44d132dde401 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:42.995238464 +0000 UTC m=+3.036107825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs") pod "network-metrics-daemon-4gtf5" (UID: "afe96c24-b384-431f-85db-44d132dde401") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:42.496310 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.495539    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aef09d11-25b8-405f-8a39-68d1c7e17a46-konnectivity-ca\") pod \"konnectivity-agent-7gdzf\" (UID: \"aef09d11-25b8-405f-8a39-68d1c7e17a46\") " pod="kube-system/konnectivity-agent-7gdzf"
Sep 10 23:36:42.500348 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.500316    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aef09d11-25b8-405f-8a39-68d1c7e17a46-agent-certs\") pod \"konnectivity-agent-7gdzf\" (UID: \"aef09d11-25b8-405f-8a39-68d1c7e17a46\") " pod="kube-system/konnectivity-agent-7gdzf"
Sep 10 23:36:42.502077 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.502047    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lptt4\" (UniqueName: \"kubernetes.io/projected/afe96c24-b384-431f-85db-44d132dde401-kube-api-access-lptt4\") pod \"network-metrics-daemon-4gtf5\" (UID: \"afe96c24-b384-431f-85db-44d132dde401\") " pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:42.503206 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:42.503184    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:36:42.503311 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:42.503214    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:36:42.503311 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:42.503228    2581 projected.go:196] Error preparing data for projected volume kube-api-access-bhnmc for pod openshift-network-diagnostics/network-check-target-xjmkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:42.503439 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:42.503330    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc podName:21ece222-a646-4ff2-b0bd-34580d528de4 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:43.003312195 +0000 UTC m=+3.044181500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bhnmc" (UniqueName: "kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc") pod "network-check-target-xjmkz" (UID: "21ece222-a646-4ff2-b0bd-34580d528de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:42.504784 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.504757    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkszs\" (UniqueName: \"kubernetes.io/projected/54ed315c-a8ea-457b-8795-b40ad51e0a01-kube-api-access-kkszs\") pod \"node-ca-h7g65\" (UID: \"54ed315c-a8ea-457b-8795-b40ad51e0a01\") " pod="openshift-image-registry/node-ca-h7g65"
Sep 10 23:36:42.505601 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.505581    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmp24\" (UniqueName: \"kubernetes.io/projected/d0d5e641-cb68-4660-9972-c48a5cebdd51-kube-api-access-dmp24\") pod \"iptables-alerter-hcf7p\" (UID: \"d0d5e641-cb68-4660-9972-c48a5cebdd51\") " pod="openshift-network-operator/iptables-alerter-hcf7p"
Sep 10 23:36:42.505974 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.505945    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97jl9\" (UniqueName: \"kubernetes.io/projected/76711a65-1e10-49cd-bd62-f762bc02f6e4-kube-api-access-97jl9\") pod \"aws-ebs-csi-driver-node-wq5j8\" (UID: \"76711a65-1e10-49cd-bd62-f762bc02f6e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.506344 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.506308    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk6fd\" (UniqueName: \"kubernetes.io/projected/e3fccb42-7296-4d10-9efc-e4d2344f71b4-kube-api-access-lk6fd\") pod \"multus-zb552\" (UID: \"e3fccb42-7296-4d10-9efc-e4d2344f71b4\") " pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.569454 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.569366    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:36:42.591623 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.591573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/912d77fa-8dc2-459a-8469-be8706ce081d-cnibin\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.591623 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.591623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-run-ovn\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.591889 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.591657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.591889 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.591665    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/912d77fa-8dc2-459a-8469-be8706ce081d-cnibin\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.591889 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.591718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbsjh\" (UniqueName: \"kubernetes.io/projected/912d77fa-8dc2-459a-8469-be8706ce081d-kube-api-access-nbsjh\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.591889 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.591747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/380d5f9c-5375-4728-a66b-461ec152a23b-kubelet-config\") pod \"global-pull-secret-syncer-wc9vw\" (UID: \"380d5f9c-5375-4728-a66b-461ec152a23b\") " pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:42.591889 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.591751    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-run-ovn\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.591889 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.591784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-kubelet\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.591889 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.591804    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.592152 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.591810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v45b4\" (UniqueName: \"kubernetes.io/projected/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-kube-api-access-v45b4\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.592152 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-sysctl-conf\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.592152 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592053    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-lib-modules\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.592152 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-modprobe-d\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.592351 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592152    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/380d5f9c-5375-4728-a66b-461ec152a23b-kubelet-config\") pod \"global-pull-secret-syncer-wc9vw\" (UID: \"380d5f9c-5375-4728-a66b-461ec152a23b\") " pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:42.592351 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-tuned\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.592351 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592207    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-modprobe-d\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.592351 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/912d77fa-8dc2-459a-8469-be8706ce081d-system-cni-dir\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.592351 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/912d77fa-8dc2-459a-8469-be8706ce081d-cni-binary-copy\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.592351 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/912d77fa-8dc2-459a-8469-be8706ce081d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.592351 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdgvh\" (UniqueName: \"kubernetes.io/projected/197415e0-e604-40a0-af02-b22590f55c2e-kube-api-access-kdgvh\") pod \"node-resolver-cvkl5\" (UID: \"197415e0-e604-40a0-af02-b22590f55c2e\") " pod="openshift-dns/node-resolver-cvkl5"
Sep 10 23:36:42.592351 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-sysctl-d\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.592632 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592364    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-slash\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.592632 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-ovnkube-config\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.592632 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-ovnkube-script-lib\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.592632 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592424    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-lib-modules\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.592632 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-run\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.592632 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-systemd-units\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.592632 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-run-systemd\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.592632 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-slash\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.592632 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592526    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-etc-openvswitch\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.592632 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-env-overrides\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.592632 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret\") pod \"global-pull-secret-syncer-wc9vw\" (UID: \"380d5f9c-5375-4728-a66b-461ec152a23b\") " pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:42.592632 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592605    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/912d77fa-8dc2-459a-8469-be8706ce081d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.593055 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592653    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-var-lib-openvswitch\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.593055 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592872    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-sysctl-d\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.593055 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592335    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-sysctl-conf\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593293    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-run-systemd\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593318    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-ovnkube-config\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593337    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-run\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593300    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-ovnkube-script-lib\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593370    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-etc-openvswitch\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593410    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-kubelet\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.592607    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-var-lib-openvswitch\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-kubernetes\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/197415e0-e604-40a0-af02-b22590f55c2e-tmp-dir\") pod \"node-resolver-cvkl5\" (UID: \"197415e0-e604-40a0-af02-b22590f55c2e\") " pod="openshift-dns/node-resolver-cvkl5"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-ovn-node-metrics-cert\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/380d5f9c-5375-4728-a66b-461ec152a23b-dbus\") pod \"global-pull-secret-syncer-wc9vw\" (UID: \"380d5f9c-5375-4728-a66b-461ec152a23b\") " pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-host\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/912d77fa-8dc2-459a-8469-be8706ce081d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-run-openvswitch\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593629    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-cni-bin\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-systemd\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593727    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-host\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.594369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593794    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-systemd\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593808    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-env-overrides\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593835    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-kubernetes\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593862    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/912d77fa-8dc2-459a-8469-be8706ce081d-system-cni-dir\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:42.593945    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593962    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/912d77fa-8dc2-459a-8469-be8706ce081d-cni-binary-copy\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:42.593995    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret podName:380d5f9c-5375-4728-a66b-461ec152a23b nodeName:}" failed. No retries permitted until 2026-09-10 23:36:43.093976847 +0000 UTC m=+3.134846132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret") pod "global-pull-secret-syncer-wc9vw" (UID: "380d5f9c-5375-4728-a66b-461ec152a23b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594065    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/197415e0-e604-40a0-af02-b22590f55c2e-tmp-dir\") pod \"node-resolver-cvkl5\" (UID: \"197415e0-e604-40a0-af02-b22590f55c2e\") " pod="openshift-dns/node-resolver-cvkl5"
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594155    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-cni-bin\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594185    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-run-openvswitch\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.593410    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-systemd-units\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594189    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/912d77fa-8dc2-459a-8469-be8706ce081d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-log-socket\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-sys\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594242    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/380d5f9c-5375-4728-a66b-461ec152a23b-dbus\") pod \"global-pull-secret-syncer-wc9vw\" (UID: \"380d5f9c-5375-4728-a66b-461ec152a23b\") " pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-var-lib-kubelet\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzg6q\" (UniqueName: \"kubernetes.io/projected/32277bda-aca3-4ea0-8f27-a420c4d80a32-kube-api-access-hzg6q\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.595518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594300    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-log-socket\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594318    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-run-netns\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594338    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-var-lib-kubelet\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594352    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/912d77fa-8dc2-459a-8469-be8706ce081d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-sys\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594378    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-node-log\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594427    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-run-netns\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-cni-netd\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-sysconfig\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594484    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32277bda-aca3-4ea0-8f27-a420c4d80a32-tmp\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594529    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/197415e0-e604-40a0-af02-b22590f55c2e-hosts-file\") pod \"node-resolver-cvkl5\" (UID: \"197415e0-e604-40a0-af02-b22590f55c2e\") " pod="openshift-dns/node-resolver-cvkl5"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-run-ovn-kubernetes\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-sysconfig\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594630    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-run-ovn-kubernetes\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594653    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-node-log\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594700    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-host-cni-netd\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594777    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/197415e0-e604-40a0-af02-b22590f55c2e-hosts-file\") pod \"node-resolver-cvkl5\" (UID: \"197415e0-e604-40a0-af02-b22590f55c2e\") " pod="openshift-dns/node-resolver-cvkl5"
Sep 10 23:36:42.596329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.594946    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/912d77fa-8dc2-459a-8469-be8706ce081d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.597722 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.597700    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32277bda-aca3-4ea0-8f27-a420c4d80a32-tmp\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.597978 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.597957    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32277bda-aca3-4ea0-8f27-a420c4d80a32-etc-tuned\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.598121 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.598100    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-ovn-node-metrics-cert\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.604893 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.604865    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbsjh\" (UniqueName: \"kubernetes.io/projected/912d77fa-8dc2-459a-8469-be8706ce081d-kube-api-access-nbsjh\") pod \"multus-additional-cni-plugins-526tg\" (UID: \"912d77fa-8dc2-459a-8469-be8706ce081d\") " pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.605440 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.605416    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdgvh\" (UniqueName: \"kubernetes.io/projected/197415e0-e604-40a0-af02-b22590f55c2e-kube-api-access-kdgvh\") pod \"node-resolver-cvkl5\" (UID: \"197415e0-e604-40a0-af02-b22590f55c2e\") " pod="openshift-dns/node-resolver-cvkl5"
Sep 10 23:36:42.606725 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.606675    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v45b4\" (UniqueName: \"kubernetes.io/projected/ba4da0b9-03ac-4ff4-ac98-f3b844029ecb-kube-api-access-v45b4\") pod \"ovnkube-node-s9nk5\" (UID: \"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.607485 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.607466    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzg6q\" (UniqueName: \"kubernetes.io/projected/32277bda-aca3-4ea0-8f27-a420c4d80a32-kube-api-access-hzg6q\") pod \"tuned-q8pv8\" (UID: \"32277bda-aca3-4ea0-8f27-a420c4d80a32\") " pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.675483 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.675447    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8"
Sep 10 23:36:42.695051 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.695017    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h7g65"
Sep 10 23:36:42.713313 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.713280    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hcf7p"
Sep 10 23:36:42.717495 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.717461    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zb552"
Sep 10 23:36:42.725652 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.725627    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7gdzf"
Sep 10 23:36:42.735734 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.735709    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:36:42.744865 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.744833    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cvkl5"
Sep 10 23:36:42.754010 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.753986    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q8pv8"
Sep 10 23:36:42.762026 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.761998    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-526tg"
Sep 10 23:36:42.998011 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:42.997923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs\") pod \"network-metrics-daemon-4gtf5\" (UID: \"afe96c24-b384-431f-85db-44d132dde401\") " pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:42.998179 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:42.998104    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:42.998236 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:42.998185    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs podName:afe96c24-b384-431f-85db-44d132dde401 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:43.998168546 +0000 UTC m=+4.039037850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs") pod "network-metrics-daemon-4gtf5" (UID: "afe96c24-b384-431f-85db-44d132dde401") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:43.098614 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:43.098572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhnmc\" (UniqueName: \"kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc\") pod \"network-check-target-xjmkz\" (UID: \"21ece222-a646-4ff2-b0bd-34580d528de4\") " pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:36:43.098827 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:43.098628    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret\") pod \"global-pull-secret-syncer-wc9vw\" (UID: \"380d5f9c-5375-4728-a66b-461ec152a23b\") " pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:43.098827 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:43.098777    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:43.098827 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:43.098798    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:36:43.098827 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:43.098827    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:36:43.099045 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:43.098841    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret podName:380d5f9c-5375-4728-a66b-461ec152a23b nodeName:}" failed. No retries permitted until 2026-09-10 23:36:44.09882012 +0000 UTC m=+4.139689422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret") pod "global-pull-secret-syncer-wc9vw" (UID: "380d5f9c-5375-4728-a66b-461ec152a23b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:43.099045 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:43.098846    2581 projected.go:196] Error preparing data for projected volume kube-api-access-bhnmc for pod openshift-network-diagnostics/network-check-target-xjmkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:43.099045 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:43.098914    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc podName:21ece222-a646-4ff2-b0bd-34580d528de4 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:44.098893568 +0000 UTC m=+4.139762866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhnmc" (UniqueName: "kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc") pod "network-check-target-xjmkz" (UID: "21ece222-a646-4ff2-b0bd-34580d528de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:43.427572 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:43.427518    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 23:31:42 +0000 UTC" deadline="2028-06-09 07:37:13.971515654 +0000 UTC"
Sep 10 23:36:43.427572 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:43.427565    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15296h0m30.543955683s"
Sep 10 23:36:43.689910 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:43.689874    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod197415e0_e604_40a0_af02_b22590f55c2e.slice/crio-e458e92575aa06dff592ada93ccdc8dd825a4fc4a2e8855da3cee947bf6140d2 WatchSource:0}: Error finding container e458e92575aa06dff592ada93ccdc8dd825a4fc4a2e8855da3cee947bf6140d2: Status 404 returned error can't find the container with id e458e92575aa06dff592ada93ccdc8dd825a4fc4a2e8855da3cee947bf6140d2
Sep 10 23:36:43.690505 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:43.690477    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ed315c_a8ea_457b_8795_b40ad51e0a01.slice/crio-ecb048a129a1dc63b67a34701510333db9a07d5d7a58c2e526822dbdacf092d0 WatchSource:0}: Error finding container ecb048a129a1dc63b67a34701510333db9a07d5d7a58c2e526822dbdacf092d0: Status 404 returned error can't find the container with id ecb048a129a1dc63b67a34701510333db9a07d5d7a58c2e526822dbdacf092d0
Sep 10 23:36:43.690822 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:43.690795    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod912d77fa_8dc2_459a_8469_be8706ce081d.slice/crio-e93dec5c99711ef87b4307753c726fb7deeb806387c2a7f809c2a9c9c7871ddd WatchSource:0}: Error finding container e93dec5c99711ef87b4307753c726fb7deeb806387c2a7f809c2a9c9c7871ddd: Status 404 returned error can't find the container with id e93dec5c99711ef87b4307753c726fb7deeb806387c2a7f809c2a9c9c7871ddd
Sep 10 23:36:43.697728 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:43.697702    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3fccb42_7296_4d10_9efc_e4d2344f71b4.slice/crio-7d99910409e0944a7ea20d074d13a4152c990dfd2d7a362856e0a303f54cdf0a WatchSource:0}: Error finding container 7d99910409e0944a7ea20d074d13a4152c990dfd2d7a362856e0a303f54cdf0a: Status 404 returned error can't find the container with id 7d99910409e0944a7ea20d074d13a4152c990dfd2d7a362856e0a303f54cdf0a
Sep 10 23:36:43.700446 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:36:43.700416    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba4da0b9_03ac_4ff4_ac98_f3b844029ecb.slice/crio-51e75b9dd888d93910a1a0b5e5706e0ddc866e5048fbef70f6e07d6fd89bc3aa WatchSource:0}: Error finding container 51e75b9dd888d93910a1a0b5e5706e0ddc866e5048fbef70f6e07d6fd89bc3aa: Status 404 returned error can't find the container with id 51e75b9dd888d93910a1a0b5e5706e0ddc866e5048fbef70f6e07d6fd89bc3aa
Sep 10 23:36:44.008999 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.008809    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs\") pod \"network-metrics-daemon-4gtf5\" (UID: \"afe96c24-b384-431f-85db-44d132dde401\") " pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:44.009157 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:44.008969    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:44.009229 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:44.009176    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs podName:afe96c24-b384-431f-85db-44d132dde401 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:46.009149934 +0000 UTC m=+6.050019223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs") pod "network-metrics-daemon-4gtf5" (UID: "afe96c24-b384-431f-85db-44d132dde401") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:44.109595 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.109558    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhnmc\" (UniqueName: \"kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc\") pod \"network-check-target-xjmkz\" (UID: \"21ece222-a646-4ff2-b0bd-34580d528de4\") " pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:36:44.109796 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.109626    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret\") pod \"global-pull-secret-syncer-wc9vw\" (UID: \"380d5f9c-5375-4728-a66b-461ec152a23b\") " pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:44.109796 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:44.109790    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:44.109925 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:44.109868    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret podName:380d5f9c-5375-4728-a66b-461ec152a23b nodeName:}" failed. No retries permitted until 2026-09-10 23:36:46.109839738 +0000 UTC m=+6.150709038 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret") pod "global-pull-secret-syncer-wc9vw" (UID: "380d5f9c-5375-4728-a66b-461ec152a23b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:44.109996 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:44.109956    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:36:44.109996 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:44.109967    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:36:44.109996 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:44.109977    2581 projected.go:196] Error preparing data for projected volume kube-api-access-bhnmc for pod openshift-network-diagnostics/network-check-target-xjmkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:44.110159 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:44.110036    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc podName:21ece222-a646-4ff2-b0bd-34580d528de4 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:46.110025173 +0000 UTC m=+6.150894462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhnmc" (UniqueName: "kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc") pod "network-check-target-xjmkz" (UID: "21ece222-a646-4ff2-b0bd-34580d528de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:44.428004 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.427878    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 23:31:42 +0000 UTC" deadline="2028-03-05 14:47:53.885508285 +0000 UTC"
Sep 10 23:36:44.428004 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.427939    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12999h11m9.457572741s"
Sep 10 23:36:44.478911 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.478873    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:36:44.479155 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.479003    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:44.479155 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:44.479023    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:36:44.479155 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.479046    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:44.479327 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:44.479157    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:36:44.479327 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:44.479242    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:36:44.503351 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.503307    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8" event={"ID":"76711a65-1e10-49cd-bd62-f762bc02f6e4","Type":"ContainerStarted","Data":"d60f3d20b8e9094c33426fbb99df60c476124bf9037583a6e27ec473b3439a75"}
Sep 10 23:36:44.512892 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.512850    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hcf7p" event={"ID":"d0d5e641-cb68-4660-9972-c48a5cebdd51","Type":"ContainerStarted","Data":"245076a3e86f6cc90e65c9d9b11888928d20f32d27ace5b34709733df7ca414f"}
Sep 10 23:36:44.520532 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.520493    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-526tg" event={"ID":"912d77fa-8dc2-459a-8469-be8706ce081d","Type":"ContainerStarted","Data":"e93dec5c99711ef87b4307753c726fb7deeb806387c2a7f809c2a9c9c7871ddd"}
Sep 10 23:36:44.532988 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.532650    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zb552" event={"ID":"e3fccb42-7296-4d10-9efc-e4d2344f71b4","Type":"ContainerStarted","Data":"7d99910409e0944a7ea20d074d13a4152c990dfd2d7a362856e0a303f54cdf0a"}
Sep 10 23:36:44.538023 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.537881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5" event={"ID":"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb","Type":"ContainerStarted","Data":"51e75b9dd888d93910a1a0b5e5706e0ddc866e5048fbef70f6e07d6fd89bc3aa"}
Sep 10 23:36:44.548647 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.548610    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h7g65" event={"ID":"54ed315c-a8ea-457b-8795-b40ad51e0a01","Type":"ContainerStarted","Data":"ecb048a129a1dc63b67a34701510333db9a07d5d7a58c2e526822dbdacf092d0"}
Sep 10 23:36:44.559610 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.559569    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cvkl5" event={"ID":"197415e0-e604-40a0-af02-b22590f55c2e","Type":"ContainerStarted","Data":"e458e92575aa06dff592ada93ccdc8dd825a4fc4a2e8855da3cee947bf6140d2"}
Sep 10 23:36:44.579359 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.578987    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal" event={"ID":"71a0709018cb1fe9919f44a57d998256","Type":"ContainerStarted","Data":"d80b8c653f3ece1c13812e26141af723e712435862d7408a771ddf8bd2f92ff6"}
Sep 10 23:36:44.590646 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.589966    2581 generic.go:356] "Generic (PLEG): container finished" podID="bbf41b1140a7013c210a677ef110508a" containerID="0e6821cad767c33436be2b062dd4056916dd73be7be57696211335791a5bc68f" exitCode=0
Sep 10 23:36:44.590646 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.590069    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" event={"ID":"bbf41b1140a7013c210a677ef110508a","Type":"ContainerDied","Data":"0e6821cad767c33436be2b062dd4056916dd73be7be57696211335791a5bc68f"}
Sep 10 23:36:44.602084 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.601965    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q8pv8" event={"ID":"32277bda-aca3-4ea0-8f27-a420c4d80a32","Type":"ContainerStarted","Data":"aa3771696e2b77cb81718b179e94ebf8dfd4615d26af4a093d61cc80203441bc"}
Sep 10 23:36:44.607170 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.607135    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7gdzf" event={"ID":"aef09d11-25b8-405f-8a39-68d1c7e17a46","Type":"ContainerStarted","Data":"fc9005c2b03f829dcd398c5ccb3ff92a3c50740fd9888dd52efcda8d671d6afd"}
Sep 10 23:36:44.612538 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:44.611301    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal" podStartSLOduration=2.611279405 podStartE2EDuration="2.611279405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:36:44.595078917 +0000 UTC m=+4.635948230" watchObservedRunningTime="2026-09-10 23:36:44.611279405 +0000 UTC m=+4.652148716"
Sep 10 23:36:45.622306 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:45.622264    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" event={"ID":"bbf41b1140a7013c210a677ef110508a","Type":"ContainerStarted","Data":"b420d0202288f73f8673af88c7d6f75207a62e29bdd78f15bd51bb996fa2b8c4"}
Sep 10 23:36:46.029491 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:46.029390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs\") pod \"network-metrics-daemon-4gtf5\" (UID: \"afe96c24-b384-431f-85db-44d132dde401\") " pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:46.029659 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:46.029589    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:46.029659 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:46.029657    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs podName:afe96c24-b384-431f-85db-44d132dde401 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:50.029637786 +0000 UTC m=+10.070507088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs") pod "network-metrics-daemon-4gtf5" (UID: "afe96c24-b384-431f-85db-44d132dde401") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:46.130680 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:46.130638    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret\") pod \"global-pull-secret-syncer-wc9vw\" (UID: \"380d5f9c-5375-4728-a66b-461ec152a23b\") " pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:46.130892 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:46.130749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhnmc\" (UniqueName: \"kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc\") pod \"network-check-target-xjmkz\" (UID: \"21ece222-a646-4ff2-b0bd-34580d528de4\") " pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:36:46.130963 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:46.130927    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:36:46.130963 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:46.130959    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:36:46.131060 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:46.130974    2581 projected.go:196] Error preparing data for projected volume kube-api-access-bhnmc for pod openshift-network-diagnostics/network-check-target-xjmkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:46.131060 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:46.131035    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc podName:21ece222-a646-4ff2-b0bd-34580d528de4 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:50.131016691 +0000 UTC m=+10.171885981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhnmc" (UniqueName: "kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc") pod "network-check-target-xjmkz" (UID: "21ece222-a646-4ff2-b0bd-34580d528de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:46.131509 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:46.131488    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:46.131621 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:46.131554    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret podName:380d5f9c-5375-4728-a66b-461ec152a23b nodeName:}" failed. No retries permitted until 2026-09-10 23:36:50.131537669 +0000 UTC m=+10.172406972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret") pod "global-pull-secret-syncer-wc9vw" (UID: "380d5f9c-5375-4728-a66b-461ec152a23b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:46.478211 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:46.478120    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:36:46.478387 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:46.478249    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:36:46.478622 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:46.478591    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:46.478733 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:46.478701    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:36:46.481201 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:46.478095    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:46.481337 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:46.481290    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:36:48.480439 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:48.479722    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:48.480439 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:48.479857    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:36:48.480439 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:48.479937    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:48.480439 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:48.479997    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:36:48.480439 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:48.480042    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:36:48.480439 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:48.480087    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:36:50.065035 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:50.064993    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs\") pod \"network-metrics-daemon-4gtf5\" (UID: \"afe96c24-b384-431f-85db-44d132dde401\") " pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:50.065454 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:50.065179    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:50.065454 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:50.065249    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs podName:afe96c24-b384-431f-85db-44d132dde401 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:58.065228264 +0000 UTC m=+18.106097568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs") pod "network-metrics-daemon-4gtf5" (UID: "afe96c24-b384-431f-85db-44d132dde401") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:50.165689 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:50.165634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret\") pod \"global-pull-secret-syncer-wc9vw\" (UID: \"380d5f9c-5375-4728-a66b-461ec152a23b\") " pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:50.165873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:50.165744    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhnmc\" (UniqueName: \"kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc\") pod \"network-check-target-xjmkz\" (UID: \"21ece222-a646-4ff2-b0bd-34580d528de4\") " pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:36:50.165940 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:50.165901    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:36:50.165940 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:50.165920    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:36:50.165940 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:50.165932    2581 projected.go:196] Error preparing data for projected volume kube-api-access-bhnmc for pod openshift-network-diagnostics/network-check-target-xjmkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:50.166084 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:50.166038    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc podName:21ece222-a646-4ff2-b0bd-34580d528de4 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:58.166019228 +0000 UTC m=+18.206888514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhnmc" (UniqueName: "kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc") pod "network-check-target-xjmkz" (UID: "21ece222-a646-4ff2-b0bd-34580d528de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:50.166470 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:50.166443    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:50.166543 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:50.166504    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret podName:380d5f9c-5375-4728-a66b-461ec152a23b nodeName:}" failed. No retries permitted until 2026-09-10 23:36:58.166489613 +0000 UTC m=+18.207358899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret") pod "global-pull-secret-syncer-wc9vw" (UID: "380d5f9c-5375-4728-a66b-461ec152a23b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:50.479298 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:50.479208    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:50.479298 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:50.479235    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:36:50.479298 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:50.479257    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:50.479551 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:50.479351    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:36:50.479551 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:50.479470    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:36:50.479660 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:50.479551    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:36:52.477820 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:52.477780    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:52.478234 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:52.477781    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:36:52.478234 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:52.477927    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:36:52.478234 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:52.477795    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:52.478234 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:52.478005    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:36:52.478234 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:52.478068    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:36:54.477795 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:54.477264    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:36:54.477795 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:54.477308    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:54.477795 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:54.477267    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:54.477795 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:54.477409    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:36:54.477795 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:54.477539    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:36:54.477795 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:54.477627    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:36:56.478060 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:56.478022    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:56.478551 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:56.478157    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:36:56.478551 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:56.478037    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:56.478551 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:56.478276    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:36:56.478551 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:56.478022    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:36:56.478551 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:56.478348    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:36:58.124895 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:58.124853    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs\") pod \"network-metrics-daemon-4gtf5\" (UID: \"afe96c24-b384-431f-85db-44d132dde401\") " pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:58.125415 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:58.125053    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:58.125415 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:58.125147    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs podName:afe96c24-b384-431f-85db-44d132dde401 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:14.125125939 +0000 UTC m=+34.165995235 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs") pod "network-metrics-daemon-4gtf5" (UID: "afe96c24-b384-431f-85db-44d132dde401") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:58.225258 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:58.225219    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhnmc\" (UniqueName: \"kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc\") pod \"network-check-target-xjmkz\" (UID: \"21ece222-a646-4ff2-b0bd-34580d528de4\") " pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:36:58.225445 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:58.225280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret\") pod \"global-pull-secret-syncer-wc9vw\" (UID: \"380d5f9c-5375-4728-a66b-461ec152a23b\") " pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:58.225445 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:58.225393    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:58.225445 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:58.225418    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:36:58.225445 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:58.225449    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:36:58.225626 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:58.225462    2581 projected.go:196] Error preparing data for projected volume kube-api-access-bhnmc for pod openshift-network-diagnostics/network-check-target-xjmkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:58.225626 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:58.225465    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret podName:380d5f9c-5375-4728-a66b-461ec152a23b nodeName:}" failed. No retries permitted until 2026-09-10 23:37:14.225448829 +0000 UTC m=+34.266318135 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret") pod "global-pull-secret-syncer-wc9vw" (UID: "380d5f9c-5375-4728-a66b-461ec152a23b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:58.225626 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:58.225527    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc podName:21ece222-a646-4ff2-b0bd-34580d528de4 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:14.225511713 +0000 UTC m=+34.266381001 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhnmc" (UniqueName: "kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc") pod "network-check-target-xjmkz" (UID: "21ece222-a646-4ff2-b0bd-34580d528de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:58.477810 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:58.477776    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:36:58.477962 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:58.477778    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:36:58.477962 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:58.477906    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:36:58.477962 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:36:58.477778    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:36:58.478094 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:58.477965    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:36:58.478094 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:36:58.478045    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:37:00.478154 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:00.478119    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:37:00.478645 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:00.478208    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:37:00.478645 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:00.478245    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:37:00.478645 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:00.478276    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:37:00.478645 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:00.478335    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:37:00.478645 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:00.478408    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:37:02.479539 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:02.477867    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:37:02.479539 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:02.477894    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:37:02.479539 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:02.477996    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:37:02.479539 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:02.478359    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:37:02.479539 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:02.478465    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:37:02.479539 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:02.478555    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:37:03.664199 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.663726    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q8pv8" event={"ID":"32277bda-aca3-4ea0-8f27-a420c4d80a32","Type":"ContainerStarted","Data":"3491afafca14cbe28444b0c7b7a01c18f4ccfa44249ccad358c524db27c80a11"}
Sep 10 23:37:03.665491 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.665460    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7gdzf" event={"ID":"aef09d11-25b8-405f-8a39-68d1c7e17a46","Type":"ContainerStarted","Data":"60102dd8706e853ad3181f070c1083ec92610257065c4d86e4ceb22450663844"}
Sep 10 23:37:03.667130 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.667101    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8" event={"ID":"76711a65-1e10-49cd-bd62-f762bc02f6e4","Type":"ContainerStarted","Data":"2b0e01107f2b40a8c6d28d0ded5716e5820c65620c3534862dc920fad4ea0ae9"}
Sep 10 23:37:03.669038 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.669009    2581 generic.go:356] "Generic (PLEG): container finished" podID="912d77fa-8dc2-459a-8469-be8706ce081d" containerID="e77432359e51a67fb392c2ba05621f1752196a8cb02233bd9fc6e9bef3759b5b" exitCode=0
Sep 10 23:37:03.669168 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.669101    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-526tg" event={"ID":"912d77fa-8dc2-459a-8469-be8706ce081d","Type":"ContainerDied","Data":"e77432359e51a67fb392c2ba05621f1752196a8cb02233bd9fc6e9bef3759b5b"}
Sep 10 23:37:03.671291 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.671269    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zb552" event={"ID":"e3fccb42-7296-4d10-9efc-e4d2344f71b4","Type":"ContainerStarted","Data":"c2f703b7fb899a21d4a9bd820c79160218ea0a11aa1d6be975960cb21ec34610"}
Sep 10 23:37:03.674708 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.674687    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5" event={"ID":"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb","Type":"ContainerStarted","Data":"604eaa00c795529a58d6584ea6b6173b14973f90fe1234f951c0b861db70b477"}
Sep 10 23:37:03.674836 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.674742    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5" event={"ID":"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb","Type":"ContainerStarted","Data":"cc15ff89a6660fbb539770b8543840e8ad9fe2af95c305bce86a131654a43d6c"}
Sep 10 23:37:03.674836 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.674774    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5" event={"ID":"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb","Type":"ContainerStarted","Data":"c0e1999c610b8bfe400a1b0ec8faeca8c56654bda72e5b550dd96384ede1b874"}
Sep 10 23:37:03.674836 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.674803    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5" event={"ID":"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb","Type":"ContainerStarted","Data":"1cb2a4b0bbadd75b35d0a2ddcebe7637e51729ba26664bccefe8968a0b73f2ac"}
Sep 10 23:37:03.674836 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.674833    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5" event={"ID":"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb","Type":"ContainerStarted","Data":"177ae1826a96e42d131d44fd551a758ab98f927dc496ecbdb0f089ba9c894562"}
Sep 10 23:37:03.675047 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.674862    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5" event={"ID":"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb","Type":"ContainerStarted","Data":"20eb862444fc6c821a7aa94242e64ccd7d022ca7354bc448e9d9349b1bf15483"}
Sep 10 23:37:03.676502 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.676302    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h7g65" event={"ID":"54ed315c-a8ea-457b-8795-b40ad51e0a01","Type":"ContainerStarted","Data":"702f3516056b67037032e96a3079dfa8797f01bc2ba0fb6af4289df4adc76259"}
Sep 10 23:37:03.678006 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.677983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cvkl5" event={"ID":"197415e0-e604-40a0-af02-b22590f55c2e","Type":"ContainerStarted","Data":"ed4e13a9a59b9651a4c243741b6a72d52f2231369c1a719f69a37ed4ce0a1b5f"}
Sep 10 23:37:03.682832 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.682788    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" podStartSLOduration=21.682774838 podStartE2EDuration="21.682774838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:36:45.640067709 +0000 UTC m=+5.680937017" watchObservedRunningTime="2026-09-10 23:37:03.682774838 +0000 UTC m=+23.723644143"
Sep 10 23:37:03.683238 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.683209    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q8pv8" podStartSLOduration=3.730311037 podStartE2EDuration="22.68320206s" totalImagesPullingTime="18.952891023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:03.682433449 +0000 UTC m=+23.723302754" watchObservedRunningTime="2026-09-10 23:37:03.68320206 +0000 UTC m=+23.724071375"
Sep 10 23:37:03.713682 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.713607    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zb552" podStartSLOduration=3.693371098 podStartE2EDuration="22.71359097s" totalImagesPullingTime="19.020219872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:03.713479264 +0000 UTC m=+23.754348582" watchObservedRunningTime="2026-09-10 23:37:03.71359097 +0000 UTC m=+23.754460276"
Sep 10 23:37:03.731499 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.731453    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7gdzf" podStartSLOduration=7.887464664 podStartE2EDuration="22.731438804s" totalImagesPullingTime="14.84397414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:03.73104322 +0000 UTC m=+23.771912526" watchObservedRunningTime="2026-09-10 23:37:03.731438804 +0000 UTC m=+23.772308108"
Sep 10 23:37:03.777193 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.777167    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7gdzf"
Sep 10 23:37:03.777744 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.777726    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7gdzf"
Sep 10 23:37:03.787890 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.787848    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h7g65" podStartSLOduration=3.8390714470000002 podStartE2EDuration="22.787834728s" totalImagesPullingTime="18.948763281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:03.768106775 +0000 UTC m=+23.808976079" watchObservedRunningTime="2026-09-10 23:37:03.787834728 +0000 UTC m=+23.828704033"
Sep 10 23:37:03.808735 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.808665    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cvkl5" podStartSLOduration=3.857165207 podStartE2EDuration="22.808652821s" totalImagesPullingTime="18.951487614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:03.787960077 +0000 UTC m=+23.828829361" watchObservedRunningTime="2026-09-10 23:37:03.808652821 +0000 UTC m=+23.849522170"
Sep 10 23:37:03.912440 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.912370    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:03.994069 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:03.994029    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:04.162688 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.162641    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 23:37:04.389044 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.388961    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:04.449134 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.449023    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T23:37:04.162689107Z","UUID":"ea12e049-54f6-4ffe-94a4-caae3a9e5f44","Handler":null,"Name":"","Endpoint":""}
Sep 10 23:37:04.450655 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.450633    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 23:37:04.450811 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.450689    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 23:37:04.453598 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.453573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:04.477765 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.477733    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:37:04.477933 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.477735    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:37:04.477933 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:04.477851    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:37:04.477933 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:04.477921    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:37:04.478106 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.477745    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:37:04.478106 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:04.477982    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:37:04.683356 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.683230    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8" event={"ID":"76711a65-1e10-49cd-bd62-f762bc02f6e4","Type":"ContainerStarted","Data":"a4c4f82547cc540940f9033168e66a71d3c2a64722b22285d09d249b338c654a"}
Sep 10 23:37:04.685846 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.685809    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hcf7p" event={"ID":"d0d5e641-cb68-4660-9972-c48a5cebdd51","Type":"ContainerStarted","Data":"89c67db915000fc30d7d66af9e32f65c0868c85f32ab0369571fc9803f886461"}
Sep 10 23:37:04.686219 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.686192    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7gdzf"
Sep 10 23:37:04.686709 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.686691    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7gdzf"
Sep 10 23:37:04.701131 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.700923    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hcf7p" podStartSLOduration=4.753324459 podStartE2EDuration="23.700902473s" totalImagesPullingTime="18.947578014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:04.699982983 +0000 UTC m=+24.740852289" watchObservedRunningTime="2026-09-10 23:37:04.700902473 +0000 UTC m=+24.741771779"
Sep 10 23:37:04.786158 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.786120    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:04.877175 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.877139    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:04.936188 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:04.936120    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:05.690877 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:05.690837    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8" event={"ID":"76711a65-1e10-49cd-bd62-f762bc02f6e4","Type":"ContainerStarted","Data":"31078c70ea4315324eeb487395b0930ad5cf1617fb03d9ac4bd85b11c6fce4da"}
Sep 10 23:37:05.695016 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:05.694971    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5" event={"ID":"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb","Type":"ContainerStarted","Data":"e62c750dc28e26097e54b1121b4ff5decf6aafc9f7b3ae9e7814bd9a82b06748"}
Sep 10 23:37:05.710505 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:05.710456    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq5j8" podStartSLOduration=3.64681552 podStartE2EDuration="24.710440283s" totalImagesPullingTime="21.063624763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:05.710045151 +0000 UTC m=+25.750914456" watchObservedRunningTime="2026-09-10 23:37:05.710440283 +0000 UTC m=+25.751309588"
Sep 10 23:37:06.477685 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:06.477627    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:37:06.477869 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:06.477785    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:37:06.478200 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:06.478177    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:37:06.478294 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:06.478277    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:37:06.478343 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:06.478337    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:37:06.478414 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:06.478396    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:37:08.477978 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:08.477813    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:37:08.478569 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:08.477816    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:37:08.478569 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:08.478059    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:37:08.478569 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:08.477833    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:37:08.478569 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:08.478160    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:37:08.478569 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:08.478276    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:37:08.703615 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:08.703584    2581 generic.go:356] "Generic (PLEG): container finished" podID="912d77fa-8dc2-459a-8469-be8706ce081d" containerID="cdb3c9ccfdb7fa8d7e7dc3bad262c3aa5297dc106f3911d0a9a57e82ff46f7bc" exitCode=0
Sep 10 23:37:08.703799 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:08.703662    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-526tg" event={"ID":"912d77fa-8dc2-459a-8469-be8706ce081d","Type":"ContainerDied","Data":"cdb3c9ccfdb7fa8d7e7dc3bad262c3aa5297dc106f3911d0a9a57e82ff46f7bc"}
Sep 10 23:37:08.707760 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:08.707737    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5" event={"ID":"ba4da0b9-03ac-4ff4-ac98-f3b844029ecb","Type":"ContainerStarted","Data":"611b92b5b52a61ceab3ee9985dd3a876d5434405d3391e5fc641d36ab25a47c8"}
Sep 10 23:37:08.708015 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:08.708002    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:37:08.724353 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:08.724329    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:37:08.760535 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:08.760414    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5" podStartSLOduration=8.77106832 podStartE2EDuration="27.760395031s" totalImagesPullingTime="18.989326711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:08.758826761 +0000 UTC m=+28.799696065" watchObservedRunningTime="2026-09-10 23:37:08.760395031 +0000 UTC m=+28.801264335"
Sep 10 23:37:09.712054 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:09.711875    2581 generic.go:356] "Generic (PLEG): container finished" podID="912d77fa-8dc2-459a-8469-be8706ce081d" containerID="2af92c1ddad740d6b270a2a5891f48c81dd57e026ca0064bcdf4f9f46ca06388" exitCode=0
Sep 10 23:37:09.712439 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:09.711954    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-526tg" event={"ID":"912d77fa-8dc2-459a-8469-be8706ce081d","Type":"ContainerDied","Data":"2af92c1ddad740d6b270a2a5891f48c81dd57e026ca0064bcdf4f9f46ca06388"}
Sep 10 23:37:09.713283 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:09.712570    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:37:09.713283 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:09.712635    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:37:09.729400 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:09.729371    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:37:09.822928 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:09.822889    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wc9vw"]
Sep 10 23:37:09.823103 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:09.823008    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:37:09.823179 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:09.823119    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:37:09.826187 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:09.826163    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xjmkz"]
Sep 10 23:37:09.826317 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:09.826280    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:37:09.826406 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:09.826386    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:37:09.826772 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:09.826744    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4gtf5"]
Sep 10 23:37:09.826882 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:09.826836    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:37:09.826945 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:09.826928    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:37:10.567888 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:10.567799    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:10.637015 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:10.636976    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:10.717745 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:10.717714    2581 generic.go:356] "Generic (PLEG): container finished" podID="912d77fa-8dc2-459a-8469-be8706ce081d" containerID="3ffd606615a0219a0ae03c76bb0f3e7170c0bf1dc706ea6c3561c7884ad93643" exitCode=0
Sep 10 23:37:10.718194 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:10.717802    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-526tg" event={"ID":"912d77fa-8dc2-459a-8469-be8706ce081d","Type":"ContainerDied","Data":"3ffd606615a0219a0ae03c76bb0f3e7170c0bf1dc706ea6c3561c7884ad93643"}
Sep 10 23:37:11.477896 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:11.477859    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:37:11.478076 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:11.477866    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:37:11.478076 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:11.478000    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:37:11.478076 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:11.478067    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:37:11.478239 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:11.478156    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:37:11.478294 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:11.478240    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:37:12.480079 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:12.479992    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:12.570396 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:12.570369    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:12.633731 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:12.633693    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:13.477349 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:13.477312    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:37:13.477521 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:13.477316    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:37:13.477521 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:13.477457    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjmkz" podUID="21ece222-a646-4ff2-b0bd-34580d528de4"
Sep 10 23:37:13.477521 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:13.477313    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:37:13.477711 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:13.477545    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gtf5" podUID="afe96c24-b384-431f-85db-44d132dde401"
Sep 10 23:37:13.477711 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:13.477627    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc9vw" podUID="380d5f9c-5375-4728-a66b-461ec152a23b"
Sep 10 23:37:13.493322 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:13.493282    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:13.591276 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:13.591238    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:14.151622 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:14.151385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs\") pod \"network-metrics-daemon-4gtf5\" (UID: \"afe96c24-b384-431f-85db-44d132dde401\") " pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:37:14.151822 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:14.151548    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:37:14.151822 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:14.151736    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs podName:afe96c24-b384-431f-85db-44d132dde401 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:46.151714412 +0000 UTC m=+66.192583708 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs") pod "network-metrics-daemon-4gtf5" (UID: "afe96c24-b384-431f-85db-44d132dde401") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:37:14.252607 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:14.252569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret\") pod \"global-pull-secret-syncer-wc9vw\" (UID: \"380d5f9c-5375-4728-a66b-461ec152a23b\") " pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:37:14.252821 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:14.252656    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhnmc\" (UniqueName: \"kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc\") pod \"network-check-target-xjmkz\" (UID: \"21ece222-a646-4ff2-b0bd-34580d528de4\") " pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:37:14.252821 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:14.252739    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:37:14.252821 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:14.252783    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:37:14.252821 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:14.252805    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:37:14.252821 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:14.252819    2581 projected.go:196] Error preparing data for projected volume kube-api-access-bhnmc for pod openshift-network-diagnostics/network-check-target-xjmkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:37:14.253057 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:14.252820    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret podName:380d5f9c-5375-4728-a66b-461ec152a23b nodeName:}" failed. No retries permitted until 2026-09-10 23:37:46.252798536 +0000 UTC m=+66.293667834 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret") pod "global-pull-secret-syncer-wc9vw" (UID: "380d5f9c-5375-4728-a66b-461ec152a23b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:37:14.253057 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:14.252884    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc podName:21ece222-a646-4ff2-b0bd-34580d528de4 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:46.252866566 +0000 UTC m=+66.293735849 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhnmc" (UniqueName: "kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc") pod "network-check-target-xjmkz" (UID: "21ece222-a646-4ff2-b0bd-34580d528de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:37:15.222455 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.222425    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeReady"
Sep 10 23:37:15.222974 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.222584    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 23:37:15.278998 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.278795    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zgxwp"]
Sep 10 23:37:15.294926 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.294897    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cjngp"]
Sep 10 23:37:15.295071 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.295039    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:15.299015 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.298973    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 23:37:15.299159 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.299060    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6vpbd\""
Sep 10 23:37:15.299355 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.299340    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 23:37:15.313005 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.312975    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cjngp"]
Sep 10 23:37:15.313005 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.313010    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zgxwp"]
Sep 10 23:37:15.313168 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.313105    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cjngp"
Sep 10 23:37:15.316179 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.316156    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-45clb\""
Sep 10 23:37:15.316297 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.316200    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 23:37:15.316403 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.316390    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 23:37:15.319894 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.319876    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 23:37:15.429906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.429878    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:15.460646 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.460611    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:15.460841 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.460655    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkxrp\" (UniqueName: \"kubernetes.io/projected/3f873507-a363-4ab5-b68a-8aaa1747b705-kube-api-access-lkxrp\") pod \"ingress-canary-cjngp\" (UID: \"3f873507-a363-4ab5-b68a-8aaa1747b705\") " pod="openshift-ingress-canary/ingress-canary-cjngp"
Sep 10 23:37:15.460841 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.460701    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6630eff-f33d-407a-b37a-2e81d3ec968c-tmp-dir\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:15.460841 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.460822    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f873507-a363-4ab5-b68a-8aaa1747b705-cert\") pod \"ingress-canary-cjngp\" (UID: \"3f873507-a363-4ab5-b68a-8aaa1747b705\") " pod="openshift-ingress-canary/ingress-canary-cjngp"
Sep 10 23:37:15.460950 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.460842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-splm9\" (UniqueName: \"kubernetes.io/projected/e6630eff-f33d-407a-b37a-2e81d3ec968c-kube-api-access-splm9\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:15.460950 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.460871    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6630eff-f33d-407a-b37a-2e81d3ec968c-config-volume\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:15.477793 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.477766    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:37:15.477793 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.477784    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:37:15.477960 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.477785    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:37:15.480538 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.480407    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 23:37:15.480538 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.480437    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 23:37:15.480538 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.480455    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 23:37:15.480538 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.480479    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xgqvn\""
Sep 10 23:37:15.480538 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.480414    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cql7l\""
Sep 10 23:37:15.480538 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.480411    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 23:37:15.489548 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.489516    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:15.562118 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.562088    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f873507-a363-4ab5-b68a-8aaa1747b705-cert\") pod \"ingress-canary-cjngp\" (UID: \"3f873507-a363-4ab5-b68a-8aaa1747b705\") " pod="openshift-ingress-canary/ingress-canary-cjngp"
Sep 10 23:37:15.562244 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.562127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-splm9\" (UniqueName: \"kubernetes.io/projected/e6630eff-f33d-407a-b37a-2e81d3ec968c-kube-api-access-splm9\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:15.562244 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.562157    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6630eff-f33d-407a-b37a-2e81d3ec968c-config-volume\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:15.562244 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.562183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:15.562474 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.562212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkxrp\" (UniqueName: \"kubernetes.io/projected/3f873507-a363-4ab5-b68a-8aaa1747b705-kube-api-access-lkxrp\") pod \"ingress-canary-cjngp\" (UID: \"3f873507-a363-4ab5-b68a-8aaa1747b705\") " pod="openshift-ingress-canary/ingress-canary-cjngp"
Sep 10 23:37:15.563006 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.562720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6630eff-f33d-407a-b37a-2e81d3ec968c-tmp-dir\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:15.563006 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:15.562933    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 23:37:15.563193 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:15.563137    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls podName:e6630eff-f33d-407a-b37a-2e81d3ec968c nodeName:}" failed. No retries permitted until 2026-09-10 23:37:16.06311481 +0000 UTC m=+36.103984097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls") pod "dns-default-zgxwp" (UID: "e6630eff-f33d-407a-b37a-2e81d3ec968c") : secret "dns-default-metrics-tls" not found
Sep 10 23:37:15.563253 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.563225    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6630eff-f33d-407a-b37a-2e81d3ec968c-tmp-dir\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:15.564623 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.563363    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6630eff-f33d-407a-b37a-2e81d3ec968c-config-volume\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:15.567554 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.567527    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f873507-a363-4ab5-b68a-8aaa1747b705-cert\") pod \"ingress-canary-cjngp\" (UID: \"3f873507-a363-4ab5-b68a-8aaa1747b705\") " pod="openshift-ingress-canary/ingress-canary-cjngp"
Sep 10 23:37:15.571690 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.571653    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-splm9\" (UniqueName: \"kubernetes.io/projected/e6630eff-f33d-407a-b37a-2e81d3ec968c-kube-api-access-splm9\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:15.572061 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.572045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkxrp\" (UniqueName: \"kubernetes.io/projected/3f873507-a363-4ab5-b68a-8aaa1747b705-kube-api-access-lkxrp\") pod \"ingress-canary-cjngp\" (UID: \"3f873507-a363-4ab5-b68a-8aaa1747b705\") " pod="openshift-ingress-canary/ingress-canary-cjngp"
Sep 10 23:37:15.645245 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.645208    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cjngp"
Sep 10 23:37:15.734019 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.733988    2581 generic.go:356] "Generic (PLEG): container finished" podID="912d77fa-8dc2-459a-8469-be8706ce081d" containerID="d3b6340eb56fe2c2d35fe18149f6b649e236aa68d744f73b410172aad89b5b6e" exitCode=0
Sep 10 23:37:15.734170 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.734038    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-526tg" event={"ID":"912d77fa-8dc2-459a-8469-be8706ce081d","Type":"ContainerDied","Data":"d3b6340eb56fe2c2d35fe18149f6b649e236aa68d744f73b410172aad89b5b6e"}
Sep 10 23:37:15.975289 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:15.975248    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cjngp"]
Sep 10 23:37:15.978878 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:37:15.978844    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f873507_a363_4ab5_b68a_8aaa1747b705.slice/crio-7f42972126442df2ca69cb75d58fad8f03e8454cd98df6529cce0fdaecc39217 WatchSource:0}: Error finding container 7f42972126442df2ca69cb75d58fad8f03e8454cd98df6529cce0fdaecc39217: Status 404 returned error can't find the container with id 7f42972126442df2ca69cb75d58fad8f03e8454cd98df6529cce0fdaecc39217
Sep 10 23:37:16.067417 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:16.067197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:16.067417 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:16.067349    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 23:37:16.067618 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:16.067432    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls podName:e6630eff-f33d-407a-b37a-2e81d3ec968c nodeName:}" failed. No retries permitted until 2026-09-10 23:37:17.067417477 +0000 UTC m=+37.108286760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls") pod "dns-default-zgxwp" (UID: "e6630eff-f33d-407a-b37a-2e81d3ec968c") : secret "dns-default-metrics-tls" not found
Sep 10 23:37:16.740489 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:16.740454    2581 generic.go:356] "Generic (PLEG): container finished" podID="912d77fa-8dc2-459a-8469-be8706ce081d" containerID="12a0feafb5c48d677d7e8aafdfbacba54fbb2e995cf75950f7460df7b4095d00" exitCode=0
Sep 10 23:37:16.741356 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:16.740549    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-526tg" event={"ID":"912d77fa-8dc2-459a-8469-be8706ce081d","Type":"ContainerDied","Data":"12a0feafb5c48d677d7e8aafdfbacba54fbb2e995cf75950f7460df7b4095d00"}
Sep 10 23:37:16.742037 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:16.742000    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cjngp" event={"ID":"3f873507-a363-4ab5-b68a-8aaa1747b705","Type":"ContainerStarted","Data":"7f42972126442df2ca69cb75d58fad8f03e8454cd98df6529cce0fdaecc39217"}
Sep 10 23:37:17.075657 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:17.075539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:17.075832 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:17.075724    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 23:37:17.075832 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:17.075805    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls podName:e6630eff-f33d-407a-b37a-2e81d3ec968c nodeName:}" failed. No retries permitted until 2026-09-10 23:37:19.075781666 +0000 UTC m=+39.116650965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls") pod "dns-default-zgxwp" (UID: "e6630eff-f33d-407a-b37a-2e81d3ec968c") : secret "dns-default-metrics-tls" not found
Sep 10 23:37:17.498073 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:17.498041    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:17.749732 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:17.749187    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-526tg" event={"ID":"912d77fa-8dc2-459a-8469-be8706ce081d","Type":"ContainerStarted","Data":"0111fa15cb7d012204b4c47ec2dff1c2dee1272651ff7e1c4f809870f7bf8110"}
Sep 10 23:37:17.808468 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:17.808406    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-526tg" podStartSLOduration=8.033596626 podStartE2EDuration="36.808383368s" totalImagesPullingTime="28.774786742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:17.806717534 +0000 UTC m=+37.847586840" watchObservedRunningTime="2026-09-10 23:37:17.808383368 +0000 UTC m=+37.849252675"
Sep 10 23:37:17.993990 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:17.993954    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:18.075248 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:18.075180    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:18.753313 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:18.753274    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cjngp" event={"ID":"3f873507-a363-4ab5-b68a-8aaa1747b705","Type":"ContainerStarted","Data":"245021be7ebc579e26c2e689308f89345898279bd06581d295ae1320de57de73"}
Sep 10 23:37:18.769416 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:18.769359    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cjngp" podStartSLOduration=1.39204994 podStartE2EDuration="3.769342448s" totalImagesPullingTime="2.377292508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:18.769044227 +0000 UTC m=+38.809913532" watchObservedRunningTime="2026-09-10 23:37:18.769342448 +0000 UTC m=+38.810211753"
Sep 10 23:37:19.092150 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:19.092067    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:19.092284 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:19.092227    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 23:37:19.092323 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:19.092306    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls podName:e6630eff-f33d-407a-b37a-2e81d3ec968c nodeName:}" failed. No retries permitted until 2026-09-10 23:37:23.092290219 +0000 UTC m=+43.133159505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls") pod "dns-default-zgxwp" (UID: "e6630eff-f33d-407a-b37a-2e81d3ec968c") : secret "dns-default-metrics-tls" not found
Sep 10 23:37:20.850758 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:20.850718    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:20.951581 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:20.951544    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:23.119171 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:23.119133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:23.119632 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:23.119268    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 23:37:23.119632 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:23.119355    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls podName:e6630eff-f33d-407a-b37a-2e81d3ec968c nodeName:}" failed. No retries permitted until 2026-09-10 23:37:31.119334397 +0000 UTC m=+51.160203681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls") pod "dns-default-zgxwp" (UID: "e6630eff-f33d-407a-b37a-2e81d3ec968c") : secret "dns-default-metrics-tls" not found
Sep 10 23:37:24.158834 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:24.158802    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:24.219779 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:24.219737    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:25.425803 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:25.425772    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:25.528378 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:25.528345    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:27.360625 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.360588    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"]
Sep 10 23:37:27.390235 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.390210    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg"]
Sep 10 23:37:27.390379 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.390335    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:27.395640 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.395614    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 10 23:37:27.395797 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.395658    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 23:37:27.409583 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.409560    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-khtf4\""
Sep 10 23:37:27.409820 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.409801    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 23:37:27.409915 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.409844    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 10 23:37:27.412464 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.412440    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg"]
Sep 10 23:37:27.412572 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.412498    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"]
Sep 10 23:37:27.412634 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.412610    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg"
Sep 10 23:37:27.415715 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.415698    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:37:27.417293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.417275    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 10 23:37:27.417405 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.417383    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2svw2\""
Sep 10 23:37:27.425696 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.425662    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 10 23:37:27.459928 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.459904    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-q8779"]
Sep 10 23:37:27.484276 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.484252    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-q8779"]
Sep 10 23:37:27.484438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.484340    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-q8779"
Sep 10 23:37:27.486750 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.486732    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-5zfhk\""
Sep 10 23:37:27.548010 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.547980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw5th\" (UniqueName: \"kubernetes.io/projected/46a48a97-1c0b-44fe-a2ed-699ee46194dd-kube-api-access-pw5th\") pod \"cluster-samples-operator-86499c89c4-mtcrg\" (UID: \"46a48a97-1c0b-44fe-a2ed-699ee46194dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg"
Sep 10 23:37:27.548145 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.548035    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-btsrj\" (UID: \"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:27.548145 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.548059    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-btsrj\" (UID: \"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:27.548145 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.548085    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhqjf\" (UniqueName: \"kubernetes.io/projected/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-kube-api-access-hhqjf\") pod \"cluster-monitoring-operator-6cd954b897-btsrj\" (UID: \"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:27.548145 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.548108    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mtcrg\" (UID: \"46a48a97-1c0b-44fe-a2ed-699ee46194dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg"
Sep 10 23:37:27.560827 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.560792    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"]
Sep 10 23:37:27.586074 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.586037    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c59bf648c-hbdwl"]
Sep 10 23:37:27.586208 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.586158    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"
Sep 10 23:37:27.589634 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.589611    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 10 23:37:27.589634 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.589626    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-566dk\""
Sep 10 23:37:27.590273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.590255    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 10 23:37:27.610144 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.610122    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"]
Sep 10 23:37:27.610257 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.610153    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c59bf648c-hbdwl"]
Sep 10 23:37:27.610257 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.610232    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.613100 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.613025    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 23:37:27.613100 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.613064    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-67vss\""
Sep 10 23:37:27.613267 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.613110    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 23:37:27.613267 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.613128    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 23:37:27.618057 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.618038    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 23:37:27.648353 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.648324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw5th\" (UniqueName: \"kubernetes.io/projected/46a48a97-1c0b-44fe-a2ed-699ee46194dd-kube-api-access-pw5th\") pod \"cluster-samples-operator-86499c89c4-mtcrg\" (UID: \"46a48a97-1c0b-44fe-a2ed-699ee46194dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg"
Sep 10 23:37:27.648490 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.648374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-btsrj\" (UID: \"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:27.648490 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.648400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-btsrj\" (UID: \"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:27.648490 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.648429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgrvz\" (UniqueName: \"kubernetes.io/projected/08a628f7-8d9d-40c8-bce1-725d011c2d0d-kube-api-access-rgrvz\") pod \"network-check-source-6f8b768455-q8779\" (UID: \"08a628f7-8d9d-40c8-bce1-725d011c2d0d\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-q8779"
Sep 10 23:37:27.648490 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.648472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhqjf\" (UniqueName: \"kubernetes.io/projected/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-kube-api-access-hhqjf\") pod \"cluster-monitoring-operator-6cd954b897-btsrj\" (UID: \"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:27.648718 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:27.648494    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:27.648718 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.648513    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mtcrg\" (UID: \"46a48a97-1c0b-44fe-a2ed-699ee46194dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg"
Sep 10 23:37:27.648718 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:27.648557    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls podName:b2f3e3dd-e396-401a-bb39-e09ae0cc63ed nodeName:}" failed. No retries permitted until 2026-09-10 23:37:28.14853773 +0000 UTC m=+48.189407012 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-btsrj" (UID: "b2f3e3dd-e396-401a-bb39-e09ae0cc63ed") : secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:27.648718 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:27.648579    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 23:37:27.648718 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:27.648623    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls podName:46a48a97-1c0b-44fe-a2ed-699ee46194dd nodeName:}" failed. No retries permitted until 2026-09-10 23:37:28.148612453 +0000 UTC m=+48.189481766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-mtcrg" (UID: "46a48a97-1c0b-44fe-a2ed-699ee46194dd") : secret "samples-operator-tls" not found
Sep 10 23:37:27.649262 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.649242    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-btsrj\" (UID: \"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:27.661174 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.661149    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhqjf\" (UniqueName: \"kubernetes.io/projected/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-kube-api-access-hhqjf\") pod \"cluster-monitoring-operator-6cd954b897-btsrj\" (UID: \"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:27.661269 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.661239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw5th\" (UniqueName: \"kubernetes.io/projected/46a48a97-1c0b-44fe-a2ed-699ee46194dd-kube-api-access-pw5th\") pod \"cluster-samples-operator-86499c89c4-mtcrg\" (UID: \"46a48a97-1c0b-44fe-a2ed-699ee46194dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg"
Sep 10 23:37:27.694587 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.694551    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:27.749949 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.749914    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.749949 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.749951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-ca-trust-extracted\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.750111 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.749979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-image-registry-private-configuration\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.750111 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.750058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-bound-sa-token\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.750111 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.750097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-certificates\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.750227 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.750117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-j66qz\" (UID: \"a8aa8281-3111-4640-94aa-da77bc7128ae\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"
Sep 10 23:37:27.750227 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.750142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgrvz\" (UniqueName: \"kubernetes.io/projected/08a628f7-8d9d-40c8-bce1-725d011c2d0d-kube-api-access-rgrvz\") pod \"network-check-source-6f8b768455-q8779\" (UID: \"08a628f7-8d9d-40c8-bce1-725d011c2d0d\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-q8779"
Sep 10 23:37:27.750227 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.750159    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8aa8281-3111-4640-94aa-da77bc7128ae-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-j66qz\" (UID: \"a8aa8281-3111-4640-94aa-da77bc7128ae\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"
Sep 10 23:37:27.750227 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.750201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-trusted-ca\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.750423 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.750399    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rtm6\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-kube-api-access-6rtm6\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.750475 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.750446    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-installation-pull-secrets\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.758043 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.758019    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgrvz\" (UniqueName: \"kubernetes.io/projected/08a628f7-8d9d-40c8-bce1-725d011c2d0d-kube-api-access-rgrvz\") pod \"network-check-source-6f8b768455-q8779\" (UID: \"08a628f7-8d9d-40c8-bce1-725d011c2d0d\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-q8779"
Sep 10 23:37:27.792637 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.792600    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-q8779"
Sep 10 23:37:27.794429 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.794399    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:27.851403 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.851360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-certificates\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.851591 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.851410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-j66qz\" (UID: \"a8aa8281-3111-4640-94aa-da77bc7128ae\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"
Sep 10 23:37:27.851591 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.851449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8aa8281-3111-4640-94aa-da77bc7128ae-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-j66qz\" (UID: \"a8aa8281-3111-4640-94aa-da77bc7128ae\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"
Sep 10 23:37:27.851591 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.851498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-trusted-ca\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.851591 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.851552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rtm6\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-kube-api-access-6rtm6\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.851817 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.851597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-installation-pull-secrets\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.851817 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.851689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.851817 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.851731    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-ca-trust-extracted\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.851817 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.851764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-image-registry-private-configuration\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.851817 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.851805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-bound-sa-token\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.852025 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:27.851598    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 23:37:27.852267 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:27.852072    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert podName:a8aa8281-3111-4640-94aa-da77bc7128ae nodeName:}" failed. No retries permitted until 2026-09-10 23:37:28.352053057 +0000 UTC m=+48.392922353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-j66qz" (UID: "a8aa8281-3111-4640-94aa-da77bc7128ae") : secret "networking-console-plugin-cert" not found
Sep 10 23:37:27.852267 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.852082    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-certificates\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.852267 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:27.851996    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 23:37:27.852267 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:27.852165    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c59bf648c-hbdwl: secret "image-registry-tls" not found
Sep 10 23:37:27.852267 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.852188    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8aa8281-3111-4640-94aa-da77bc7128ae-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-j66qz\" (UID: \"a8aa8281-3111-4640-94aa-da77bc7128ae\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"
Sep 10 23:37:27.852267 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:27.852220    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls podName:27b4b4ef-7c4b-4f85-b128-b5fd26f222e8 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:28.352201592 +0000 UTC m=+48.393070896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls") pod "image-registry-7c59bf648c-hbdwl" (UID: "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8") : secret "image-registry-tls" not found
Sep 10 23:37:27.852583 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.852430    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-ca-trust-extracted\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.852825 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.852797    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-trusted-ca\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.854940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.854915    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-image-registry-private-configuration\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.854940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.854928    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-installation-pull-secrets\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.862347 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.862322    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-bound-sa-token\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:27.862458 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:27.862441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rtm6\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-kube-api-access-6rtm6\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:28.086398 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:28.086359    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-q8779"]
Sep 10 23:37:28.089532 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:37:28.089509    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a628f7_8d9d_40c8_bce1_725d011c2d0d.slice/crio-1095cfbcc49b8aed846c803eea8b0cdaffa364317f2e26c79b32a7f96e1ac118 WatchSource:0}: Error finding container 1095cfbcc49b8aed846c803eea8b0cdaffa364317f2e26c79b32a7f96e1ac118: Status 404 returned error can't find the container with id 1095cfbcc49b8aed846c803eea8b0cdaffa364317f2e26c79b32a7f96e1ac118
Sep 10 23:37:28.153958 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:28.153879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-btsrj\" (UID: \"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:28.153958 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:28.153943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mtcrg\" (UID: \"46a48a97-1c0b-44fe-a2ed-699ee46194dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg"
Sep 10 23:37:28.154124 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:28.154029    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 23:37:28.154124 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:28.154031    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:28.154124 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:28.154082    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls podName:46a48a97-1c0b-44fe-a2ed-699ee46194dd nodeName:}" failed. No retries permitted until 2026-09-10 23:37:29.154068735 +0000 UTC m=+49.194938032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-mtcrg" (UID: "46a48a97-1c0b-44fe-a2ed-699ee46194dd") : secret "samples-operator-tls" not found
Sep 10 23:37:28.154124 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:28.154095    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls podName:b2f3e3dd-e396-401a-bb39-e09ae0cc63ed nodeName:}" failed. No retries permitted until 2026-09-10 23:37:29.154089805 +0000 UTC m=+49.194959090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-btsrj" (UID: "b2f3e3dd-e396-401a-bb39-e09ae0cc63ed") : secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:28.355877 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:28.355836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:28.356046 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:28.355894    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-j66qz\" (UID: \"a8aa8281-3111-4640-94aa-da77bc7128ae\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"
Sep 10 23:37:28.356046 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:28.355996    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 23:37:28.356046 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:28.356013    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c59bf648c-hbdwl: secret "image-registry-tls" not found
Sep 10 23:37:28.356219 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:28.356069    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls podName:27b4b4ef-7c4b-4f85-b128-b5fd26f222e8 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:29.356053923 +0000 UTC m=+49.396923209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls") pod "image-registry-7c59bf648c-hbdwl" (UID: "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8") : secret "image-registry-tls" not found
Sep 10 23:37:28.356219 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:28.356079    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 23:37:28.356219 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:28.356120    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert podName:a8aa8281-3111-4640-94aa-da77bc7128ae nodeName:}" failed. No retries permitted until 2026-09-10 23:37:29.356108132 +0000 UTC m=+49.396977415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-j66qz" (UID: "a8aa8281-3111-4640-94aa-da77bc7128ae") : secret "networking-console-plugin-cert" not found
Sep 10 23:37:28.541121 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:28.541091    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:28.641692 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:28.641627    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:28.699499 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:28.699463    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:28.778487 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:28.778452    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-q8779" event={"ID":"08a628f7-8d9d-40c8-bce1-725d011c2d0d","Type":"ContainerStarted","Data":"1095cfbcc49b8aed846c803eea8b0cdaffa364317f2e26c79b32a7f96e1ac118"}
Sep 10 23:37:29.162919 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:29.162882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mtcrg\" (UID: \"46a48a97-1c0b-44fe-a2ed-699ee46194dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg"
Sep 10 23:37:29.163100 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:29.162990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-btsrj\" (UID: \"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:29.163100 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:29.163057    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 23:37:29.163203 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:29.163100    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:29.163203 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:29.163141    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls podName:46a48a97-1c0b-44fe-a2ed-699ee46194dd nodeName:}" failed. No retries permitted until 2026-09-10 23:37:31.163119772 +0000 UTC m=+51.203989060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-mtcrg" (UID: "46a48a97-1c0b-44fe-a2ed-699ee46194dd") : secret "samples-operator-tls" not found
Sep 10 23:37:29.163203 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:29.163161    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls podName:b2f3e3dd-e396-401a-bb39-e09ae0cc63ed nodeName:}" failed. No retries permitted until 2026-09-10 23:37:31.163151458 +0000 UTC m=+51.204020745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-btsrj" (UID: "b2f3e3dd-e396-401a-bb39-e09ae0cc63ed") : secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:29.365456 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:29.365422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-j66qz\" (UID: \"a8aa8281-3111-4640-94aa-da77bc7128ae\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"
Sep 10 23:37:29.365631 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:29.365554    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:29.365631 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:29.365583    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 23:37:29.365778 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:29.365685    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert podName:a8aa8281-3111-4640-94aa-da77bc7128ae nodeName:}" failed. No retries permitted until 2026-09-10 23:37:31.365649113 +0000 UTC m=+51.406518399 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-j66qz" (UID: "a8aa8281-3111-4640-94aa-da77bc7128ae") : secret "networking-console-plugin-cert" not found
Sep 10 23:37:29.365778 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:29.365695    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 23:37:29.365778 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:29.365712    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c59bf648c-hbdwl: secret "image-registry-tls" not found
Sep 10 23:37:29.365778 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:29.365769    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls podName:27b4b4ef-7c4b-4f85-b128-b5fd26f222e8 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:31.365752373 +0000 UTC m=+51.406621671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls") pod "image-registry-7c59bf648c-hbdwl" (UID: "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8") : secret "image-registry-tls" not found
Sep 10 23:37:29.964361 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:29.964331    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:30.064690 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:30.064629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:31.180940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:31.180901    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mtcrg\" (UID: \"46a48a97-1c0b-44fe-a2ed-699ee46194dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg"
Sep 10 23:37:31.181525 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:31.180991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:31.181525 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:31.181040    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-btsrj\" (UID: \"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:31.181525 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:31.181090    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 23:37:31.181525 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:31.181141    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 23:37:31.181525 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:31.181174    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls podName:46a48a97-1c0b-44fe-a2ed-699ee46194dd nodeName:}" failed. No retries permitted until 2026-09-10 23:37:35.181153814 +0000 UTC m=+55.222023114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-mtcrg" (UID: "46a48a97-1c0b-44fe-a2ed-699ee46194dd") : secret "samples-operator-tls" not found
Sep 10 23:37:31.181525 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:31.181141    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:31.181525 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:31.181194    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls podName:e6630eff-f33d-407a-b37a-2e81d3ec968c nodeName:}" failed. No retries permitted until 2026-09-10 23:37:47.181184722 +0000 UTC m=+67.222054009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls") pod "dns-default-zgxwp" (UID: "e6630eff-f33d-407a-b37a-2e81d3ec968c") : secret "dns-default-metrics-tls" not found
Sep 10 23:37:31.181525 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:31.181216    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls podName:b2f3e3dd-e396-401a-bb39-e09ae0cc63ed nodeName:}" failed. No retries permitted until 2026-09-10 23:37:35.181200554 +0000 UTC m=+55.222069837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-btsrj" (UID: "b2f3e3dd-e396-401a-bb39-e09ae0cc63ed") : secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:31.382121 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:31.382085    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-j66qz\" (UID: \"a8aa8281-3111-4640-94aa-da77bc7128ae\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"
Sep 10 23:37:31.382286 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:31.382184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:31.382286 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:31.382233    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 23:37:31.382286 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:31.382272    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 23:37:31.382286 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:31.382281    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c59bf648c-hbdwl: secret "image-registry-tls" not found
Sep 10 23:37:31.382419 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:31.382302    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert podName:a8aa8281-3111-4640-94aa-da77bc7128ae nodeName:}" failed. No retries permitted until 2026-09-10 23:37:35.382286064 +0000 UTC m=+55.423155366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-j66qz" (UID: "a8aa8281-3111-4640-94aa-da77bc7128ae") : secret "networking-console-plugin-cert" not found
Sep 10 23:37:31.382419 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:31.382319    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls podName:27b4b4ef-7c4b-4f85-b128-b5fd26f222e8 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:35.382308208 +0000 UTC m=+55.423177510 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls") pod "image-registry-7c59bf648c-hbdwl" (UID: "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8") : secret "image-registry-tls" not found
Sep 10 23:37:31.560795 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:31.560764    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:31.661982 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:31.661947    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:31.787363 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:31.787328    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-q8779" event={"ID":"08a628f7-8d9d-40c8-bce1-725d011c2d0d","Type":"ContainerStarted","Data":"b646adabd122eb7f06c329a178f263a1aa632013abb5a861a39d02b00717fde9"}
Sep 10 23:37:32.342021 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:32.341967    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:32.432184 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:32.432153    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:32.488652 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:32.488605    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:32.589205 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:32.589161    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:32.644227 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:32.644144    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:32.804900 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:32.804839    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-q8779" podStartSLOduration=2.2228171899999998 podStartE2EDuration="5.804819421s" totalImagesPullingTime="3.582002231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:32.804214937 +0000 UTC m=+52.845084242" watchObservedRunningTime="2026-09-10 23:37:32.804819421 +0000 UTC m=+52.845688727"
Sep 10 23:37:32.908088 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:32.908003    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j7j76"]
Sep 10 23:37:32.909953 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:32.909925    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:32.912843 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:32.912818    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 23:37:32.912843 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:32.912832    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4wv72\""
Sep 10 23:37:32.913251 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:32.913231    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 23:37:32.913483 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:32.913283    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 23:37:32.913849 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:32.913830    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 23:37:32.921239 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:32.921216    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j7j76"]
Sep 10 23:37:32.930914 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:32.930889    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:33.009324 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.009281    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:33.095662 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.095624    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:33.095846 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.095693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:33.095846 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.095829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xcnh\" (UniqueName: \"kubernetes.io/projected/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-api-access-6xcnh\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:33.095925 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.095870    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/432c2920-5ba6-489e-8dcc-7656d6e98c6b-data-volume\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:33.095961 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.095934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/432c2920-5ba6-489e-8dcc-7656d6e98c6b-crio-socket\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:33.103421 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.103387    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:33.196619 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.196522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xcnh\" (UniqueName: \"kubernetes.io/projected/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-api-access-6xcnh\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:33.196619 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.196565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/432c2920-5ba6-489e-8dcc-7656d6e98c6b-data-volume\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:33.196619 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.196599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/432c2920-5ba6-489e-8dcc-7656d6e98c6b-crio-socket\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:33.196930 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.196764    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/432c2920-5ba6-489e-8dcc-7656d6e98c6b-crio-socket\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:33.196930 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.196834    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:33.196930 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.196871    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:33.197051 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:33.196950    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 23:37:33.197051 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.196965    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/432c2920-5ba6-489e-8dcc-7656d6e98c6b-data-volume\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:33.197051 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:33.197021    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm podName:432c2920-5ba6-489e-8dcc-7656d6e98c6b nodeName:}" failed. No retries permitted until 2026-09-10 23:37:33.697002135 +0000 UTC m=+53.737871431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j7j76" (UID: "432c2920-5ba6-489e-8dcc-7656d6e98c6b") : configmap "kube-rbac-proxy" not found
Sep 10 23:37:33.197051 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:33.197025    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:33.197225 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:33.197063    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls podName:432c2920-5ba6-489e-8dcc-7656d6e98c6b nodeName:}" failed. No retries permitted until 2026-09-10 23:37:33.697052268 +0000 UTC m=+53.737921565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j7j76" (UID: "432c2920-5ba6-489e-8dcc-7656d6e98c6b") : secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:33.205040 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.205015    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xcnh\" (UniqueName: \"kubernetes.io/projected/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-api-access-6xcnh\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:33.700512 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.700473    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:33.700917 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:33.700525    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:33.700917 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:33.700603    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 23:37:33.700917 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:33.700625    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:33.700917 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:33.700695    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm podName:432c2920-5ba6-489e-8dcc-7656d6e98c6b nodeName:}" failed. No retries permitted until 2026-09-10 23:37:34.700656176 +0000 UTC m=+54.741525474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j7j76" (UID: "432c2920-5ba6-489e-8dcc-7656d6e98c6b") : configmap "kube-rbac-proxy" not found
Sep 10 23:37:33.700917 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:33.700724    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls podName:432c2920-5ba6-489e-8dcc-7656d6e98c6b nodeName:}" failed. No retries permitted until 2026-09-10 23:37:34.700716535 +0000 UTC m=+54.741585818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j7j76" (UID: "432c2920-5ba6-489e-8dcc-7656d6e98c6b") : secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:34.709258 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:34.709207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:34.709707 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:34.709283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:34.709707 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:34.709298    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 23:37:34.709707 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:34.709361    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm podName:432c2920-5ba6-489e-8dcc-7656d6e98c6b nodeName:}" failed. No retries permitted until 2026-09-10 23:37:36.709342401 +0000 UTC m=+56.750211688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j7j76" (UID: "432c2920-5ba6-489e-8dcc-7656d6e98c6b") : configmap "kube-rbac-proxy" not found
Sep 10 23:37:34.709707 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:34.709413    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:34.709707 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:34.709451    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls podName:432c2920-5ba6-489e-8dcc-7656d6e98c6b nodeName:}" failed. No retries permitted until 2026-09-10 23:37:36.709442099 +0000 UTC m=+56.750311382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j7j76" (UID: "432c2920-5ba6-489e-8dcc-7656d6e98c6b") : secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:34.740905 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:34.740874    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:34.841743 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:34.841707    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:35.213316 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:35.213279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-btsrj\" (UID: \"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:35.213501 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:35.213290    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:35.213501 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:35.213433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mtcrg\" (UID: \"46a48a97-1c0b-44fe-a2ed-699ee46194dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg"
Sep 10 23:37:35.213501 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:35.213441    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls podName:b2f3e3dd-e396-401a-bb39-e09ae0cc63ed nodeName:}" failed. No retries permitted until 2026-09-10 23:37:43.213426605 +0000 UTC m=+63.254295910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-btsrj" (UID: "b2f3e3dd-e396-401a-bb39-e09ae0cc63ed") : secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:35.213656 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:35.213555    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 23:37:35.213656 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:35.213613    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls podName:46a48a97-1c0b-44fe-a2ed-699ee46194dd nodeName:}" failed. No retries permitted until 2026-09-10 23:37:43.213597482 +0000 UTC m=+63.254466780 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-mtcrg" (UID: "46a48a97-1c0b-44fe-a2ed-699ee46194dd") : secret "samples-operator-tls" not found
Sep 10 23:37:35.415457 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:35.415395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-j66qz\" (UID: \"a8aa8281-3111-4640-94aa-da77bc7128ae\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"
Sep 10 23:37:35.415656 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:35.415542    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 23:37:35.415656 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:35.415564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:35.415656 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:35.415599    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert podName:a8aa8281-3111-4640-94aa-da77bc7128ae nodeName:}" failed. No retries permitted until 2026-09-10 23:37:43.415585588 +0000 UTC m=+63.456454871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-j66qz" (UID: "a8aa8281-3111-4640-94aa-da77bc7128ae") : secret "networking-console-plugin-cert" not found
Sep 10 23:37:35.415842 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:35.415699    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 23:37:35.415842 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:35.415713    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c59bf648c-hbdwl: secret "image-registry-tls" not found
Sep 10 23:37:35.415842 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:35.415765    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls podName:27b4b4ef-7c4b-4f85-b128-b5fd26f222e8 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:43.415749681 +0000 UTC m=+63.456618978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls") pod "image-registry-7c59bf648c-hbdwl" (UID: "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8") : secret "image-registry-tls" not found
Sep 10 23:37:35.485410 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:35.485329    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cvkl5_197415e0-e604-40a0-af02-b22590f55c2e/dns-node-resolver/0.log"
Sep 10 23:37:35.945513 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:35.945432    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:36.724554 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:36.724510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:36.724554 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:36.724565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:36.724809 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:36.724637    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 23:37:36.724809 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:36.724697    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:36.724809 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:36.724725    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm podName:432c2920-5ba6-489e-8dcc-7656d6e98c6b nodeName:}" failed. No retries permitted until 2026-09-10 23:37:40.724708583 +0000 UTC m=+60.765577865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j7j76" (UID: "432c2920-5ba6-489e-8dcc-7656d6e98c6b") : configmap "kube-rbac-proxy" not found
Sep 10 23:37:36.724809 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:36.724744    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls podName:432c2920-5ba6-489e-8dcc-7656d6e98c6b nodeName:}" failed. No retries permitted until 2026-09-10 23:37:40.724731642 +0000 UTC m=+60.765600924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j7j76" (UID: "432c2920-5ba6-489e-8dcc-7656d6e98c6b") : secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:36.878462 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:36.878437    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h7g65_54ed315c-a8ea-457b-8795-b40ad51e0a01/node-ca/0.log"
Sep 10 23:37:37.481130 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:37.481098    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cjngp_3f873507-a363-4ab5-b68a-8aaa1747b705/serve-healthcheck-canary/0.log"
Sep 10 23:37:38.700869 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:38.700815    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:39.378153 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:39.378124    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:39.517046 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:39.517011    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:39.617951 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:39.617912    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:39.743297 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:39.743263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:39.898747 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:39.898713    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:40.048916 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:40.048824    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:40.165499 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:40.165463    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:40.758867 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:40.758814    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:40.759261 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:40.758959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:40.759261 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:40.758964    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:40.759261 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:40.758995    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 23:37:40.759261 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:40.759057    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm podName:432c2920-5ba6-489e-8dcc-7656d6e98c6b nodeName:}" failed. No retries permitted until 2026-09-10 23:37:48.759041683 +0000 UTC m=+68.799910984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j7j76" (UID: "432c2920-5ba6-489e-8dcc-7656d6e98c6b") : configmap "kube-rbac-proxy" not found
Sep 10 23:37:40.759261 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:40.759070    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls podName:432c2920-5ba6-489e-8dcc-7656d6e98c6b nodeName:}" failed. No retries permitted until 2026-09-10 23:37:48.759064794 +0000 UTC m=+68.799934079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j7j76" (UID: "432c2920-5ba6-489e-8dcc-7656d6e98c6b") : secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:40.874168 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:40.874122    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:41.275221 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:41.275182    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:41.479266 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:41.479232    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:41.731655 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:41.731624    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9nk5"
Sep 10 23:37:41.879182 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:41.879149    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:42.673011 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:42.672970    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:42.880001 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:42.879966    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:43.072930 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.072896    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:43.280903 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.280865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-btsrj\" (UID: \"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:43.281089 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.280985    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mtcrg\" (UID: \"46a48a97-1c0b-44fe-a2ed-699ee46194dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg"
Sep 10 23:37:43.281089 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:43.281011    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:43.281089 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:43.281087    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls podName:b2f3e3dd-e396-401a-bb39-e09ae0cc63ed nodeName:}" failed. No retries permitted until 2026-09-10 23:37:59.28107108 +0000 UTC m=+79.321940365 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-btsrj" (UID: "b2f3e3dd-e396-401a-bb39-e09ae0cc63ed") : secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:43.283584 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.283544    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a48a97-1c0b-44fe-a2ed-699ee46194dd-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mtcrg\" (UID: \"46a48a97-1c0b-44fe-a2ed-699ee46194dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg"
Sep 10 23:37:43.301084 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.301052    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:43.326030 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.325957    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2svw2\""
Sep 10 23:37:43.334123 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.334102    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg"
Sep 10 23:37:43.387062 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.387023    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:43.483278 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.483235    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:43.483460 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.483314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-j66qz\" (UID: \"a8aa8281-3111-4640-94aa-da77bc7128ae\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"
Sep 10 23:37:43.483460 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:43.483402    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 23:37:43.483529 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:43.483471    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert podName:a8aa8281-3111-4640-94aa-da77bc7128ae nodeName:}" failed. No retries permitted until 2026-09-10 23:37:59.483453836 +0000 UTC m=+79.524323131 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-j66qz" (UID: "a8aa8281-3111-4640-94aa-da77bc7128ae") : secret "networking-console-plugin-cert" not found
Sep 10 23:37:43.486077 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.486056    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls\") pod \"image-registry-7c59bf648c-hbdwl\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") " pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:43.487051 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.487020    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:43.521432 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.521412    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-67vss\""
Sep 10 23:37:43.529465 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.529445    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:43.603161 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.603127    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg"]
Sep 10 23:37:43.797757 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.797727    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c59bf648c-hbdwl"]
Sep 10 23:37:43.800996 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:37:43.800967    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27b4b4ef_7c4b_4f85_b128_b5fd26f222e8.slice/crio-20c9f621e5b354b62c7322104b20f3dd19eb24e5629edcf456c9f01f8101b1b9 WatchSource:0}: Error finding container 20c9f621e5b354b62c7322104b20f3dd19eb24e5629edcf456c9f01f8101b1b9: Status 404 returned error can't find the container with id 20c9f621e5b354b62c7322104b20f3dd19eb24e5629edcf456c9f01f8101b1b9
Sep 10 23:37:43.819012 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.818979    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl" event={"ID":"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8","Type":"ContainerStarted","Data":"20c9f621e5b354b62c7322104b20f3dd19eb24e5629edcf456c9f01f8101b1b9"}
Sep 10 23:37:43.820146 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.820123    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg" event={"ID":"46a48a97-1c0b-44fe-a2ed-699ee46194dd","Type":"ContainerStarted","Data":"2b1555d09655e6ab3efdb74221a949d95a4d8475ecff490eb934e6ec6419c307"}
Sep 10 23:37:43.877804 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.877703    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:43.929277 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:43.929242    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:44.675662 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:44.675630    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:44.825372 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:44.825336    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl" event={"ID":"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8","Type":"ContainerStarted","Data":"fd0c67c10e20adadd96adc8a50f982049237693fea492977a5f90d39790726b4"}
Sep 10 23:37:44.825544 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:44.825457    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:37:44.845243 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:44.845197    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl" podStartSLOduration=17.845175051 podStartE2EDuration="17.845175051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:44.844626067 +0000 UTC m=+64.885495376" watchObservedRunningTime="2026-09-10 23:37:44.845175051 +0000 UTC m=+64.886044357"
Sep 10 23:37:44.882134 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:44.882097    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:45.082045 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:45.082009    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:45.276276 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:45.276207    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:45.518425 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:45.518392    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:45.665531 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:45.665501    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:45.829905 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:45.829877    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg" event={"ID":"46a48a97-1c0b-44fe-a2ed-699ee46194dd","Type":"ContainerStarted","Data":"622910c346aefdff0499be84ebf41bb01c66bf3645518fbed8b1ea989972bf89"}
Sep 10 23:37:45.830096 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:45.829967    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg" event={"ID":"46a48a97-1c0b-44fe-a2ed-699ee46194dd","Type":"ContainerStarted","Data":"4a48c0938b94796533b16fde686db30f3ab81763fe79a93ca9fb51c504741325"}
Sep 10 23:37:45.850615 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:45.850565    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mtcrg" podStartSLOduration=17.075888649 podStartE2EDuration="18.850548802s" totalImagesPullingTime="1.774660153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:45.849528092 +0000 UTC m=+65.890397398" watchObservedRunningTime="2026-09-10 23:37:45.850548802 +0000 UTC m=+65.891418169"
Sep 10 23:37:46.203833 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.203796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs\") pod \"network-metrics-daemon-4gtf5\" (UID: \"afe96c24-b384-431f-85db-44d132dde401\") " pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:37:46.206520 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.206497    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 23:37:46.214621 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:46.214599    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 23:37:46.214757 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:46.214699    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs podName:afe96c24-b384-431f-85db-44d132dde401 nodeName:}" failed. No retries permitted until 2026-09-10 23:38:50.214656568 +0000 UTC m=+130.255525856 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs") pod "network-metrics-daemon-4gtf5" (UID: "afe96c24-b384-431f-85db-44d132dde401") : secret "metrics-daemon-secret" not found
Sep 10 23:37:46.304757 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.304714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhnmc\" (UniqueName: \"kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc\") pod \"network-check-target-xjmkz\" (UID: \"21ece222-a646-4ff2-b0bd-34580d528de4\") " pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:37:46.304927 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.304785    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret\") pod \"global-pull-secret-syncer-wc9vw\" (UID: \"380d5f9c-5375-4728-a66b-461ec152a23b\") " pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:37:46.307406 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.307386    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhnmc\" (UniqueName: \"kubernetes.io/projected/21ece222-a646-4ff2-b0bd-34580d528de4-kube-api-access-bhnmc\") pod \"network-check-target-xjmkz\" (UID: \"21ece222-a646-4ff2-b0bd-34580d528de4\") " pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:37:46.307466 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.307440    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 23:37:46.317822 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.317793    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380d5f9c-5375-4728-a66b-461ec152a23b-original-pull-secret\") pod \"global-pull-secret-syncer-wc9vw\" (UID: \"380d5f9c-5375-4728-a66b-461ec152a23b\") " pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:37:46.388081 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.388044    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc9vw"
Sep 10 23:37:46.401924 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.401904    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xgqvn\""
Sep 10 23:37:46.409980 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.409960    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:37:46.472579 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.472551    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:46.681612 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.681581    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wc9vw"]
Sep 10 23:37:46.684802 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.684778    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:46.685167 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:37:46.685141    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod380d5f9c_5375_4728_a66b_461ec152a23b.slice/crio-1b0b1a5900b82a7a53c89156e2b8f2efee737424240d5d3a969ccce2d7e5aa8a WatchSource:0}: Error finding container 1b0b1a5900b82a7a53c89156e2b8f2efee737424240d5d3a969ccce2d7e5aa8a: Status 404 returned error can't find the container with id 1b0b1a5900b82a7a53c89156e2b8f2efee737424240d5d3a969ccce2d7e5aa8a
Sep 10 23:37:46.719274 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.719203    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xjmkz"]
Sep 10 23:37:46.721580 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:37:46.721557    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21ece222_a646_4ff2_b0bd_34580d528de4.slice/crio-f318d018fc114c44c140d9358129b1ca1bb7fa7fd4c620500868ead51eb39531 WatchSource:0}: Error finding container f318d018fc114c44c140d9358129b1ca1bb7fa7fd4c620500868ead51eb39531: Status 404 returned error can't find the container with id f318d018fc114c44c140d9358129b1ca1bb7fa7fd4c620500868ead51eb39531
Sep 10 23:37:46.835937 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.835900    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wc9vw" event={"ID":"380d5f9c-5375-4728-a66b-461ec152a23b","Type":"ContainerStarted","Data":"1b0b1a5900b82a7a53c89156e2b8f2efee737424240d5d3a969ccce2d7e5aa8a"}
Sep 10 23:37:46.837430 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.837403    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xjmkz" event={"ID":"21ece222-a646-4ff2-b0bd-34580d528de4","Type":"ContainerStarted","Data":"8560155dea5e13eb1ce92b853d8a8550cd6e44fcd961c37e8583603f30ce9aca"}
Sep 10 23:37:46.837786 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.837451    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xjmkz" event={"ID":"21ece222-a646-4ff2-b0bd-34580d528de4","Type":"ContainerStarted","Data":"f318d018fc114c44c140d9358129b1ca1bb7fa7fd4c620500868ead51eb39531"}
Sep 10 23:37:46.837786 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.837751    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:37:46.857270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.857226    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xjmkz" podStartSLOduration=65.857211225 podStartE2EDuration="1m5.857211225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:36:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:46.856200938 +0000 UTC m=+66.897070242" watchObservedRunningTime="2026-09-10 23:37:46.857211225 +0000 UTC m=+66.898080531"
Sep 10 23:37:46.879234 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:46.879207    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:47.027620 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:47.027540    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:47.108057 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:47.108029    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:47.213862 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:47.213825    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:47.216651 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:47.216628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6630eff-f33d-407a-b37a-2e81d3ec968c-metrics-tls\") pod \"dns-default-zgxwp\" (UID: \"e6630eff-f33d-407a-b37a-2e81d3ec968c\") " pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:47.273517 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:47.273486    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:47.448790 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:47.448707    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6vpbd\""
Sep 10 23:37:47.451454 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:47.451420    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:47.456593 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:47.456562    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:47.532640 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:47.532580    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:47.733928 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:47.733839    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zgxwp"]
Sep 10 23:37:47.738434 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:37:47.738404    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6630eff_f33d_407a_b37a_2e81d3ec968c.slice/crio-b87109479f98c587f7b545754b69dd0cae235276793a6e202e7ca00f4343435c WatchSource:0}: Error finding container b87109479f98c587f7b545754b69dd0cae235276793a6e202e7ca00f4343435c: Status 404 returned error can't find the container with id b87109479f98c587f7b545754b69dd0cae235276793a6e202e7ca00f4343435c
Sep 10 23:37:47.843124 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:47.843079    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zgxwp" event={"ID":"e6630eff-f33d-407a-b37a-2e81d3ec968c","Type":"ContainerStarted","Data":"b87109479f98c587f7b545754b69dd0cae235276793a6e202e7ca00f4343435c"}
Sep 10 23:37:48.105334 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:48.105250    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:48.499837 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:48.499747    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:48.829234 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:48.829152    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:48.829234 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:48.829201    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:48.829404 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:48.829361    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:48.829439 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:37:48.829418    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls podName:432c2920-5ba6-489e-8dcc-7656d6e98c6b nodeName:}" failed. No retries permitted until 2026-09-10 23:38:04.829403204 +0000 UTC m=+84.870272500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j7j76" (UID: "432c2920-5ba6-489e-8dcc-7656d6e98c6b") : secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:48.830057 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:48.829843    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/432c2920-5ba6-489e-8dcc-7656d6e98c6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:37:48.914016 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:48.913974    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:49.304361 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:49.304323    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:49.506324 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:49.506292    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:49.885182 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:49.885145    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:50.086735 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:50.086654    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:50.856905 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:50.856875    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zgxwp" event={"ID":"e6630eff-f33d-407a-b37a-2e81d3ec968c","Type":"ContainerStarted","Data":"5f933cadc4a08e83b7448daefcb6eb3c2b92c8d4a6d94e340fb8a12e6ee41c35"}
Sep 10 23:37:50.858618 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:50.858588    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wc9vw" event={"ID":"380d5f9c-5375-4728-a66b-461ec152a23b","Type":"ContainerStarted","Data":"a2de9d713bfbabf555017244a9a89387dbf3467f1e7a17cee9506edb962fa408"}
Sep 10 23:37:50.876365 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:50.876319    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wc9vw" podStartSLOduration=65.88964994 podStartE2EDuration="1m9.876299419s" totalImagesPullingTime="3.986649479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:50.874641198 +0000 UTC m=+70.915510503" watchObservedRunningTime="2026-09-10 23:37:50.876299419 +0000 UTC m=+70.917168728"
Sep 10 23:37:51.864003 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:51.863960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zgxwp" event={"ID":"e6630eff-f33d-407a-b37a-2e81d3ec968c","Type":"ContainerStarted","Data":"3a31ae09071ec8bf517c378a7883de0f861cf1687df7cda1b6057c152c93b04c"}
Sep 10 23:37:51.886004 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:51.885895    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zgxwp" podStartSLOduration=33.959730509 podStartE2EDuration="36.885874223s" totalImagesPullingTime="2.926143714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:51.885576771 +0000 UTC m=+71.926446076" watchObservedRunningTime="2026-09-10 23:37:51.885874223 +0000 UTC m=+71.926743530"
Sep 10 23:37:52.868037 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:52.868004    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:37:56.888949 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:56.888917    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk"]
Sep 10 23:37:56.894442 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:56.894423    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk"
Sep 10 23:37:56.899142 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:56.899121    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 10 23:37:56.900199 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:56.900178    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 23:37:56.900324 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:56.900177    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 23:37:56.900324 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:56.900178    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 23:37:56.910303 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:56.910275    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk"]
Sep 10 23:37:56.989853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:56.989823    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/45227a6e-717c-4ab7-b59a-68bf19824b76-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bd66676cd-xj2kk\" (UID: \"45227a6e-717c-4ab7-b59a-68bf19824b76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk"
Sep 10 23:37:56.990024 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:56.989887    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tldz\" (UniqueName: \"kubernetes.io/projected/45227a6e-717c-4ab7-b59a-68bf19824b76-kube-api-access-2tldz\") pod \"klusterlet-addon-workmgr-7bd66676cd-xj2kk\" (UID: \"45227a6e-717c-4ab7-b59a-68bf19824b76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk"
Sep 10 23:37:56.990024 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:56.989987    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45227a6e-717c-4ab7-b59a-68bf19824b76-tmp\") pod \"klusterlet-addon-workmgr-7bd66676cd-xj2kk\" (UID: \"45227a6e-717c-4ab7-b59a-68bf19824b76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk"
Sep 10 23:37:57.003483 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.003454    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c59bf648c-hbdwl"]
Sep 10 23:37:57.027423 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.027388    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:57.059073 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.059043    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cc958457f-jp6d6"]
Sep 10 23:37:57.062725 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.062711    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.082646 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.082617    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cc958457f-jp6d6"]
Sep 10 23:37:57.090829 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.090808    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45227a6e-717c-4ab7-b59a-68bf19824b76-tmp\") pod \"klusterlet-addon-workmgr-7bd66676cd-xj2kk\" (UID: \"45227a6e-717c-4ab7-b59a-68bf19824b76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk"
Sep 10 23:37:57.090958 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.090879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/45227a6e-717c-4ab7-b59a-68bf19824b76-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bd66676cd-xj2kk\" (UID: \"45227a6e-717c-4ab7-b59a-68bf19824b76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk"
Sep 10 23:37:57.090958 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.090907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tldz\" (UniqueName: \"kubernetes.io/projected/45227a6e-717c-4ab7-b59a-68bf19824b76-kube-api-access-2tldz\") pod \"klusterlet-addon-workmgr-7bd66676cd-xj2kk\" (UID: \"45227a6e-717c-4ab7-b59a-68bf19824b76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk"
Sep 10 23:37:57.091185 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.091166    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45227a6e-717c-4ab7-b59a-68bf19824b76-tmp\") pod \"klusterlet-addon-workmgr-7bd66676cd-xj2kk\" (UID: \"45227a6e-717c-4ab7-b59a-68bf19824b76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk"
Sep 10 23:37:57.093458 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.093437    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/45227a6e-717c-4ab7-b59a-68bf19824b76-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bd66676cd-xj2kk\" (UID: \"45227a6e-717c-4ab7-b59a-68bf19824b76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk"
Sep 10 23:37:57.106312 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.106027    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tldz\" (UniqueName: \"kubernetes.io/projected/45227a6e-717c-4ab7-b59a-68bf19824b76-kube-api-access-2tldz\") pod \"klusterlet-addon-workmgr-7bd66676cd-xj2kk\" (UID: \"45227a6e-717c-4ab7-b59a-68bf19824b76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk"
Sep 10 23:37:57.136430 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.136395    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:57.191289 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.191198    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-installation-pull-secrets\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.191443 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.191295    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-trusted-ca\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.191443 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.191340    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-registry-tls\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.191443 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.191386    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-registry-certificates\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.191562 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.191468    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-image-registry-private-configuration\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.191562 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.191498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-bound-sa-token\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.191562 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.191519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-ca-trust-extracted\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.191562 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.191533    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n85kv\" (UniqueName: \"kubernetes.io/projected/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-kube-api-access-n85kv\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.203363 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.203336    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk"
Sep 10 23:37:57.237703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.237641    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:57.291948 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.291912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-trusted-ca\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.291948 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.291948    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-registry-tls\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.292133 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.292113    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-registry-certificates\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.292180 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.292163    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-image-registry-private-configuration\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.292223 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.292194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-bound-sa-token\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.292259 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.292226    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-ca-trust-extracted\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.292312 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.292253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n85kv\" (UniqueName: \"kubernetes.io/projected/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-kube-api-access-n85kv\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.292402 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.292380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-installation-pull-secrets\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.292971 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.292895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-trusted-ca\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.292971 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.292992    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-ca-trust-extracted\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.292971 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.292999    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-registry-certificates\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.294638 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.294610    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-registry-tls\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.295047 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.295027    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-installation-pull-secrets\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.295204 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.295187    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-image-registry-private-configuration\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.301030 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.301010    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-bound-sa-token\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.302934 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.302919    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n85kv\" (UniqueName: \"kubernetes.io/projected/9a6499b2-8d93-4e40-9d1f-2b5c3185b93c-kube-api-access-n85kv\") pod \"image-registry-5cc958457f-jp6d6\" (UID: \"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c\") " pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.370984 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.370956    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.475212 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.475187    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk"]
Sep 10 23:37:57.477184 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:37:57.477140    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45227a6e_717c_4ab7_b59a_68bf19824b76.slice/crio-b953662e752270405ae423f37ddd9bba7369cfc3fde5d0a09ffdbf5497cc28bf WatchSource:0}: Error finding container b953662e752270405ae423f37ddd9bba7369cfc3fde5d0a09ffdbf5497cc28bf: Status 404 returned error can't find the container with id b953662e752270405ae423f37ddd9bba7369cfc3fde5d0a09ffdbf5497cc28bf
Sep 10 23:37:57.646340 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.646301    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cc958457f-jp6d6"]
Sep 10 23:37:57.650486 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:37:57.650460    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a6499b2_8d93_4e40_9d1f_2b5c3185b93c.slice/crio-4621b3590551ba4cf0d7516e4eb2427cd45c8472d244770fcde29f114cf6449b WatchSource:0}: Error finding container 4621b3590551ba4cf0d7516e4eb2427cd45c8472d244770fcde29f114cf6449b: Status 404 returned error can't find the container with id 4621b3590551ba4cf0d7516e4eb2427cd45c8472d244770fcde29f114cf6449b
Sep 10 23:37:57.887086 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.886996    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cc958457f-jp6d6" event={"ID":"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c","Type":"ContainerStarted","Data":"1577606bcaec51472ffeb3221cc2d2302e63450ad83a8a04679de8e7e0cb3e55"}
Sep 10 23:37:57.887086 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.887056    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cc958457f-jp6d6" event={"ID":"9a6499b2-8d93-4e40-9d1f-2b5c3185b93c","Type":"ContainerStarted","Data":"4621b3590551ba4cf0d7516e4eb2427cd45c8472d244770fcde29f114cf6449b"}
Sep 10 23:37:57.887086 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.887081    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:37:57.888269 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:57.888239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk" event={"ID":"45227a6e-717c-4ab7-b59a-68bf19824b76","Type":"ContainerStarted","Data":"b953662e752270405ae423f37ddd9bba7369cfc3fde5d0a09ffdbf5497cc28bf"}
Sep 10 23:37:59.307343 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:59.307264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-btsrj\" (UID: \"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:59.310755 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:59.310645    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f3e3dd-e396-401a-bb39-e09ae0cc63ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-btsrj\" (UID: \"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:59.501805 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:59.501770    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-khtf4\""
Sep 10 23:37:59.508871 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:59.508843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-j66qz\" (UID: \"a8aa8281-3111-4640-94aa-da77bc7128ae\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"
Sep 10 23:37:59.509576 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:59.509552    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"
Sep 10 23:37:59.511686 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:59.511650    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8aa8281-3111-4640-94aa-da77bc7128ae-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-j66qz\" (UID: \"a8aa8281-3111-4640-94aa-da77bc7128ae\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"
Sep 10 23:37:59.686176 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:59.686139    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:59.709326 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:59.709285    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-566dk\""
Sep 10 23:37:59.717807 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:59.717779    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"
Sep 10 23:37:59.757490 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:59.757448    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:37:59.810728 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:59.810650    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cc958457f-jp6d6" podStartSLOduration=2.8106257709999998 podStartE2EDuration="2.810625771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:57.912322394 +0000 UTC m=+77.953191700" watchObservedRunningTime="2026-09-10 23:37:59.810625771 +0000 UTC m=+79.851495077"
Sep 10 23:37:59.810956 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:37:59.810884    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj"]
Sep 10 23:38:00.839137 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:38:00.839104    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f3e3dd_e396_401a_bb39_e09ae0cc63ed.slice/crio-9eb46a9a35f84326c20ac771b57dd5fe33f35000a75c09620af42f0e24a3d59c WatchSource:0}: Error finding container 9eb46a9a35f84326c20ac771b57dd5fe33f35000a75c09620af42f0e24a3d59c: Status 404 returned error can't find the container with id 9eb46a9a35f84326c20ac771b57dd5fe33f35000a75c09620af42f0e24a3d59c
Sep 10 23:38:00.899859 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:00.899828    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj" event={"ID":"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed","Type":"ContainerStarted","Data":"9eb46a9a35f84326c20ac771b57dd5fe33f35000a75c09620af42f0e24a3d59c"}
Sep 10 23:38:01.104141 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:01.104067    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz"]
Sep 10 23:38:01.107254 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:38:01.107224    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8aa8281_3111_4640_94aa_da77bc7128ae.slice/crio-76460fb15f0459667b8c371849b283197965f2cd03d209f705ecb5d0cf197dce WatchSource:0}: Error finding container 76460fb15f0459667b8c371849b283197965f2cd03d209f705ecb5d0cf197dce: Status 404 returned error can't find the container with id 76460fb15f0459667b8c371849b283197965f2cd03d209f705ecb5d0cf197dce
Sep 10 23:38:01.907948 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:01.907820    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz" event={"ID":"a8aa8281-3111-4640-94aa-da77bc7128ae","Type":"ContainerStarted","Data":"76460fb15f0459667b8c371849b283197965f2cd03d209f705ecb5d0cf197dce"}
Sep 10 23:38:01.909526 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:01.909500    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk" event={"ID":"45227a6e-717c-4ab7-b59a-68bf19824b76","Type":"ContainerStarted","Data":"585a55f02f0b8b963778f562bd62e680932cdb8dcb9e848f69bd7531bec7b977"}
Sep 10 23:38:01.909731 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:01.909714    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk"
Sep 10 23:38:01.911538 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:01.911517    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk"
Sep 10 23:38:01.926173 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:01.926114    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bd66676cd-xj2kk" podStartSLOduration=2.491261251 podStartE2EDuration="5.926097623s" totalImagesPullingTime="3.434836372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:01.925179823 +0000 UTC m=+81.966049126" watchObservedRunningTime="2026-09-10 23:38:01.926097623 +0000 UTC m=+81.966966929"
Sep 10 23:38:02.874829 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:02.874797    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zgxwp"
Sep 10 23:38:02.917453 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:02.917357    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj" event={"ID":"b2f3e3dd-e396-401a-bb39-e09ae0cc63ed","Type":"ContainerStarted","Data":"0c8e82f7bfdc0e7f85d4ab69fce36f025a40a15af0273e477a3cbdf4bb7d8b55"}
Sep 10 23:38:02.919737 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:02.919705    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz" event={"ID":"a8aa8281-3111-4640-94aa-da77bc7128ae","Type":"ContainerStarted","Data":"760810ebac5896b568999d641687c7467a7d68605835a3475bd1294f8c6cd1eb"}
Sep 10 23:38:02.938910 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:02.938865    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-btsrj" podStartSLOduration=34.117284208 podStartE2EDuration="35.938848358s" totalImagesPullingTime="1.82156415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:02.937808397 +0000 UTC m=+82.978677716" watchObservedRunningTime="2026-09-10 23:38:02.938848358 +0000 UTC m=+82.979717663"
Sep 10 23:38:02.959603 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:02.959539    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-j66qz" podStartSLOduration=34.410454189 podStartE2EDuration="35.959517674s" totalImagesPullingTime="1.549063485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:02.958631902 +0000 UTC m=+82.999501210" watchObservedRunningTime="2026-09-10 23:38:02.959517674 +0000 UTC m=+83.000386979"
Sep 10 23:38:02.997367 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:02.997329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:03.098826 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:03.098788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:03.177320 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:03.177221    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:03.432547 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:03.432442    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:04.850267 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:04.850227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:38:04.852739 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:04.852718    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/432c2920-5ba6-489e-8dcc-7656d6e98c6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7j76\" (UID: \"432c2920-5ba6-489e-8dcc-7656d6e98c6b\") " pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:38:05.021549 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:05.021515    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4wv72\""
Sep 10 23:38:05.029536 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:05.029514    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j7j76"
Sep 10 23:38:05.301328 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:05.301292    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j7j76"]
Sep 10 23:38:05.304089 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:38:05.304061    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432c2920_5ba6_489e_8dcc_7656d6e98c6b.slice/crio-7addc306139cdf446fd644238dc680828b81dbf58680434f52c4dcba56755cbb WatchSource:0}: Error finding container 7addc306139cdf446fd644238dc680828b81dbf58680434f52c4dcba56755cbb: Status 404 returned error can't find the container with id 7addc306139cdf446fd644238dc680828b81dbf58680434f52c4dcba56755cbb
Sep 10 23:38:05.932506 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:05.932480    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j7j76" event={"ID":"432c2920-5ba6-489e-8dcc-7656d6e98c6b","Type":"ContainerStarted","Data":"b236bd43d461fcddc7c1c24f74f2b4c193b48739292f965f102f0e0a0044eb05"}
Sep 10 23:38:05.932810 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:05.932534    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j7j76" event={"ID":"432c2920-5ba6-489e-8dcc-7656d6e98c6b","Type":"ContainerStarted","Data":"7addc306139cdf446fd644238dc680828b81dbf58680434f52c4dcba56755cbb"}
Sep 10 23:38:06.938864 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:06.938819    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j7j76" event={"ID":"432c2920-5ba6-489e-8dcc-7656d6e98c6b","Type":"ContainerStarted","Data":"78f0d48911b6b48fc49d6b0fc832765f8f6716246fe0007dc4d46017d43064d3"}
Sep 10 23:38:07.010214 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:07.010181    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:38:07.180183 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:07.180149    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:07.255862 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:07.255832    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:07.318710 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:07.318664    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:07.945427 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:07.945390    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j7j76" event={"ID":"432c2920-5ba6-489e-8dcc-7656d6e98c6b","Type":"ContainerStarted","Data":"250f0cba3cd49cc88c5597867f4c3f3e222d15fcb9552268152c97e205bb6e1d"}
Sep 10 23:38:07.963042 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:07.962993    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j7j76" podStartSLOduration=34.094162994 podStartE2EDuration="35.962977315s" totalImagesPullingTime="1.868814321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:37:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:07.961215302 +0000 UTC m=+88.002084608" watchObservedRunningTime="2026-09-10 23:38:07.962977315 +0000 UTC m=+88.003846619"
Sep 10 23:38:08.839655 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:08.839621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:08.897637 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:08.897598    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:09.221310 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:09.221277    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:11.322082 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.322050    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:11.472315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.472285    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:11.571911 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.571876    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"]
Sep 10 23:38:11.575288 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.575217    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:11.576119 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.576100    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"
Sep 10 23:38:11.578410 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.578384    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-k7lnw\""
Sep 10 23:38:11.578515 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.578461    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 10 23:38:11.578515 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.578474    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 10 23:38:11.579475 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.579457    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 23:38:11.591949 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.591928    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"]
Sep 10 23:38:11.593029 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.593013    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fdwkm"]
Sep 10 23:38:11.596221 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.596202    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.598578 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.598549    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 23:38:11.598705 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.598617    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v8rxg\""
Sep 10 23:38:11.598705 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.598647    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 23:38:11.598967 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.598949    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 23:38:11.658732 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.658700    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:11.703726 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.703686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b27f5d5-b5a6-4abf-8c08-d71ead781045-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.703726 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.703728    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b27f5d5-b5a6-4abf-8c08-d71ead781045-node-exporter-textfile\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.703938 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.703789    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a6e9048-c627-4b8b-8169-8715e8a015b5-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-nkflj\" (UID: \"5a6e9048-c627-4b8b-8169-8715e8a015b5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"
Sep 10 23:38:11.703938 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.703829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b27f5d5-b5a6-4abf-8c08-d71ead781045-node-exporter-tls\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.703938 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.703855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a6e9048-c627-4b8b-8169-8715e8a015b5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-nkflj\" (UID: \"5a6e9048-c627-4b8b-8169-8715e8a015b5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"
Sep 10 23:38:11.703938 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.703873    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b27f5d5-b5a6-4abf-8c08-d71ead781045-sys\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.703938 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.703908    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn76r\" (UniqueName: \"kubernetes.io/projected/1b27f5d5-b5a6-4abf-8c08-d71ead781045-kube-api-access-bn76r\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.703938 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.703936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b27f5d5-b5a6-4abf-8c08-d71ead781045-root\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.704174 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.703959    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b27f5d5-b5a6-4abf-8c08-d71ead781045-node-exporter-wtmp\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.704174 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.703982    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b27f5d5-b5a6-4abf-8c08-d71ead781045-metrics-client-ca\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.704174 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.704002    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b27f5d5-b5a6-4abf-8c08-d71ead781045-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.704174 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.704022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk7jt\" (UniqueName: \"kubernetes.io/projected/5a6e9048-c627-4b8b-8169-8715e8a015b5-kube-api-access-gk7jt\") pod \"openshift-state-metrics-67dcf8c979-nkflj\" (UID: \"5a6e9048-c627-4b8b-8169-8715e8a015b5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"
Sep 10 23:38:11.704174 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.704062    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a6e9048-c627-4b8b-8169-8715e8a015b5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-nkflj\" (UID: \"5a6e9048-c627-4b8b-8169-8715e8a015b5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"
Sep 10 23:38:11.753717 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.753688    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:11.805309 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.805274    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a6e9048-c627-4b8b-8169-8715e8a015b5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-nkflj\" (UID: \"5a6e9048-c627-4b8b-8169-8715e8a015b5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"
Sep 10 23:38:11.805477 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.805336    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b27f5d5-b5a6-4abf-8c08-d71ead781045-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.805477 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.805395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b27f5d5-b5a6-4abf-8c08-d71ead781045-node-exporter-textfile\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.805477 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.805423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a6e9048-c627-4b8b-8169-8715e8a015b5-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-nkflj\" (UID: \"5a6e9048-c627-4b8b-8169-8715e8a015b5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"
Sep 10 23:38:11.805477 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.805465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b27f5d5-b5a6-4abf-8c08-d71ead781045-node-exporter-tls\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.805727 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.805493    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a6e9048-c627-4b8b-8169-8715e8a015b5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-nkflj\" (UID: \"5a6e9048-c627-4b8b-8169-8715e8a015b5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"
Sep 10 23:38:11.805727 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.805521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b27f5d5-b5a6-4abf-8c08-d71ead781045-sys\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.805727 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.805546    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn76r\" (UniqueName: \"kubernetes.io/projected/1b27f5d5-b5a6-4abf-8c08-d71ead781045-kube-api-access-bn76r\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.805727 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.805569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b27f5d5-b5a6-4abf-8c08-d71ead781045-root\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.805727 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.805600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b27f5d5-b5a6-4abf-8c08-d71ead781045-node-exporter-wtmp\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.805727 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.805631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b27f5d5-b5a6-4abf-8c08-d71ead781045-metrics-client-ca\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.805727 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.805655    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b27f5d5-b5a6-4abf-8c08-d71ead781045-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.805727 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.805718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk7jt\" (UniqueName: \"kubernetes.io/projected/5a6e9048-c627-4b8b-8169-8715e8a015b5-kube-api-access-gk7jt\") pod \"openshift-state-metrics-67dcf8c979-nkflj\" (UID: \"5a6e9048-c627-4b8b-8169-8715e8a015b5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"
Sep 10 23:38:11.806173 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.805978    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b27f5d5-b5a6-4abf-8c08-d71ead781045-sys\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.806173 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.806003    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b27f5d5-b5a6-4abf-8c08-d71ead781045-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.806173 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.806080    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b27f5d5-b5a6-4abf-8c08-d71ead781045-root\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.806173 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.806114    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b27f5d5-b5a6-4abf-8c08-d71ead781045-node-exporter-wtmp\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.806371 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.806209    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a6e9048-c627-4b8b-8169-8715e8a015b5-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-nkflj\" (UID: \"5a6e9048-c627-4b8b-8169-8715e8a015b5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"
Sep 10 23:38:11.806701 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.806662    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b27f5d5-b5a6-4abf-8c08-d71ead781045-node-exporter-textfile\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.807071 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.806785    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b27f5d5-b5a6-4abf-8c08-d71ead781045-metrics-client-ca\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.808252 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.808231    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a6e9048-c627-4b8b-8169-8715e8a015b5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-nkflj\" (UID: \"5a6e9048-c627-4b8b-8169-8715e8a015b5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"
Sep 10 23:38:11.808505 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.808483    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a6e9048-c627-4b8b-8169-8715e8a015b5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-nkflj\" (UID: \"5a6e9048-c627-4b8b-8169-8715e8a015b5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"
Sep 10 23:38:11.808746 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.808725    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b27f5d5-b5a6-4abf-8c08-d71ead781045-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.808896 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.808879    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b27f5d5-b5a6-4abf-8c08-d71ead781045-node-exporter-tls\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.813324 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.813299    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn76r\" (UniqueName: \"kubernetes.io/projected/1b27f5d5-b5a6-4abf-8c08-d71ead781045-kube-api-access-bn76r\") pod \"node-exporter-fdwkm\" (UID: \"1b27f5d5-b5a6-4abf-8c08-d71ead781045\") " pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.814022 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.814003    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk7jt\" (UniqueName: \"kubernetes.io/projected/5a6e9048-c627-4b8b-8169-8715e8a015b5-kube-api-access-gk7jt\") pod \"openshift-state-metrics-67dcf8c979-nkflj\" (UID: \"5a6e9048-c627-4b8b-8169-8715e8a015b5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"
Sep 10 23:38:11.853768 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.853695    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:11.885558 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.885530    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"
Sep 10 23:38:11.904995 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.904972    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fdwkm"
Sep 10 23:38:11.916381 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:38:11.916338    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b27f5d5_b5a6_4abf_8c08_d71ead781045.slice/crio-f6b4fb376cf31be5e1166ca160f9c08fa2a32926f2108878fceca4cafd8f59fe WatchSource:0}: Error finding container f6b4fb376cf31be5e1166ca160f9c08fa2a32926f2108878fceca4cafd8f59fe: Status 404 returned error can't find the container with id f6b4fb376cf31be5e1166ca160f9c08fa2a32926f2108878fceca4cafd8f59fe
Sep 10 23:38:11.957081 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.957046    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:11.961128 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:11.961101    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdwkm" event={"ID":"1b27f5d5-b5a6-4abf-8c08-d71ead781045","Type":"ContainerStarted","Data":"f6b4fb376cf31be5e1166ca160f9c08fa2a32926f2108878fceca4cafd8f59fe"}
Sep 10 23:38:12.055291 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:12.055257    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:12.172042 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:12.171997    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj"]
Sep 10 23:38:12.230312 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:12.230248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:12.336455 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:12.336413    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:12.543176 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:12.543136    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:12.672132 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:12.672097    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:12.852760 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:12.852734    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:12.969438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:12.969404    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj" event={"ID":"5a6e9048-c627-4b8b-8169-8715e8a015b5","Type":"ContainerStarted","Data":"ca1d7a805711974de1e85bb27080d192fcea5b9f56c1ef2199a15c630d83c6f5"}
Sep 10 23:38:12.969560 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:12.969482    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj" event={"ID":"5a6e9048-c627-4b8b-8169-8715e8a015b5","Type":"ContainerStarted","Data":"8f54458ad7ff212191c850e34a1606335a011f3267ec229b864db97386f59f21"}
Sep 10 23:38:12.969560 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:12.969513    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj" event={"ID":"5a6e9048-c627-4b8b-8169-8715e8a015b5","Type":"ContainerStarted","Data":"3563587d085ca4c397b1d2957181d9f0f7aa4b125234068a50d31ec9b6925bde"}
Sep 10 23:38:12.971461 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:12.971434    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdwkm" event={"ID":"1b27f5d5-b5a6-4abf-8c08-d71ead781045","Type":"ContainerStarted","Data":"a706fee3f220c4d2ffe69c92b47343ee9fc9c5ee035a4e13d84e34087433487e"}
Sep 10 23:38:12.990275 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:12.990246    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:13.111256 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:13.111230    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:13.257432 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:13.257396    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:13.572963 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:13.572922    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:13.658845 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:13.658815    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:13.735016 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:13.734975    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:13.898001 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:13.897968    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:13.978092 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:13.978054    2581 generic.go:356] "Generic (PLEG): container finished" podID="1b27f5d5-b5a6-4abf-8c08-d71ead781045" containerID="a706fee3f220c4d2ffe69c92b47343ee9fc9c5ee035a4e13d84e34087433487e" exitCode=0
Sep 10 23:38:13.978255 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:13.978131    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdwkm" event={"ID":"1b27f5d5-b5a6-4abf-8c08-d71ead781045","Type":"ContainerDied","Data":"a706fee3f220c4d2ffe69c92b47343ee9fc9c5ee035a4e13d84e34087433487e"}
Sep 10 23:38:13.978255 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:13.978181    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdwkm" event={"ID":"1b27f5d5-b5a6-4abf-8c08-d71ead781045","Type":"ContainerStarted","Data":"e1de5dab9b1679888ccaf7580123d3b730bdb518a23327acff15daabdce47b05"}
Sep 10 23:38:13.978255 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:13.978198    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdwkm" event={"ID":"1b27f5d5-b5a6-4abf-8c08-d71ead781045","Type":"ContainerStarted","Data":"fed4c6c804476dfd160f06a4cd229caf2b9432a015c2a18df30ff81e905ad18b"}
Sep 10 23:38:13.980220 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:13.980198    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj" event={"ID":"5a6e9048-c627-4b8b-8169-8715e8a015b5","Type":"ContainerStarted","Data":"81ff37a4f8eafb3038f8cf8ebd10075c4b7c9ad2750def58fa31706152d8494c"}
Sep 10 23:38:14.001600 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:14.001541    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:14.001741 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:14.001643    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fdwkm" podStartSLOduration=2.027630682 podStartE2EDuration="3.001631336s" totalImagesPullingTime="894.717223ms" totalInitContainerRuntime="79.283431ms" isStatefulPod=true podCreationTimestamp="2026-09-10 23:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:14.001007472 +0000 UTC m=+94.041876777" watchObservedRunningTime="2026-09-10 23:38:14.001631336 +0000 UTC m=+94.042500655"
Sep 10 23:38:14.018650 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:14.018608    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nkflj" podStartSLOduration=1.880188506 podStartE2EDuration="3.018593728s" totalImagesPullingTime="1.138405222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:14.017909248 +0000 UTC m=+94.058778552" watchObservedRunningTime="2026-09-10 23:38:14.018593728 +0000 UTC m=+94.059463033"
Sep 10 23:38:14.495147 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:14.495112    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:14.640754 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:14.640718    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:14.741731 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:14.741694    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:14.866895 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:14.866803    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:15.070988 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:15.070952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:15.245591 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:15.245560    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:15.994017 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:15.993979    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:16.056263 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:16.056225    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:16.337350 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:16.337260    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:16.428638 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:16.428607    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:16.568777 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:16.568741    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:17.845700 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:17.845658    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xjmkz"
Sep 10 23:38:17.940388 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:17.940347    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:18.104440 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:18.104360    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:18.208175 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:18.208140    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:18.897268 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:18.897240    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cc958457f-jp6d6"
Sep 10 23:38:19.046360 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.046322    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:19.062378 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.062347    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75657f94f9-wmgjj"]
Sep 10 23:38:19.066657 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.066640    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.069156 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.069123    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 23:38:19.069276 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.069166    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 23:38:19.069327 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.069279    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 23:38:19.069425 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.069409    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 23:38:19.069479 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.069458    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 23:38:19.069479 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.069469    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 23:38:19.069579 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.069490    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2vdlb\""
Sep 10 23:38:19.069579 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.069485    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 23:38:19.076583 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.076561    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75657f94f9-wmgjj"]
Sep 10 23:38:19.109122 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.109090    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:19.166316 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.166254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/924d7183-0d70-42a1-880b-595c8fd20a35-console-serving-cert\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.166316 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.166284    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/924d7183-0d70-42a1-880b-595c8fd20a35-console-oauth-config\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.166498 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.166381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-service-ca\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.166498 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.166438    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-oauth-serving-cert\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.166498 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.166471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-console-config\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.166600 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.166517    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x96n7\" (UniqueName: \"kubernetes.io/projected/924d7183-0d70-42a1-880b-595c8fd20a35-kube-api-access-x96n7\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.267342 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.267308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-service-ca\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.267501 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.267356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-oauth-serving-cert\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.267501 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.267388    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-console-config\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.267501 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.267425    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x96n7\" (UniqueName: \"kubernetes.io/projected/924d7183-0d70-42a1-880b-595c8fd20a35-kube-api-access-x96n7\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.267501 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.267457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/924d7183-0d70-42a1-880b-595c8fd20a35-console-serving-cert\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.267501 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.267481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/924d7183-0d70-42a1-880b-595c8fd20a35-console-oauth-config\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.268144 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.268085    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-oauth-serving-cert\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.268144 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.268124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-console-config\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.268418 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.268125    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-service-ca\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.270021 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.270002    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/924d7183-0d70-42a1-880b-595c8fd20a35-console-oauth-config\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.270223 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.270205    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/924d7183-0d70-42a1-880b-595c8fd20a35-console-serving-cert\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.275328 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.275304    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x96n7\" (UniqueName: \"kubernetes.io/projected/924d7183-0d70-42a1-880b-595c8fd20a35-kube-api-access-x96n7\") pod \"console-75657f94f9-wmgjj\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") " pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.375833 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.375800    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:19.650997 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:19.650965    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75657f94f9-wmgjj"]
Sep 10 23:38:19.654317 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:38:19.654289    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod924d7183_0d70_42a1_880b_595c8fd20a35.slice/crio-39ff17dd113657b5cf902b9f4d8b0b5a0bc6703ab96fd0a89afbf7fefba06745 WatchSource:0}: Error finding container 39ff17dd113657b5cf902b9f4d8b0b5a0bc6703ab96fd0a89afbf7fefba06745: Status 404 returned error can't find the container with id 39ff17dd113657b5cf902b9f4d8b0b5a0bc6703ab96fd0a89afbf7fefba06745
Sep 10 23:38:20.003280 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:20.003247    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75657f94f9-wmgjj" event={"ID":"924d7183-0d70-42a1-880b-595c8fd20a35","Type":"ContainerStarted","Data":"39ff17dd113657b5cf902b9f4d8b0b5a0bc6703ab96fd0a89afbf7fefba06745"}
Sep 10 23:38:21.026654 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:21.026621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:21.131771 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:21.131724    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:22.023035 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.022991    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl" podUID="27b4b4ef-7c4b-4f85-b128-b5fd26f222e8" containerName="registry" containerID="cri-o://fd0c67c10e20adadd96adc8a50f982049237693fea492977a5f90d39790726b4" gracePeriod=30
Sep 10 23:38:22.607472 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.607453    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:38:22.699085 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.699053    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-ca-trust-extracted\") pod \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") "
Sep 10 23:38:22.699260 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.699107    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-image-registry-private-configuration\") pod \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") "
Sep 10 23:38:22.699260 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.699137    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-bound-sa-token\") pod \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") "
Sep 10 23:38:22.699260 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.699191    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-installation-pull-secrets\") pod \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") "
Sep 10 23:38:22.699540 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.699517    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls\") pod \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") "
Sep 10 23:38:22.699730 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.699570    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-certificates\") pod \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") "
Sep 10 23:38:22.699730 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.699602    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-trusted-ca\") pod \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") "
Sep 10 23:38:22.699730 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.699655    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rtm6\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-kube-api-access-6rtm6\") pod \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\" (UID: \"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8\") "
Sep 10 23:38:22.700303 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.700210    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8" (UID: "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:38:22.700832 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.700804    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8" (UID: "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:38:22.702329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.702223    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8" (UID: "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:38:22.702329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.702252    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8" (UID: "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:38:22.702641 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.702608    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-kube-api-access-6rtm6" (OuterVolumeSpecName: "kube-api-access-6rtm6") pod "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8" (UID: "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8"). InnerVolumeSpecName "kube-api-access-6rtm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:38:22.702765 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.702733    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8" (UID: "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:38:22.704191 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.704167    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8" (UID: "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:38:22.709032 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.709004    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8" (UID: "27b4b4ef-7c4b-4f85-b128-b5fd26f222e8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:38:22.801208 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.801133    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-certificates\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:38:22.801208 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.801159    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-trusted-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:38:22.801208 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.801168    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rtm6\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-kube-api-access-6rtm6\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:38:22.801208 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.801176    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-ca-trust-extracted\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:38:22.801208 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.801185    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-image-registry-private-configuration\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:38:22.801208 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.801193    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-bound-sa-token\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:38:22.801208 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.801201    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-installation-pull-secrets\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:38:22.801515 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:22.801217    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8-registry-tls\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:38:23.016176 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:23.016139    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75657f94f9-wmgjj" event={"ID":"924d7183-0d70-42a1-880b-595c8fd20a35","Type":"ContainerStarted","Data":"fd39f350be2c73cdcefc1da4bee4819a431a37989911a25f97750a875bf9dc70"}
Sep 10 23:38:23.017498 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:23.017472    2581 generic.go:356] "Generic (PLEG): container finished" podID="27b4b4ef-7c4b-4f85-b128-b5fd26f222e8" containerID="fd0c67c10e20adadd96adc8a50f982049237693fea492977a5f90d39790726b4" exitCode=0
Sep 10 23:38:23.017635 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:23.017517    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl"
Sep 10 23:38:23.017635 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:23.017548    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl" event={"ID":"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8","Type":"ContainerDied","Data":"fd0c67c10e20adadd96adc8a50f982049237693fea492977a5f90d39790726b4"}
Sep 10 23:38:23.017635 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:23.017582    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c59bf648c-hbdwl" event={"ID":"27b4b4ef-7c4b-4f85-b128-b5fd26f222e8","Type":"ContainerDied","Data":"20c9f621e5b354b62c7322104b20f3dd19eb24e5629edcf456c9f01f8101b1b9"}
Sep 10 23:38:23.017635 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:23.017601    2581 scope.go:117] "RemoveContainer" containerID="fd0c67c10e20adadd96adc8a50f982049237693fea492977a5f90d39790726b4"
Sep 10 23:38:23.026329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:23.026220    2581 scope.go:117] "RemoveContainer" containerID="fd0c67c10e20adadd96adc8a50f982049237693fea492977a5f90d39790726b4"
Sep 10 23:38:23.026517 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:38:23.026498    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd0c67c10e20adadd96adc8a50f982049237693fea492977a5f90d39790726b4\": container with ID starting with fd0c67c10e20adadd96adc8a50f982049237693fea492977a5f90d39790726b4 not found: ID does not exist" containerID="fd0c67c10e20adadd96adc8a50f982049237693fea492977a5f90d39790726b4"
Sep 10 23:38:23.026562 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:23.026527    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd0c67c10e20adadd96adc8a50f982049237693fea492977a5f90d39790726b4"} err="failed to get container status \"fd0c67c10e20adadd96adc8a50f982049237693fea492977a5f90d39790726b4\": rpc error: code = NotFound desc = could not find container \"fd0c67c10e20adadd96adc8a50f982049237693fea492977a5f90d39790726b4\": container with ID starting with fd0c67c10e20adadd96adc8a50f982049237693fea492977a5f90d39790726b4 not found: ID does not exist"
Sep 10 23:38:23.038981 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:23.038933    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75657f94f9-wmgjj" podStartSLOduration=1.096717487 podStartE2EDuration="4.038918825s" totalImagesPullingTime="2.942201338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:23.033160766 +0000 UTC m=+103.074030071" watchObservedRunningTime="2026-09-10 23:38:23.038918825 +0000 UTC m=+103.079788129"
Sep 10 23:38:23.047730 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:23.047706    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c59bf648c-hbdwl"]
Sep 10 23:38:23.051799 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:23.051749    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c59bf648c-hbdwl"]
Sep 10 23:38:24.482554 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:24.482521    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27b4b4ef-7c4b-4f85-b128-b5fd26f222e8" path="/var/lib/kubelet/pods/27b4b4ef-7c4b-4f85-b128-b5fd26f222e8/volumes"
Sep 10 23:38:25.559833 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:25.559783    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:25.664630 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:25.664601    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:28.909090 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:28.909054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:28.964659 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:28.964625    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:29.303575 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.303536    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b5955fbbf-wk9k7"]
Sep 10 23:38:29.303895 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.303878    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27b4b4ef-7c4b-4f85-b128-b5fd26f222e8" containerName="registry"
Sep 10 23:38:29.303978 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.303898    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="27b4b4ef-7c4b-4f85-b128-b5fd26f222e8" containerName="registry"
Sep 10 23:38:29.304031 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.303977    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="27b4b4ef-7c4b-4f85-b128-b5fd26f222e8" containerName="registry"
Sep 10 23:38:29.309332 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.309304    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.318069 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.318047    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 23:38:29.319149 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.319128    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b5955fbbf-wk9k7"]
Sep 10 23:38:29.376310 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.376273    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:29.376471 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.376332    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:29.381638 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.381613    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:29.450849 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.450810    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-serving-cert\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.451004 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.450859    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-oauth-config\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.451004 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.450921    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-oauth-serving-cert\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.451004 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.450950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-service-ca\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.451004 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.450993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpxl7\" (UniqueName: \"kubernetes.io/projected/6f2a3225-117a-4885-be23-e7a7fb3b115c-kube-api-access-mpxl7\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.451191 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.451171    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-config\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.451250 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.451232    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-trusted-ca-bundle\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.552055 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.552023    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-serving-cert\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.552202 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.552063    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-oauth-config\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.552202 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.552099    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-oauth-serving-cert\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.552202 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.552125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-service-ca\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.552202 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.552156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpxl7\" (UniqueName: \"kubernetes.io/projected/6f2a3225-117a-4885-be23-e7a7fb3b115c-kube-api-access-mpxl7\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.552394 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.552207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-config\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.552394 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.552241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-trusted-ca-bundle\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.553104 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.553078    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-trusted-ca-bundle\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.553104 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.553083    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-oauth-serving-cert\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.553287 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.553112    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-service-ca\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.553287 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.553195    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-config\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.554689 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.554617    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-oauth-config\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.554908 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.554889    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-serving-cert\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.560105 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.560081    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpxl7\" (UniqueName: \"kubernetes.io/projected/6f2a3225-117a-4885-be23-e7a7fb3b115c-kube-api-access-mpxl7\") pod \"console-5b5955fbbf-wk9k7\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") " pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.619121 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.619094    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:29.887272 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:29.887200    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b5955fbbf-wk9k7"]
Sep 10 23:38:29.890026 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:38:29.889998    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f2a3225_117a_4885_be23_e7a7fb3b115c.slice/crio-10bfca24d812b33ff09119f27b2c6cc6423835b19b1b98d0ccc5a7041caf36b3 WatchSource:0}: Error finding container 10bfca24d812b33ff09119f27b2c6cc6423835b19b1b98d0ccc5a7041caf36b3: Status 404 returned error can't find the container with id 10bfca24d812b33ff09119f27b2c6cc6423835b19b1b98d0ccc5a7041caf36b3
Sep 10 23:38:30.019008 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:30.018981    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:30.043230 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:30.043201    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5955fbbf-wk9k7" event={"ID":"6f2a3225-117a-4885-be23-e7a7fb3b115c","Type":"ContainerStarted","Data":"6ab283d223f456901f19c1b864ab17d4d3fbf416b2afea3cd3334402567e72b5"}
Sep 10 23:38:30.043383 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:30.043249    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5955fbbf-wk9k7" event={"ID":"6f2a3225-117a-4885-be23-e7a7fb3b115c","Type":"ContainerStarted","Data":"10bfca24d812b33ff09119f27b2c6cc6423835b19b1b98d0ccc5a7041caf36b3"}
Sep 10 23:38:30.047108 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:30.047091    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:38:30.062929 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:30.062886    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b5955fbbf-wk9k7" podStartSLOduration=1.062873035 podStartE2EDuration="1.062873035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:38:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:30.060620634 +0000 UTC m=+110.101489940" watchObservedRunningTime="2026-09-10 23:38:30.062873035 +0000 UTC m=+110.103742342"
Sep 10 23:38:30.081062 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:30.081034    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:33.121376 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:33.121340    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:33.222417 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:33.222384    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:33.284837 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:33.284797    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:36.749517 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:36.749481    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:36.847978 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:36.847926    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:36.948913 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:36.948872    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:37.007147 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:37.007066    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:38.315923 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:38.315885    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:38.367211 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:38.367175    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:39.619858 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:39.619820    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:39.620302 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:39.619898    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:39.624812 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:39.624790    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:39.718244 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:39.718211    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:39.774847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:39.774811    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:40.081677 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:40.081633    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:38:40.129272 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:40.129238    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75657f94f9-wmgjj"]
Sep 10 23:38:40.563057 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:40.563014    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:40.615471 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:40.615433    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:43.310627 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:43.310578    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:43.365019 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:43.364988    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:44.108983 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:44.108952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:44.165701 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:44.165634    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:50.219762 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:50.219728    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs\") pod \"network-metrics-daemon-4gtf5\" (UID: \"afe96c24-b384-431f-85db-44d132dde401\") " pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:38:50.222112 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:50.222090    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afe96c24-b384-431f-85db-44d132dde401-metrics-certs\") pod \"network-metrics-daemon-4gtf5\" (UID: \"afe96c24-b384-431f-85db-44d132dde401\") " pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:38:50.296760 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:50.296732    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cql7l\""
Sep 10 23:38:50.304660 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:50.304641    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gtf5"
Sep 10 23:38:50.581718 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:50.581684    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4gtf5"]
Sep 10 23:38:50.584286 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:38:50.584247    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe96c24_b384_431f_85db_44d132dde401.slice/crio-00855b16c640f3f0e344e93619e9dcc0d827a26d2b977277ad48c51504419430 WatchSource:0}: Error finding container 00855b16c640f3f0e344e93619e9dcc0d827a26d2b977277ad48c51504419430: Status 404 returned error can't find the container with id 00855b16c640f3f0e344e93619e9dcc0d827a26d2b977277ad48c51504419430
Sep 10 23:38:51.118485 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:51.118450    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4gtf5" event={"ID":"afe96c24-b384-431f-85db-44d132dde401","Type":"ContainerStarted","Data":"00855b16c640f3f0e344e93619e9dcc0d827a26d2b977277ad48c51504419430"}
Sep 10 23:38:52.124500 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:52.124465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4gtf5" event={"ID":"afe96c24-b384-431f-85db-44d132dde401","Type":"ContainerStarted","Data":"cb0858b9b918ab91567cde5bf5fd1c9856f20fa8d0843741dfc9a75b7c0acc60"}
Sep 10 23:38:52.124970 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:52.124540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4gtf5" event={"ID":"afe96c24-b384-431f-85db-44d132dde401","Type":"ContainerStarted","Data":"3446b1ea759902b8a47b02fb80bad3028a010446bb1ed33e1d7313fdf20b5906"}
Sep 10 23:38:52.141607 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:52.141560    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4gtf5" podStartSLOduration=130.299128197 podStartE2EDuration="2m11.141546298s" totalImagesPullingTime="842.418101ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:52.140566482 +0000 UTC m=+132.181435790" watchObservedRunningTime="2026-09-10 23:38:52.141546298 +0000 UTC m=+132.182415602"
Sep 10 23:38:52.210267 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:52.210243    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cjngp_3f873507-a363-4ab5-b68a-8aaa1747b705/serve-healthcheck-canary/0.log"
Sep 10 23:38:52.264087 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:52.264059    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:52.321124 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:52.321094    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:55.557222 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:55.557186    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:38:55.657156 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:38:55.657120    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:04.764139 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:04.764095    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:04.867454 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:04.867416    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:04.926396 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:04.926357    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:05.149379 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.149295    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75657f94f9-wmgjj" podUID="924d7183-0d70-42a1-880b-595c8fd20a35" containerName="console" containerID="cri-o://fd39f350be2c73cdcefc1da4bee4819a431a37989911a25f97750a875bf9dc70" gracePeriod=15
Sep 10 23:39:05.406461 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.406408    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:39:05.436465 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.436440    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/924d7183-0d70-42a1-880b-595c8fd20a35-console-oauth-config\") pod \"924d7183-0d70-42a1-880b-595c8fd20a35\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") "
Sep 10 23:39:05.436597 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.436496    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/924d7183-0d70-42a1-880b-595c8fd20a35-console-serving-cert\") pod \"924d7183-0d70-42a1-880b-595c8fd20a35\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") "
Sep 10 23:39:05.436597 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.436537    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-oauth-serving-cert\") pod \"924d7183-0d70-42a1-880b-595c8fd20a35\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") "
Sep 10 23:39:05.436732 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.436716    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-console-config\") pod \"924d7183-0d70-42a1-880b-595c8fd20a35\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") "
Sep 10 23:39:05.436797 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.436757    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x96n7\" (UniqueName: \"kubernetes.io/projected/924d7183-0d70-42a1-880b-595c8fd20a35-kube-api-access-x96n7\") pod \"924d7183-0d70-42a1-880b-595c8fd20a35\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") "
Sep 10 23:39:05.436854 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.436810    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-service-ca\") pod \"924d7183-0d70-42a1-880b-595c8fd20a35\" (UID: \"924d7183-0d70-42a1-880b-595c8fd20a35\") "
Sep 10 23:39:05.437025 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.436920    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "924d7183-0d70-42a1-880b-595c8fd20a35" (UID: "924d7183-0d70-42a1-880b-595c8fd20a35"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:39:05.437159 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.437073    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-oauth-serving-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:39:05.437159 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.437102    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-console-config" (OuterVolumeSpecName: "console-config") pod "924d7183-0d70-42a1-880b-595c8fd20a35" (UID: "924d7183-0d70-42a1-880b-595c8fd20a35"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:39:05.437291 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.437266    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-service-ca" (OuterVolumeSpecName: "service-ca") pod "924d7183-0d70-42a1-880b-595c8fd20a35" (UID: "924d7183-0d70-42a1-880b-595c8fd20a35"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:39:05.438939 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.438914    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/924d7183-0d70-42a1-880b-595c8fd20a35-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "924d7183-0d70-42a1-880b-595c8fd20a35" (UID: "924d7183-0d70-42a1-880b-595c8fd20a35"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:39:05.439131 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.439106    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/924d7183-0d70-42a1-880b-595c8fd20a35-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "924d7183-0d70-42a1-880b-595c8fd20a35" (UID: "924d7183-0d70-42a1-880b-595c8fd20a35"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:39:05.439211 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.439130    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/924d7183-0d70-42a1-880b-595c8fd20a35-kube-api-access-x96n7" (OuterVolumeSpecName: "kube-api-access-x96n7") pod "924d7183-0d70-42a1-880b-595c8fd20a35" (UID: "924d7183-0d70-42a1-880b-595c8fd20a35"). InnerVolumeSpecName "kube-api-access-x96n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:39:05.537806 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.537754    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-console-config\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:39:05.537806 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.537800    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x96n7\" (UniqueName: \"kubernetes.io/projected/924d7183-0d70-42a1-880b-595c8fd20a35-kube-api-access-x96n7\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:39:05.537806 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.537811    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/924d7183-0d70-42a1-880b-595c8fd20a35-service-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:39:05.537806 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.537820    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/924d7183-0d70-42a1-880b-595c8fd20a35-console-oauth-config\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:39:05.538068 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:05.537828    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/924d7183-0d70-42a1-880b-595c8fd20a35-console-serving-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:39:06.180743 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:06.180706    2581 generic.go:356] "Generic (PLEG): container finished" podID="924d7183-0d70-42a1-880b-595c8fd20a35" containerID="fd39f350be2c73cdcefc1da4bee4819a431a37989911a25f97750a875bf9dc70" exitCode=0
Sep 10 23:39:06.181253 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:06.180764    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75657f94f9-wmgjj"
Sep 10 23:39:06.181253 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:06.180792    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75657f94f9-wmgjj" event={"ID":"924d7183-0d70-42a1-880b-595c8fd20a35","Type":"ContainerDied","Data":"fd39f350be2c73cdcefc1da4bee4819a431a37989911a25f97750a875bf9dc70"}
Sep 10 23:39:06.181253 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:06.180843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75657f94f9-wmgjj" event={"ID":"924d7183-0d70-42a1-880b-595c8fd20a35","Type":"ContainerDied","Data":"39ff17dd113657b5cf902b9f4d8b0b5a0bc6703ab96fd0a89afbf7fefba06745"}
Sep 10 23:39:06.181253 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:06.180864    2581 scope.go:117] "RemoveContainer" containerID="fd39f350be2c73cdcefc1da4bee4819a431a37989911a25f97750a875bf9dc70"
Sep 10 23:39:06.189002 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:06.188988    2581 scope.go:117] "RemoveContainer" containerID="fd39f350be2c73cdcefc1da4bee4819a431a37989911a25f97750a875bf9dc70"
Sep 10 23:39:06.189277 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:39:06.189249    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd39f350be2c73cdcefc1da4bee4819a431a37989911a25f97750a875bf9dc70\": container with ID starting with fd39f350be2c73cdcefc1da4bee4819a431a37989911a25f97750a875bf9dc70 not found: ID does not exist" containerID="fd39f350be2c73cdcefc1da4bee4819a431a37989911a25f97750a875bf9dc70"
Sep 10 23:39:06.189339 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:06.189285    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd39f350be2c73cdcefc1da4bee4819a431a37989911a25f97750a875bf9dc70"} err="failed to get container status \"fd39f350be2c73cdcefc1da4bee4819a431a37989911a25f97750a875bf9dc70\": rpc error: code = NotFound desc = could not find container \"fd39f350be2c73cdcefc1da4bee4819a431a37989911a25f97750a875bf9dc70\": container with ID starting with fd39f350be2c73cdcefc1da4bee4819a431a37989911a25f97750a875bf9dc70 not found: ID does not exist"
Sep 10 23:39:06.200341 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:06.200313    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75657f94f9-wmgjj"]
Sep 10 23:39:06.202174 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:06.202150    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75657f94f9-wmgjj"]
Sep 10 23:39:06.482732 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:06.482703    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="924d7183-0d70-42a1-880b-595c8fd20a35" path="/var/lib/kubelet/pods/924d7183-0d70-42a1-880b-595c8fd20a35/volumes"
Sep 10 23:39:27.794642 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:27.794609    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:27.852498 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:27.852472    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:28.759117 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:28.759085    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-546bd7c44f-fvp8g"]
Sep 10 23:39:28.759353 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:28.759341    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="924d7183-0d70-42a1-880b-595c8fd20a35" containerName="console"
Sep 10 23:39:28.759406 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:28.759355    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="924d7183-0d70-42a1-880b-595c8fd20a35" containerName="console"
Sep 10 23:39:28.759406 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:28.759405    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="924d7183-0d70-42a1-880b-595c8fd20a35" containerName="console"
Sep 10 23:39:28.764914 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:28.764892    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:28.772506 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:28.772484    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-546bd7c44f-fvp8g"]
Sep 10 23:39:28.813522 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:28.813491    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:28.910444 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:28.910411    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-service-ca\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:28.910614 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:28.910464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-trusted-ca-bundle\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:28.910614 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:28.910544    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-oauth-serving-cert\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:28.910614 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:28.910590    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwkww\" (UniqueName: \"kubernetes.io/projected/3bac376d-f518-4a04-bfa9-b21237c97a92-kube-api-access-dwkww\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:28.910805 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:28.910624    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-console-config\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:28.910805 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:28.910649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bac376d-f518-4a04-bfa9-b21237c97a92-console-serving-cert\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:28.910805 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:28.910705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3bac376d-f518-4a04-bfa9-b21237c97a92-console-oauth-config\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:28.915004 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:28.914971    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:29.011090 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:29.011001    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-trusted-ca-bundle\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:29.011090 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:29.011053    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-oauth-serving-cert\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:29.011090 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:29.011076    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwkww\" (UniqueName: \"kubernetes.io/projected/3bac376d-f518-4a04-bfa9-b21237c97a92-kube-api-access-dwkww\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:29.011344 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:29.011109    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-console-config\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:29.011344 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:29.011132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bac376d-f518-4a04-bfa9-b21237c97a92-console-serving-cert\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:29.011344 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:29.011156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3bac376d-f518-4a04-bfa9-b21237c97a92-console-oauth-config\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:29.011344 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:29.011222    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-service-ca\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:29.011836 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:29.011809    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-oauth-serving-cert\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:29.011962 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:29.011914    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-console-config\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:29.011962 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:29.011933    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-service-ca\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:29.012155 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:29.012140    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-trusted-ca-bundle\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:29.013590 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:29.013572    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3bac376d-f518-4a04-bfa9-b21237c97a92-console-oauth-config\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:29.013761 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:29.013744    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bac376d-f518-4a04-bfa9-b21237c97a92-console-serving-cert\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:29.019104 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:29.019082    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwkww\" (UniqueName: \"kubernetes.io/projected/3bac376d-f518-4a04-bfa9-b21237c97a92-kube-api-access-dwkww\") pod \"console-546bd7c44f-fvp8g\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") " pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:29.075123 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:29.075091    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:29.346596 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:29.346446    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-546bd7c44f-fvp8g"]
Sep 10 23:39:29.349211 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:39:29.349187    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bac376d_f518_4a04_bfa9_b21237c97a92.slice/crio-4cfe981f6f619983d54cde0513fb8153cce30e3a64b1a5963f33412118f3e2df WatchSource:0}: Error finding container 4cfe981f6f619983d54cde0513fb8153cce30e3a64b1a5963f33412118f3e2df: Status 404 returned error can't find the container with id 4cfe981f6f619983d54cde0513fb8153cce30e3a64b1a5963f33412118f3e2df
Sep 10 23:39:30.269059 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:30.269021    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-546bd7c44f-fvp8g" event={"ID":"3bac376d-f518-4a04-bfa9-b21237c97a92","Type":"ContainerStarted","Data":"a79e8710aa19f23d14855d315d0fa278f970257e3d8118fd7992498f2e05af55"}
Sep 10 23:39:30.269492 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:30.269069    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-546bd7c44f-fvp8g" event={"ID":"3bac376d-f518-4a04-bfa9-b21237c97a92","Type":"ContainerStarted","Data":"4cfe981f6f619983d54cde0513fb8153cce30e3a64b1a5963f33412118f3e2df"}
Sep 10 23:39:30.285954 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:30.285909    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-546bd7c44f-fvp8g" podStartSLOduration=2.285892511 podStartE2EDuration="2.285892511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:39:30.285423224 +0000 UTC m=+170.326292531" watchObservedRunningTime="2026-09-10 23:39:30.285892511 +0000 UTC m=+170.326761816"
Sep 10 23:39:39.075272 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:39.075194    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:39.075740 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:39.075515    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:39.081112 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:39.081083    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:39.306176 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:39.306147    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:39:39.351333 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:39.351257    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b5955fbbf-wk9k7"]
Sep 10 23:39:39.445864 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:39.445838    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:39.500569 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:39.500540    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:39.554800 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:39.554771    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:39.731886 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:39.731854    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:39.780361 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:39.780326    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:55.569244 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:55.569206    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:39:55.670490 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:39:55.670457    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:04.370276 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.370236    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b5955fbbf-wk9k7" podUID="6f2a3225-117a-4885-be23-e7a7fb3b115c" containerName="console" containerID="cri-o://6ab283d223f456901f19c1b864ab17d4d3fbf416b2afea3cd3334402567e72b5" gracePeriod=15
Sep 10 23:40:04.617628 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.617601    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:40:04.682092 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.682016    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-serving-cert\") pod \"6f2a3225-117a-4885-be23-e7a7fb3b115c\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") "
Sep 10 23:40:04.682092 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.682057    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-trusted-ca-bundle\") pod \"6f2a3225-117a-4885-be23-e7a7fb3b115c\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") "
Sep 10 23:40:04.682092 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.682088    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-config\") pod \"6f2a3225-117a-4885-be23-e7a7fb3b115c\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") "
Sep 10 23:40:04.682369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.682113    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-service-ca\") pod \"6f2a3225-117a-4885-be23-e7a7fb3b115c\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") "
Sep 10 23:40:04.682369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.682147    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-oauth-serving-cert\") pod \"6f2a3225-117a-4885-be23-e7a7fb3b115c\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") "
Sep 10 23:40:04.682369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.682182    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpxl7\" (UniqueName: \"kubernetes.io/projected/6f2a3225-117a-4885-be23-e7a7fb3b115c-kube-api-access-mpxl7\") pod \"6f2a3225-117a-4885-be23-e7a7fb3b115c\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") "
Sep 10 23:40:04.682369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.682215    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-oauth-config\") pod \"6f2a3225-117a-4885-be23-e7a7fb3b115c\" (UID: \"6f2a3225-117a-4885-be23-e7a7fb3b115c\") "
Sep 10 23:40:04.682584 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.682551    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6f2a3225-117a-4885-be23-e7a7fb3b115c" (UID: "6f2a3225-117a-4885-be23-e7a7fb3b115c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:40:04.682740 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.682558    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-service-ca" (OuterVolumeSpecName: "service-ca") pod "6f2a3225-117a-4885-be23-e7a7fb3b115c" (UID: "6f2a3225-117a-4885-be23-e7a7fb3b115c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:40:04.682740 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.682571    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-config" (OuterVolumeSpecName: "console-config") pod "6f2a3225-117a-4885-be23-e7a7fb3b115c" (UID: "6f2a3225-117a-4885-be23-e7a7fb3b115c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:40:04.682740 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.682603    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6f2a3225-117a-4885-be23-e7a7fb3b115c" (UID: "6f2a3225-117a-4885-be23-e7a7fb3b115c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:40:04.684740 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.684645    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6f2a3225-117a-4885-be23-e7a7fb3b115c" (UID: "6f2a3225-117a-4885-be23-e7a7fb3b115c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:40:04.684925 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.684887    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6f2a3225-117a-4885-be23-e7a7fb3b115c" (UID: "6f2a3225-117a-4885-be23-e7a7fb3b115c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:40:04.684925 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.684907    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f2a3225-117a-4885-be23-e7a7fb3b115c-kube-api-access-mpxl7" (OuterVolumeSpecName: "kube-api-access-mpxl7") pod "6f2a3225-117a-4885-be23-e7a7fb3b115c" (UID: "6f2a3225-117a-4885-be23-e7a7fb3b115c"). InnerVolumeSpecName "kube-api-access-mpxl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:40:04.783708 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.783654    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-config\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:40:04.783708 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.783700    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-service-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:40:04.783708 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.783710    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-oauth-serving-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:40:04.783708 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.783719    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpxl7\" (UniqueName: \"kubernetes.io/projected/6f2a3225-117a-4885-be23-e7a7fb3b115c-kube-api-access-mpxl7\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:40:04.783967 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.783729    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-oauth-config\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:40:04.783967 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.783737    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f2a3225-117a-4885-be23-e7a7fb3b115c-console-serving-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:40:04.783967 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:04.783745    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2a3225-117a-4885-be23-e7a7fb3b115c-trusted-ca-bundle\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:40:05.395034 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:05.395000    2581 generic.go:356] "Generic (PLEG): container finished" podID="6f2a3225-117a-4885-be23-e7a7fb3b115c" containerID="6ab283d223f456901f19c1b864ab17d4d3fbf416b2afea3cd3334402567e72b5" exitCode=0
Sep 10 23:40:05.395438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:05.395056    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5955fbbf-wk9k7"
Sep 10 23:40:05.395438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:05.395079    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5955fbbf-wk9k7" event={"ID":"6f2a3225-117a-4885-be23-e7a7fb3b115c","Type":"ContainerDied","Data":"6ab283d223f456901f19c1b864ab17d4d3fbf416b2afea3cd3334402567e72b5"}
Sep 10 23:40:05.395438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:05.395153    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5955fbbf-wk9k7" event={"ID":"6f2a3225-117a-4885-be23-e7a7fb3b115c","Type":"ContainerDied","Data":"10bfca24d812b33ff09119f27b2c6cc6423835b19b1b98d0ccc5a7041caf36b3"}
Sep 10 23:40:05.395438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:05.395173    2581 scope.go:117] "RemoveContainer" containerID="6ab283d223f456901f19c1b864ab17d4d3fbf416b2afea3cd3334402567e72b5"
Sep 10 23:40:05.403896 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:05.403878    2581 scope.go:117] "RemoveContainer" containerID="6ab283d223f456901f19c1b864ab17d4d3fbf416b2afea3cd3334402567e72b5"
Sep 10 23:40:05.404175 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:40:05.404156    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ab283d223f456901f19c1b864ab17d4d3fbf416b2afea3cd3334402567e72b5\": container with ID starting with 6ab283d223f456901f19c1b864ab17d4d3fbf416b2afea3cd3334402567e72b5 not found: ID does not exist" containerID="6ab283d223f456901f19c1b864ab17d4d3fbf416b2afea3cd3334402567e72b5"
Sep 10 23:40:05.404233 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:05.404183    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ab283d223f456901f19c1b864ab17d4d3fbf416b2afea3cd3334402567e72b5"} err="failed to get container status \"6ab283d223f456901f19c1b864ab17d4d3fbf416b2afea3cd3334402567e72b5\": rpc error: code = NotFound desc = could not find container \"6ab283d223f456901f19c1b864ab17d4d3fbf416b2afea3cd3334402567e72b5\": container with ID starting with 6ab283d223f456901f19c1b864ab17d4d3fbf416b2afea3cd3334402567e72b5 not found: ID does not exist"
Sep 10 23:40:05.415643 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:05.415624    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b5955fbbf-wk9k7"]
Sep 10 23:40:05.417459 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:05.417431    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b5955fbbf-wk9k7"]
Sep 10 23:40:06.482058 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:06.482025    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f2a3225-117a-4885-be23-e7a7fb3b115c" path="/var/lib/kubelet/pods/6f2a3225-117a-4885-be23-e7a7fb3b115c/volumes"
Sep 10 23:40:19.819689 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:19.819625    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:22.373705 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:22.373654    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:22.474041 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:22.474006    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:41.881152 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:41.881112    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:41.979979 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:41.979937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:40:42.481625 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.481600    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476"]
Sep 10 23:40:42.481904 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.481890    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f2a3225-117a-4885-be23-e7a7fb3b115c" containerName="console"
Sep 10 23:40:42.481948 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.481908    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f2a3225-117a-4885-be23-e7a7fb3b115c" containerName="console"
Sep 10 23:40:42.481981 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.481959    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f2a3225-117a-4885-be23-e7a7fb3b115c" containerName="console"
Sep 10 23:40:42.485947 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.485930    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476"
Sep 10 23:40:42.488854 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.488833    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-49xzp\""
Sep 10 23:40:42.488971 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.488924    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:40:42.489059 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.489012    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:40:42.489715 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.489692    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476"]
Sep 10 23:40:42.547081 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.547042    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wrqp\" (UniqueName: \"kubernetes.io/projected/9b89feca-4f82-4826-b507-d142982d0148-kube-api-access-5wrqp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476\" (UID: \"9b89feca-4f82-4826-b507-d142982d0148\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476"
Sep 10 23:40:42.547260 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.547097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b89feca-4f82-4826-b507-d142982d0148-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476\" (UID: \"9b89feca-4f82-4826-b507-d142982d0148\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476"
Sep 10 23:40:42.547260 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.547185    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b89feca-4f82-4826-b507-d142982d0148-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476\" (UID: \"9b89feca-4f82-4826-b507-d142982d0148\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476"
Sep 10 23:40:42.647689 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.647613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b89feca-4f82-4826-b507-d142982d0148-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476\" (UID: \"9b89feca-4f82-4826-b507-d142982d0148\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476"
Sep 10 23:40:42.647873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.647725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b89feca-4f82-4826-b507-d142982d0148-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476\" (UID: \"9b89feca-4f82-4826-b507-d142982d0148\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476"
Sep 10 23:40:42.647873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.647767    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wrqp\" (UniqueName: \"kubernetes.io/projected/9b89feca-4f82-4826-b507-d142982d0148-kube-api-access-5wrqp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476\" (UID: \"9b89feca-4f82-4826-b507-d142982d0148\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476"
Sep 10 23:40:42.648032 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.648009    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b89feca-4f82-4826-b507-d142982d0148-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476\" (UID: \"9b89feca-4f82-4826-b507-d142982d0148\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476"
Sep 10 23:40:42.648094 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.648041    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b89feca-4f82-4826-b507-d142982d0148-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476\" (UID: \"9b89feca-4f82-4826-b507-d142982d0148\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476"
Sep 10 23:40:42.655972 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.655939    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wrqp\" (UniqueName: \"kubernetes.io/projected/9b89feca-4f82-4826-b507-d142982d0148-kube-api-access-5wrqp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476\" (UID: \"9b89feca-4f82-4826-b507-d142982d0148\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476"
Sep 10 23:40:42.796421 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:42.796339    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476"
Sep 10 23:40:43.064840 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:43.064764    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476"]
Sep 10 23:40:43.068814 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:40:43.068780    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b89feca_4f82_4826_b507_d142982d0148.slice/crio-3bb2c4a6f774602711a0dc5741f7af35114f9143ce62b85f3b0b183221d3220d WatchSource:0}: Error finding container 3bb2c4a6f774602711a0dc5741f7af35114f9143ce62b85f3b0b183221d3220d: Status 404 returned error can't find the container with id 3bb2c4a6f774602711a0dc5741f7af35114f9143ce62b85f3b0b183221d3220d
Sep 10 23:40:43.525716 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:43.525680    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476" event={"ID":"9b89feca-4f82-4826-b507-d142982d0148","Type":"ContainerStarted","Data":"3bb2c4a6f774602711a0dc5741f7af35114f9143ce62b85f3b0b183221d3220d"}
Sep 10 23:40:50.554290 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:50.554257    2581 generic.go:356] "Generic (PLEG): container finished" podID="9b89feca-4f82-4826-b507-d142982d0148" containerID="49fa6cb64cd7e0e35cfa03db7c93f4e80254d4705a49f4b684c8a410fd61f914" exitCode=0
Sep 10 23:40:50.554813 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:50.554332    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476" event={"ID":"9b89feca-4f82-4826-b507-d142982d0148","Type":"ContainerDied","Data":"49fa6cb64cd7e0e35cfa03db7c93f4e80254d4705a49f4b684c8a410fd61f914"}
Sep 10 23:40:52.563945 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:52.563909    2581 generic.go:356] "Generic (PLEG): container finished" podID="9b89feca-4f82-4826-b507-d142982d0148" containerID="107c2fb959bbbb6127f915dc4661c660d15a7234f0318f04ce84fb12d06807c4" exitCode=0
Sep 10 23:40:52.564305 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:52.563964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476" event={"ID":"9b89feca-4f82-4826-b507-d142982d0148","Type":"ContainerDied","Data":"107c2fb959bbbb6127f915dc4661c660d15a7234f0318f04ce84fb12d06807c4"}
Sep 10 23:40:59.592530 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:59.592495    2581 generic.go:356] "Generic (PLEG): container finished" podID="9b89feca-4f82-4826-b507-d142982d0148" containerID="55e6e3a5675d30e3f0f218d6e5aef9cd7fc1eed0ddc83a4f68e87530276bfae2" exitCode=0
Sep 10 23:40:59.592917 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:40:59.592579    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476" event={"ID":"9b89feca-4f82-4826-b507-d142982d0148","Type":"ContainerDied","Data":"55e6e3a5675d30e3f0f218d6e5aef9cd7fc1eed0ddc83a4f68e87530276bfae2"}
Sep 10 23:41:00.717970 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:00.717945    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476"
Sep 10 23:41:00.798369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:00.798338    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b89feca-4f82-4826-b507-d142982d0148-bundle\") pod \"9b89feca-4f82-4826-b507-d142982d0148\" (UID: \"9b89feca-4f82-4826-b507-d142982d0148\") "
Sep 10 23:41:00.798546 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:00.798392    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wrqp\" (UniqueName: \"kubernetes.io/projected/9b89feca-4f82-4826-b507-d142982d0148-kube-api-access-5wrqp\") pod \"9b89feca-4f82-4826-b507-d142982d0148\" (UID: \"9b89feca-4f82-4826-b507-d142982d0148\") "
Sep 10 23:41:00.798546 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:00.798462    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b89feca-4f82-4826-b507-d142982d0148-util\") pod \"9b89feca-4f82-4826-b507-d142982d0148\" (UID: \"9b89feca-4f82-4826-b507-d142982d0148\") "
Sep 10 23:41:00.799132 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:00.799042    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b89feca-4f82-4826-b507-d142982d0148-bundle" (OuterVolumeSpecName: "bundle") pod "9b89feca-4f82-4826-b507-d142982d0148" (UID: "9b89feca-4f82-4826-b507-d142982d0148"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:41:00.800805 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:00.800781    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b89feca-4f82-4826-b507-d142982d0148-kube-api-access-5wrqp" (OuterVolumeSpecName: "kube-api-access-5wrqp") pod "9b89feca-4f82-4826-b507-d142982d0148" (UID: "9b89feca-4f82-4826-b507-d142982d0148"). InnerVolumeSpecName "kube-api-access-5wrqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:41:00.802562 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:00.802542    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b89feca-4f82-4826-b507-d142982d0148-util" (OuterVolumeSpecName: "util") pod "9b89feca-4f82-4826-b507-d142982d0148" (UID: "9b89feca-4f82-4826-b507-d142982d0148"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:41:00.899233 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:00.899154    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b89feca-4f82-4826-b507-d142982d0148-bundle\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:41:00.899233 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:00.899180    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wrqp\" (UniqueName: \"kubernetes.io/projected/9b89feca-4f82-4826-b507-d142982d0148-kube-api-access-5wrqp\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:41:00.899233 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:00.899191    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b89feca-4f82-4826-b507-d142982d0148-util\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:41:01.601177 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:01.601094    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476" event={"ID":"9b89feca-4f82-4826-b507-d142982d0148","Type":"ContainerDied","Data":"3bb2c4a6f774602711a0dc5741f7af35114f9143ce62b85f3b0b183221d3220d"}
Sep 10 23:41:01.601177 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:01.601136    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3bb2c4a6f774602711a0dc5741f7af35114f9143ce62b85f3b0b183221d3220d"
Sep 10 23:41:01.601177 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:01.601146    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tp476"
Sep 10 23:41:03.485365 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:03.485327    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:04.288723 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:04.288686    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:07.090190 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:07.090152    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:07.203705 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:07.202523    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:09.467468 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.467435    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:09.566418 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.566385    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:09.857032 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.856950    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh"]
Sep 10 23:41:09.857225 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.857212    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b89feca-4f82-4826-b507-d142982d0148" containerName="extract"
Sep 10 23:41:09.857273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.857227    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b89feca-4f82-4826-b507-d142982d0148" containerName="extract"
Sep 10 23:41:09.857273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.857235    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b89feca-4f82-4826-b507-d142982d0148" containerName="util"
Sep 10 23:41:09.857273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.857240    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b89feca-4f82-4826-b507-d142982d0148" containerName="util"
Sep 10 23:41:09.857273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.857247    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b89feca-4f82-4826-b507-d142982d0148" containerName="pull"
Sep 10 23:41:09.857273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.857253    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b89feca-4f82-4826-b507-d142982d0148" containerName="pull"
Sep 10 23:41:09.857451 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.857300    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b89feca-4f82-4826-b507-d142982d0148" containerName="extract"
Sep 10 23:41:09.861422 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.861393    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh"
Sep 10 23:41:09.864052 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.864030    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-49xzp\""
Sep 10 23:41:09.864184 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.864170    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:41:09.865087 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.865069    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:41:09.875104 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.875084    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh"]
Sep 10 23:41:09.962258 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.962215    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz2zb\" (UniqueName: \"kubernetes.io/projected/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-kube-api-access-sz2zb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh\" (UID: \"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh"
Sep 10 23:41:09.962433 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.962275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh\" (UID: \"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh"
Sep 10 23:41:09.962433 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:09.962350    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh\" (UID: \"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh"
Sep 10 23:41:10.063683 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:10.063634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh\" (UID: \"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh"
Sep 10 23:41:10.063816 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:10.063697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh\" (UID: \"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh"
Sep 10 23:41:10.063816 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:10.063733    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz2zb\" (UniqueName: \"kubernetes.io/projected/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-kube-api-access-sz2zb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh\" (UID: \"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh"
Sep 10 23:41:10.064101 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:10.064076    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh\" (UID: \"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh"
Sep 10 23:41:10.064133 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:10.064086    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh\" (UID: \"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh"
Sep 10 23:41:10.072308 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:10.072276    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz2zb\" (UniqueName: \"kubernetes.io/projected/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-kube-api-access-sz2zb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh\" (UID: \"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh"
Sep 10 23:41:10.170494 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:10.170408    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh"
Sep 10 23:41:10.444548 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:10.444525    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh"]
Sep 10 23:41:10.446715 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:41:10.446690    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90cbdaba_dc0b_4cb9_bdb6_04850a5d3499.slice/crio-6857b2bc8c74d612fc4ee9ff7923fd213c37ee4641e7802f3296c1b6edfe1eeb WatchSource:0}: Error finding container 6857b2bc8c74d612fc4ee9ff7923fd213c37ee4641e7802f3296c1b6edfe1eeb: Status 404 returned error can't find the container with id 6857b2bc8c74d612fc4ee9ff7923fd213c37ee4641e7802f3296c1b6edfe1eeb
Sep 10 23:41:10.633761 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:10.633727    2581 generic.go:356] "Generic (PLEG): container finished" podID="90cbdaba-dc0b-4cb9-bdb6-04850a5d3499" containerID="44d955f9193e5a6c1329b915facb3eba2794bfd4c787f0f36e884bdfd435460c" exitCode=0
Sep 10 23:41:10.634181 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:10.633821    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh" event={"ID":"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499","Type":"ContainerDied","Data":"44d955f9193e5a6c1329b915facb3eba2794bfd4c787f0f36e884bdfd435460c"}
Sep 10 23:41:10.634181 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:10.633873    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh" event={"ID":"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499","Type":"ContainerStarted","Data":"6857b2bc8c74d612fc4ee9ff7923fd213c37ee4641e7802f3296c1b6edfe1eeb"}
Sep 10 23:41:11.849092 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:11.849041    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:12.069656 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.069624    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:12.108337 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.108257    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-djd5v"]
Sep 10 23:41:12.114269 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.114242    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-djd5v"
Sep 10 23:41:12.116632 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.116594    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 23:41:12.117647 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.117625    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6r5bl\""
Sep 10 23:41:12.117785 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.117628    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 23:41:12.120161 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.120131    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-djd5v"]
Sep 10 23:41:12.283288 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.283257    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b487fc68-1068-488a-b1b0-72a45be0b1da-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-djd5v\" (UID: \"b487fc68-1068-488a-b1b0-72a45be0b1da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-djd5v"
Sep 10 23:41:12.283288 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.283300    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfhvk\" (UniqueName: \"kubernetes.io/projected/b487fc68-1068-488a-b1b0-72a45be0b1da-kube-api-access-nfhvk\") pod \"cert-manager-cainjector-559cdd8c87-djd5v\" (UID: \"b487fc68-1068-488a-b1b0-72a45be0b1da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-djd5v"
Sep 10 23:41:12.384140 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.384060    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b487fc68-1068-488a-b1b0-72a45be0b1da-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-djd5v\" (UID: \"b487fc68-1068-488a-b1b0-72a45be0b1da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-djd5v"
Sep 10 23:41:12.384140 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.384098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfhvk\" (UniqueName: \"kubernetes.io/projected/b487fc68-1068-488a-b1b0-72a45be0b1da-kube-api-access-nfhvk\") pod \"cert-manager-cainjector-559cdd8c87-djd5v\" (UID: \"b487fc68-1068-488a-b1b0-72a45be0b1da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-djd5v"
Sep 10 23:41:12.395988 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.393427    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfhvk\" (UniqueName: \"kubernetes.io/projected/b487fc68-1068-488a-b1b0-72a45be0b1da-kube-api-access-nfhvk\") pod \"cert-manager-cainjector-559cdd8c87-djd5v\" (UID: \"b487fc68-1068-488a-b1b0-72a45be0b1da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-djd5v"
Sep 10 23:41:12.397543 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.397515    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b487fc68-1068-488a-b1b0-72a45be0b1da-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-djd5v\" (UID: \"b487fc68-1068-488a-b1b0-72a45be0b1da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-djd5v"
Sep 10 23:41:12.436554 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.436523    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-djd5v"
Sep 10 23:41:12.647467 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.647378    2581 generic.go:356] "Generic (PLEG): container finished" podID="90cbdaba-dc0b-4cb9-bdb6-04850a5d3499" containerID="4f02b5305a1637ef3d4156c5cf2596654681b8ce39f7241718e811ab8307f602" exitCode=0
Sep 10 23:41:12.647611 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.647459    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh" event={"ID":"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499","Type":"ContainerDied","Data":"4f02b5305a1637ef3d4156c5cf2596654681b8ce39f7241718e811ab8307f602"}
Sep 10 23:41:12.707342 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:12.707243    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-djd5v"]
Sep 10 23:41:12.710077 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:41:12.710042    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb487fc68_1068_488a_b1b0_72a45be0b1da.slice/crio-6332eb9f19dc682550324482f2c63c6edf91a59ac47548e1026434b3f994f8af WatchSource:0}: Error finding container 6332eb9f19dc682550324482f2c63c6edf91a59ac47548e1026434b3f994f8af: Status 404 returned error can't find the container with id 6332eb9f19dc682550324482f2c63c6edf91a59ac47548e1026434b3f994f8af
Sep 10 23:41:13.654404 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:13.654351    2581 generic.go:356] "Generic (PLEG): container finished" podID="90cbdaba-dc0b-4cb9-bdb6-04850a5d3499" containerID="b0726cce3de3f2d688ad0161dbcc02fdc8b78199c1fc061fb0c16a6a3402b892" exitCode=0
Sep 10 23:41:13.654900 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:13.654449    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh" event={"ID":"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499","Type":"ContainerDied","Data":"b0726cce3de3f2d688ad0161dbcc02fdc8b78199c1fc061fb0c16a6a3402b892"}
Sep 10 23:41:13.655940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:13.655900    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-djd5v" event={"ID":"b487fc68-1068-488a-b1b0-72a45be0b1da","Type":"ContainerStarted","Data":"6332eb9f19dc682550324482f2c63c6edf91a59ac47548e1026434b3f994f8af"}
Sep 10 23:41:13.692100 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:13.692065    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:13.748268 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:13.748229    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:15.343006 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:15.342984    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh"
Sep 10 23:41:15.508712 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:15.508678    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-util\") pod \"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499\" (UID: \"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499\") "
Sep 10 23:41:15.508873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:15.508754    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz2zb\" (UniqueName: \"kubernetes.io/projected/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-kube-api-access-sz2zb\") pod \"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499\" (UID: \"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499\") "
Sep 10 23:41:15.508873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:15.508848    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-bundle\") pod \"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499\" (UID: \"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499\") "
Sep 10 23:41:15.509203 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:15.509165    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-bundle" (OuterVolumeSpecName: "bundle") pod "90cbdaba-dc0b-4cb9-bdb6-04850a5d3499" (UID: "90cbdaba-dc0b-4cb9-bdb6-04850a5d3499"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:41:15.511179 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:15.511150    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-kube-api-access-sz2zb" (OuterVolumeSpecName: "kube-api-access-sz2zb") pod "90cbdaba-dc0b-4cb9-bdb6-04850a5d3499" (UID: "90cbdaba-dc0b-4cb9-bdb6-04850a5d3499"). InnerVolumeSpecName "kube-api-access-sz2zb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:41:15.514083 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:15.514058    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-util" (OuterVolumeSpecName: "util") pod "90cbdaba-dc0b-4cb9-bdb6-04850a5d3499" (UID: "90cbdaba-dc0b-4cb9-bdb6-04850a5d3499"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:41:15.609997 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:15.609914    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-bundle\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:41:15.609997 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:15.609944    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-util\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:41:15.609997 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:15.609955    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz2zb\" (UniqueName: \"kubernetes.io/projected/90cbdaba-dc0b-4cb9-bdb6-04850a5d3499-kube-api-access-sz2zb\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:41:15.669160 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:15.669126    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh"
Sep 10 23:41:15.669160 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:15.669134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqq8hh" event={"ID":"90cbdaba-dc0b-4cb9-bdb6-04850a5d3499","Type":"ContainerDied","Data":"6857b2bc8c74d612fc4ee9ff7923fd213c37ee4641e7802f3296c1b6edfe1eeb"}
Sep 10 23:41:15.669365 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:15.669179    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6857b2bc8c74d612fc4ee9ff7923fd213c37ee4641e7802f3296c1b6edfe1eeb"
Sep 10 23:41:15.670870 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:15.670840    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-djd5v" event={"ID":"b487fc68-1068-488a-b1b0-72a45be0b1da","Type":"ContainerStarted","Data":"934163c78e19c203ea62c11086424fdbecb955ffb87b71366a832a7289f29a03"}
Sep 10 23:41:15.685522 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:15.685476    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-djd5v" podStartSLOduration=1.0361215559999999 podStartE2EDuration="3.685463372s" totalImagesPullingTime="2.649341816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:41:15.684811742 +0000 UTC m=+275.725681049" watchObservedRunningTime="2026-09-10 23:41:15.685463372 +0000 UTC m=+275.726332677"
Sep 10 23:41:19.063141 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:19.063107    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:20.704171 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.704134    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f8rk2"]
Sep 10 23:41:20.704705 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.704506    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90cbdaba-dc0b-4cb9-bdb6-04850a5d3499" containerName="pull"
Sep 10 23:41:20.704705 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.704523    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="90cbdaba-dc0b-4cb9-bdb6-04850a5d3499" containerName="pull"
Sep 10 23:41:20.704705 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.704534    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90cbdaba-dc0b-4cb9-bdb6-04850a5d3499" containerName="extract"
Sep 10 23:41:20.704705 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.704541    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="90cbdaba-dc0b-4cb9-bdb6-04850a5d3499" containerName="extract"
Sep 10 23:41:20.704705 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.704551    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90cbdaba-dc0b-4cb9-bdb6-04850a5d3499" containerName="util"
Sep 10 23:41:20.704705 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.704559    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="90cbdaba-dc0b-4cb9-bdb6-04850a5d3499" containerName="util"
Sep 10 23:41:20.704705 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.704639    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="90cbdaba-dc0b-4cb9-bdb6-04850a5d3499" containerName="extract"
Sep 10 23:41:20.706590 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.706571    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-f8rk2"
Sep 10 23:41:20.708783 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.708769    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hddsh\""
Sep 10 23:41:20.715261 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.715228    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f8rk2"]
Sep 10 23:41:20.752754 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.752723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/685031a3-0fe3-4ff9-8213-7d09c13cabf7-bound-sa-token\") pod \"cert-manager-55b4d954d5-f8rk2\" (UID: \"685031a3-0fe3-4ff9-8213-7d09c13cabf7\") " pod="cert-manager/cert-manager-55b4d954d5-f8rk2"
Sep 10 23:41:20.752754 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.752756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlbng\" (UniqueName: \"kubernetes.io/projected/685031a3-0fe3-4ff9-8213-7d09c13cabf7-kube-api-access-wlbng\") pod \"cert-manager-55b4d954d5-f8rk2\" (UID: \"685031a3-0fe3-4ff9-8213-7d09c13cabf7\") " pod="cert-manager/cert-manager-55b4d954d5-f8rk2"
Sep 10 23:41:20.853138 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.853097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/685031a3-0fe3-4ff9-8213-7d09c13cabf7-bound-sa-token\") pod \"cert-manager-55b4d954d5-f8rk2\" (UID: \"685031a3-0fe3-4ff9-8213-7d09c13cabf7\") " pod="cert-manager/cert-manager-55b4d954d5-f8rk2"
Sep 10 23:41:20.853138 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.853141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlbng\" (UniqueName: \"kubernetes.io/projected/685031a3-0fe3-4ff9-8213-7d09c13cabf7-kube-api-access-wlbng\") pod \"cert-manager-55b4d954d5-f8rk2\" (UID: \"685031a3-0fe3-4ff9-8213-7d09c13cabf7\") " pod="cert-manager/cert-manager-55b4d954d5-f8rk2"
Sep 10 23:41:20.861272 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.861239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/685031a3-0fe3-4ff9-8213-7d09c13cabf7-bound-sa-token\") pod \"cert-manager-55b4d954d5-f8rk2\" (UID: \"685031a3-0fe3-4ff9-8213-7d09c13cabf7\") " pod="cert-manager/cert-manager-55b4d954d5-f8rk2"
Sep 10 23:41:20.861465 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:20.861442    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlbng\" (UniqueName: \"kubernetes.io/projected/685031a3-0fe3-4ff9-8213-7d09c13cabf7-kube-api-access-wlbng\") pod \"cert-manager-55b4d954d5-f8rk2\" (UID: \"685031a3-0fe3-4ff9-8213-7d09c13cabf7\") " pod="cert-manager/cert-manager-55b4d954d5-f8rk2"
Sep 10 23:41:21.015236 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:21.015156    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-f8rk2"
Sep 10 23:41:21.285371 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:21.285295    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f8rk2"]
Sep 10 23:41:21.288330 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:41:21.288309    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod685031a3_0fe3_4ff9_8213_7d09c13cabf7.slice/crio-5d5b070fcb1122cde74f63f7d593910d567f25d9426ec07977b412f5f9f51804 WatchSource:0}: Error finding container 5d5b070fcb1122cde74f63f7d593910d567f25d9426ec07977b412f5f9f51804: Status 404 returned error can't find the container with id 5d5b070fcb1122cde74f63f7d593910d567f25d9426ec07977b412f5f9f51804
Sep 10 23:41:21.696192 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:21.696104    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-f8rk2" event={"ID":"685031a3-0fe3-4ff9-8213-7d09c13cabf7","Type":"ContainerStarted","Data":"43e3c8a3ddcf812582678bb1575cbb62ec999ebfb0e37bd15e9ef6f42f950b75"}
Sep 10 23:41:21.696192 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:21.696140    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-f8rk2" event={"ID":"685031a3-0fe3-4ff9-8213-7d09c13cabf7","Type":"ContainerStarted","Data":"5d5b070fcb1122cde74f63f7d593910d567f25d9426ec07977b412f5f9f51804"}
Sep 10 23:41:21.712440 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:21.712388    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-f8rk2" podStartSLOduration=1.712372939 podStartE2EDuration="1.712372939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:41:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:41:21.71056397 +0000 UTC m=+281.751433275" watchObservedRunningTime="2026-09-10 23:41:21.712372939 +0000 UTC m=+281.753242241"
Sep 10 23:41:24.093926 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:24.093890    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:24.193962 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:24.193929    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:26.367483 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:26.367453    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68kzg"]
Sep 10 23:41:26.369607 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:26.369586    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68kzg"
Sep 10 23:41:26.371886 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:26.371865    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:41:26.372009 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:26.371874    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-6tqgb\""
Sep 10 23:41:26.372831 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:26.372814    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 23:41:26.378504 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:26.378475    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68kzg"]
Sep 10 23:41:26.393353 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:26.393333    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5b1f2d3-6d23-42e3-908a-00e30cad0e4c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-68kzg\" (UID: \"f5b1f2d3-6d23-42e3-908a-00e30cad0e4c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68kzg"
Sep 10 23:41:26.393449 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:26.393373    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkc57\" (UniqueName: \"kubernetes.io/projected/f5b1f2d3-6d23-42e3-908a-00e30cad0e4c-kube-api-access-wkc57\") pod \"openshift-lws-operator-fd8ccff4c-68kzg\" (UID: \"f5b1f2d3-6d23-42e3-908a-00e30cad0e4c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68kzg"
Sep 10 23:41:26.493810 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:26.493782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkc57\" (UniqueName: \"kubernetes.io/projected/f5b1f2d3-6d23-42e3-908a-00e30cad0e4c-kube-api-access-wkc57\") pod \"openshift-lws-operator-fd8ccff4c-68kzg\" (UID: \"f5b1f2d3-6d23-42e3-908a-00e30cad0e4c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68kzg"
Sep 10 23:41:26.493997 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:26.493867    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5b1f2d3-6d23-42e3-908a-00e30cad0e4c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-68kzg\" (UID: \"f5b1f2d3-6d23-42e3-908a-00e30cad0e4c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68kzg"
Sep 10 23:41:26.494218 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:26.494199    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5b1f2d3-6d23-42e3-908a-00e30cad0e4c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-68kzg\" (UID: \"f5b1f2d3-6d23-42e3-908a-00e30cad0e4c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68kzg"
Sep 10 23:41:26.502064 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:26.502044    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkc57\" (UniqueName: \"kubernetes.io/projected/f5b1f2d3-6d23-42e3-908a-00e30cad0e4c-kube-api-access-wkc57\") pod \"openshift-lws-operator-fd8ccff4c-68kzg\" (UID: \"f5b1f2d3-6d23-42e3-908a-00e30cad0e4c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68kzg"
Sep 10 23:41:26.679227 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:26.679128    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68kzg"
Sep 10 23:41:26.947369 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:26.947278    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68kzg"]
Sep 10 23:41:26.950625 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:41:26.950591    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5b1f2d3_6d23_42e3_908a_00e30cad0e4c.slice/crio-a10e7a68604edd4320c03fde85e2cc08115baca0638523a7f3d5eb9452b2ec60 WatchSource:0}: Error finding container a10e7a68604edd4320c03fde85e2cc08115baca0638523a7f3d5eb9452b2ec60: Status 404 returned error can't find the container with id a10e7a68604edd4320c03fde85e2cc08115baca0638523a7f3d5eb9452b2ec60
Sep 10 23:41:27.722614 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:27.722572    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68kzg" event={"ID":"f5b1f2d3-6d23-42e3-908a-00e30cad0e4c","Type":"ContainerStarted","Data":"a10e7a68604edd4320c03fde85e2cc08115baca0638523a7f3d5eb9452b2ec60"}
Sep 10 23:41:28.728442 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:28.728412    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68kzg" event={"ID":"f5b1f2d3-6d23-42e3-908a-00e30cad0e4c","Type":"ContainerStarted","Data":"c4a32640066df82a0850c5bac8665afd3599771895fcdf1496a480a2b3080118"}
Sep 10 23:41:28.743438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:28.743387    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68kzg" podStartSLOduration=1.253953745 podStartE2EDuration="2.74337136s" totalImagesPullingTime="1.489417615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:41:28.742720241 +0000 UTC m=+288.783589545" watchObservedRunningTime="2026-09-10 23:41:28.74337136 +0000 UTC m=+288.784240665"
Sep 10 23:41:29.439175 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:29.439135    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:29.540541 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:29.540485    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:31.832339 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:31.832303    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:33.208949 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:33.208909    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:33.275722 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:33.275655    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:33.618084 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:33.618007    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:33.902548 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:33.902465    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv"]
Sep 10 23:41:33.904827 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:33.904812    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv"
Sep 10 23:41:33.907274 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:33.907252    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:41:33.907430 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:33.907411    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:41:33.908331 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:33.908312    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-49xzp\""
Sep 10 23:41:33.914770 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:33.914749    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv"]
Sep 10 23:41:33.946737 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:33.946714    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dcbc9963-e025-456e-b917-ca9529bbba44-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv\" (UID: \"dcbc9963-e025-456e-b917-ca9529bbba44\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv"
Sep 10 23:41:33.946876 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:33.946755    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dcbc9963-e025-456e-b917-ca9529bbba44-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv\" (UID: \"dcbc9963-e025-456e-b917-ca9529bbba44\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv"
Sep 10 23:41:33.946876 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:33.946785    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkgjz\" (UniqueName: \"kubernetes.io/projected/dcbc9963-e025-456e-b917-ca9529bbba44-kube-api-access-vkgjz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv\" (UID: \"dcbc9963-e025-456e-b917-ca9529bbba44\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv"
Sep 10 23:41:34.047960 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:34.047929    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkgjz\" (UniqueName: \"kubernetes.io/projected/dcbc9963-e025-456e-b917-ca9529bbba44-kube-api-access-vkgjz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv\" (UID: \"dcbc9963-e025-456e-b917-ca9529bbba44\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv"
Sep 10 23:41:34.048078 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:34.047984    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dcbc9963-e025-456e-b917-ca9529bbba44-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv\" (UID: \"dcbc9963-e025-456e-b917-ca9529bbba44\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv"
Sep 10 23:41:34.048078 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:34.048023    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dcbc9963-e025-456e-b917-ca9529bbba44-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv\" (UID: \"dcbc9963-e025-456e-b917-ca9529bbba44\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv"
Sep 10 23:41:34.048432 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:34.048412    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dcbc9963-e025-456e-b917-ca9529bbba44-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv\" (UID: \"dcbc9963-e025-456e-b917-ca9529bbba44\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv"
Sep 10 23:41:34.048471 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:34.048425    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dcbc9963-e025-456e-b917-ca9529bbba44-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv\" (UID: \"dcbc9963-e025-456e-b917-ca9529bbba44\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv"
Sep 10 23:41:34.058800 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:34.058772    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkgjz\" (UniqueName: \"kubernetes.io/projected/dcbc9963-e025-456e-b917-ca9529bbba44-kube-api-access-vkgjz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv\" (UID: \"dcbc9963-e025-456e-b917-ca9529bbba44\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv"
Sep 10 23:41:34.214035 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:34.214010    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv"
Sep 10 23:41:34.483547 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:34.483348    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv"]
Sep 10 23:41:34.486202 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:41:34.486174    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcbc9963_e025_456e_b917_ca9529bbba44.slice/crio-2de924f3d87a0dfdfde8ec1d338425940a3c51d0ef198f09a7fbb70d61c696e1 WatchSource:0}: Error finding container 2de924f3d87a0dfdfde8ec1d338425940a3c51d0ef198f09a7fbb70d61c696e1: Status 404 returned error can't find the container with id 2de924f3d87a0dfdfde8ec1d338425940a3c51d0ef198f09a7fbb70d61c696e1
Sep 10 23:41:34.757292 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:34.757207    2581 generic.go:356] "Generic (PLEG): container finished" podID="dcbc9963-e025-456e-b917-ca9529bbba44" containerID="6b4a66c6dcd2740da21849993cb4d309ae1cf4641e82fef65cbadfcf36b6f528" exitCode=0
Sep 10 23:41:34.757292 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:34.757250    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv" event={"ID":"dcbc9963-e025-456e-b917-ca9529bbba44","Type":"ContainerDied","Data":"6b4a66c6dcd2740da21849993cb4d309ae1cf4641e82fef65cbadfcf36b6f528"}
Sep 10 23:41:34.757474 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:34.757329    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv" event={"ID":"dcbc9963-e025-456e-b917-ca9529bbba44","Type":"ContainerStarted","Data":"2de924f3d87a0dfdfde8ec1d338425940a3c51d0ef198f09a7fbb70d61c696e1"}
Sep 10 23:41:35.762957 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:35.762923    2581 generic.go:356] "Generic (PLEG): container finished" podID="dcbc9963-e025-456e-b917-ca9529bbba44" containerID="c5b9d0a06aaf7a6b7620c3cd036699c6641fc3f512e91a86ad5c2945647b812c" exitCode=0
Sep 10 23:41:35.763304 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:35.762994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv" event={"ID":"dcbc9963-e025-456e-b917-ca9529bbba44","Type":"ContainerDied","Data":"c5b9d0a06aaf7a6b7620c3cd036699c6641fc3f512e91a86ad5c2945647b812c"}
Sep 10 23:41:36.769128 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:36.769097    2581 generic.go:356] "Generic (PLEG): container finished" podID="dcbc9963-e025-456e-b917-ca9529bbba44" containerID="82a1a733643ecaf377890672e1548cc53357dc6ced2ba91fc240aa7218fc0fcc" exitCode=0
Sep 10 23:41:36.769508 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:36.769170    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv" event={"ID":"dcbc9963-e025-456e-b917-ca9529bbba44","Type":"ContainerDied","Data":"82a1a733643ecaf377890672e1548cc53357dc6ced2ba91fc240aa7218fc0fcc"}
Sep 10 23:41:37.898071 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:37.898041    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv"
Sep 10 23:41:37.980664 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:37.980631    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dcbc9963-e025-456e-b917-ca9529bbba44-util\") pod \"dcbc9963-e025-456e-b917-ca9529bbba44\" (UID: \"dcbc9963-e025-456e-b917-ca9529bbba44\") "
Sep 10 23:41:37.980842 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:37.980717    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dcbc9963-e025-456e-b917-ca9529bbba44-bundle\") pod \"dcbc9963-e025-456e-b917-ca9529bbba44\" (UID: \"dcbc9963-e025-456e-b917-ca9529bbba44\") "
Sep 10 23:41:37.980842 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:37.980743    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkgjz\" (UniqueName: \"kubernetes.io/projected/dcbc9963-e025-456e-b917-ca9529bbba44-kube-api-access-vkgjz\") pod \"dcbc9963-e025-456e-b917-ca9529bbba44\" (UID: \"dcbc9963-e025-456e-b917-ca9529bbba44\") "
Sep 10 23:41:37.981392 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:37.981364    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcbc9963-e025-456e-b917-ca9529bbba44-bundle" (OuterVolumeSpecName: "bundle") pod "dcbc9963-e025-456e-b917-ca9529bbba44" (UID: "dcbc9963-e025-456e-b917-ca9529bbba44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:41:37.982920 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:37.982888    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcbc9963-e025-456e-b917-ca9529bbba44-kube-api-access-vkgjz" (OuterVolumeSpecName: "kube-api-access-vkgjz") pod "dcbc9963-e025-456e-b917-ca9529bbba44" (UID: "dcbc9963-e025-456e-b917-ca9529bbba44"). InnerVolumeSpecName "kube-api-access-vkgjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:41:37.986624 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:37.986606    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcbc9963-e025-456e-b917-ca9529bbba44-util" (OuterVolumeSpecName: "util") pod "dcbc9963-e025-456e-b917-ca9529bbba44" (UID: "dcbc9963-e025-456e-b917-ca9529bbba44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:41:38.081506 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:38.081430    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dcbc9963-e025-456e-b917-ca9529bbba44-util\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:41:38.081506 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:38.081456    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dcbc9963-e025-456e-b917-ca9529bbba44-bundle\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:41:38.081506 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:38.081466    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkgjz\" (UniqueName: \"kubernetes.io/projected/dcbc9963-e025-456e-b917-ca9529bbba44-kube-api-access-vkgjz\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:41:38.779890 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:38.779803    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv" event={"ID":"dcbc9963-e025-456e-b917-ca9529bbba44","Type":"ContainerDied","Data":"2de924f3d87a0dfdfde8ec1d338425940a3c51d0ef198f09a7fbb70d61c696e1"}
Sep 10 23:41:38.779890 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:38.779846    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2de924f3d87a0dfdfde8ec1d338425940a3c51d0ef198f09a7fbb70d61c696e1"
Sep 10 23:41:38.779890 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:38.779848    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4kvpv"
Sep 10 23:41:40.393587 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:40.393557    2581 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 23:41:44.329566 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.329531    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8"]
Sep 10 23:41:44.336288 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.329809    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcbc9963-e025-456e-b917-ca9529bbba44" containerName="extract"
Sep 10 23:41:44.336288 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.329820    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcbc9963-e025-456e-b917-ca9529bbba44" containerName="extract"
Sep 10 23:41:44.336288 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.329828    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcbc9963-e025-456e-b917-ca9529bbba44" containerName="pull"
Sep 10 23:41:44.336288 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.329833    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcbc9963-e025-456e-b917-ca9529bbba44" containerName="pull"
Sep 10 23:41:44.336288 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.329849    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcbc9963-e025-456e-b917-ca9529bbba44" containerName="util"
Sep 10 23:41:44.336288 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.329854    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcbc9963-e025-456e-b917-ca9529bbba44" containerName="util"
Sep 10 23:41:44.336288 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.329896    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcbc9963-e025-456e-b917-ca9529bbba44" containerName="extract"
Sep 10 23:41:44.336737 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.336722    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8"
Sep 10 23:41:44.339246 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.339222    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:41:44.339368 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.339297    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:41:44.340376 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.340358    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-49xzp\""
Sep 10 23:41:44.342636 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.342613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8"]
Sep 10 23:41:44.426475 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.426436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8\" (UID: \"6bee5553-3f5c-4490-81cf-4d6a47dfa78e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8"
Sep 10 23:41:44.426646 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.426489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8\" (UID: \"6bee5553-3f5c-4490-81cf-4d6a47dfa78e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8"
Sep 10 23:41:44.426646 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.426528    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz8wt\" (UniqueName: \"kubernetes.io/projected/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-kube-api-access-cz8wt\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8\" (UID: \"6bee5553-3f5c-4490-81cf-4d6a47dfa78e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8"
Sep 10 23:41:44.527405 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.527371    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8\" (UID: \"6bee5553-3f5c-4490-81cf-4d6a47dfa78e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8"
Sep 10 23:41:44.527565 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.527418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8\" (UID: \"6bee5553-3f5c-4490-81cf-4d6a47dfa78e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8"
Sep 10 23:41:44.527565 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.527539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz8wt\" (UniqueName: \"kubernetes.io/projected/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-kube-api-access-cz8wt\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8\" (UID: \"6bee5553-3f5c-4490-81cf-4d6a47dfa78e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8"
Sep 10 23:41:44.527849 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.527829    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8\" (UID: \"6bee5553-3f5c-4490-81cf-4d6a47dfa78e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8"
Sep 10 23:41:44.527914 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.527893    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8\" (UID: \"6bee5553-3f5c-4490-81cf-4d6a47dfa78e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8"
Sep 10 23:41:44.536950 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.536919    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz8wt\" (UniqueName: \"kubernetes.io/projected/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-kube-api-access-cz8wt\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8\" (UID: \"6bee5553-3f5c-4490-81cf-4d6a47dfa78e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8"
Sep 10 23:41:44.647259 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.647183    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8"
Sep 10 23:41:44.925233 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:44.925115    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8"]
Sep 10 23:41:44.927296 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:41:44.927260    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bee5553_3f5c_4490_81cf_4d6a47dfa78e.slice/crio-56fab324396ede94b7c712f2550dd78d9a128de81689e026c522c8ede71f29d2 WatchSource:0}: Error finding container 56fab324396ede94b7c712f2550dd78d9a128de81689e026c522c8ede71f29d2: Status 404 returned error can't find the container with id 56fab324396ede94b7c712f2550dd78d9a128de81689e026c522c8ede71f29d2
Sep 10 23:41:45.485418 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:45.485375    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:45.587633 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:45.587601    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:45.810315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:45.810233    2581 generic.go:356] "Generic (PLEG): container finished" podID="6bee5553-3f5c-4490-81cf-4d6a47dfa78e" containerID="f0ed927d229929aca2ab6e802f844fc8d1dc52fdd629bfa5d94c99232dfd7a70" exitCode=0
Sep 10 23:41:45.810315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:45.810276    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8" event={"ID":"6bee5553-3f5c-4490-81cf-4d6a47dfa78e","Type":"ContainerDied","Data":"f0ed927d229929aca2ab6e802f844fc8d1dc52fdd629bfa5d94c99232dfd7a70"}
Sep 10 23:41:45.810484 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:45.810323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8" event={"ID":"6bee5553-3f5c-4490-81cf-4d6a47dfa78e","Type":"ContainerStarted","Data":"56fab324396ede94b7c712f2550dd78d9a128de81689e026c522c8ede71f29d2"}
Sep 10 23:41:45.810810 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:45.810789    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:41:46.120916 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.120837    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:46.424943 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.424858    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:46.525612 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.525575    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:46.573013 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.572980    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"]
Sep 10 23:41:46.576436 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.576418    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.578777 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.578755    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 23:41:46.579077 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.579058    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 23:41:46.579182 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.579101    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 23:41:46.579182 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.579104    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x5ggk\""
Sep 10 23:41:46.579412 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.579398    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 23:41:46.603045 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.603016    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"]
Sep 10 23:41:46.643890 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.643856    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r64h4\" (UniqueName: \"kubernetes.io/projected/3022230f-59e6-437d-8aaa-64b8f8b939e7-kube-api-access-r64h4\") pod \"opendatahub-operator-controller-manager-f676b6c5d-ggk5t\" (UID: \"3022230f-59e6-437d-8aaa-64b8f8b939e7\") " pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.643890 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.643890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3022230f-59e6-437d-8aaa-64b8f8b939e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-f676b6c5d-ggk5t\" (UID: \"3022230f-59e6-437d-8aaa-64b8f8b939e7\") " pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.644131 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.643924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3022230f-59e6-437d-8aaa-64b8f8b939e7-manifests\") pod \"opendatahub-operator-controller-manager-f676b6c5d-ggk5t\" (UID: \"3022230f-59e6-437d-8aaa-64b8f8b939e7\") " pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.644131 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.643945    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3022230f-59e6-437d-8aaa-64b8f8b939e7-tmp\") pod \"opendatahub-operator-controller-manager-f676b6c5d-ggk5t\" (UID: \"3022230f-59e6-437d-8aaa-64b8f8b939e7\") " pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.644131 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.643964    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3022230f-59e6-437d-8aaa-64b8f8b939e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f676b6c5d-ggk5t\" (UID: \"3022230f-59e6-437d-8aaa-64b8f8b939e7\") " pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.704962 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.704925    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:46.744788 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.744758    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3022230f-59e6-437d-8aaa-64b8f8b939e7-tmp\") pod \"opendatahub-operator-controller-manager-f676b6c5d-ggk5t\" (UID: \"3022230f-59e6-437d-8aaa-64b8f8b939e7\") " pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.744971 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.744799    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3022230f-59e6-437d-8aaa-64b8f8b939e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f676b6c5d-ggk5t\" (UID: \"3022230f-59e6-437d-8aaa-64b8f8b939e7\") " pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.744971 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.744858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r64h4\" (UniqueName: \"kubernetes.io/projected/3022230f-59e6-437d-8aaa-64b8f8b939e7-kube-api-access-r64h4\") pod \"opendatahub-operator-controller-manager-f676b6c5d-ggk5t\" (UID: \"3022230f-59e6-437d-8aaa-64b8f8b939e7\") " pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.744971 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.744877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3022230f-59e6-437d-8aaa-64b8f8b939e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-f676b6c5d-ggk5t\" (UID: \"3022230f-59e6-437d-8aaa-64b8f8b939e7\") " pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.744971 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.744928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3022230f-59e6-437d-8aaa-64b8f8b939e7-manifests\") pod \"opendatahub-operator-controller-manager-f676b6c5d-ggk5t\" (UID: \"3022230f-59e6-437d-8aaa-64b8f8b939e7\") " pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.745272 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.745242    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3022230f-59e6-437d-8aaa-64b8f8b939e7-manifests\") pod \"opendatahub-operator-controller-manager-f676b6c5d-ggk5t\" (UID: \"3022230f-59e6-437d-8aaa-64b8f8b939e7\") " pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.747286 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.747257    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3022230f-59e6-437d-8aaa-64b8f8b939e7-tmp\") pod \"opendatahub-operator-controller-manager-f676b6c5d-ggk5t\" (UID: \"3022230f-59e6-437d-8aaa-64b8f8b939e7\") " pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.747392 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.747379    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3022230f-59e6-437d-8aaa-64b8f8b939e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-f676b6c5d-ggk5t\" (UID: \"3022230f-59e6-437d-8aaa-64b8f8b939e7\") " pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.747577 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.747555    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3022230f-59e6-437d-8aaa-64b8f8b939e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f676b6c5d-ggk5t\" (UID: \"3022230f-59e6-437d-8aaa-64b8f8b939e7\") " pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.753939 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.753919    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r64h4\" (UniqueName: \"kubernetes.io/projected/3022230f-59e6-437d-8aaa-64b8f8b939e7-kube-api-access-r64h4\") pod \"opendatahub-operator-controller-manager-f676b6c5d-ggk5t\" (UID: \"3022230f-59e6-437d-8aaa-64b8f8b939e7\") " pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.806973 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.806942    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:46.816559 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.816530    2581 generic.go:356] "Generic (PLEG): container finished" podID="6bee5553-3f5c-4490-81cf-4d6a47dfa78e" containerID="30e89c3977b44bed95e30cce04eb234aa04c44e00c5d3e7e9c2dd91fb2edc5c8" exitCode=0
Sep 10 23:41:46.816712 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.816606    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8" event={"ID":"6bee5553-3f5c-4490-81cf-4d6a47dfa78e","Type":"ContainerDied","Data":"30e89c3977b44bed95e30cce04eb234aa04c44e00c5d3e7e9c2dd91fb2edc5c8"}
Sep 10 23:41:46.886036 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.886011    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:46.912092 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:46.912061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:47.037347 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:47.037313    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:47.138861 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:47.138828    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:47.175622 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:47.175599    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"]
Sep 10 23:41:47.177967 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:41:47.177947    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3022230f_59e6_437d_8aaa_64b8f8b939e7.slice/crio-7c08ae0c432158c57458ffe0bfb7844a7d599b3ed75be7e7588d843d5d9f95fd WatchSource:0}: Error finding container 7c08ae0c432158c57458ffe0bfb7844a7d599b3ed75be7e7588d843d5d9f95fd: Status 404 returned error can't find the container with id 7c08ae0c432158c57458ffe0bfb7844a7d599b3ed75be7e7588d843d5d9f95fd
Sep 10 23:41:47.244896 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:47.244810    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:47.339290 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:47.339258    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:47.826380 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:47.826340    2581 generic.go:356] "Generic (PLEG): container finished" podID="6bee5553-3f5c-4490-81cf-4d6a47dfa78e" containerID="b4908f75566e13a0ca7bb3ec78b12774eb62e70cd44a7a9aa9b460301ac0900b" exitCode=0
Sep 10 23:41:47.826870 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:47.826471    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8" event={"ID":"6bee5553-3f5c-4490-81cf-4d6a47dfa78e","Type":"ContainerDied","Data":"b4908f75566e13a0ca7bb3ec78b12774eb62e70cd44a7a9aa9b460301ac0900b"}
Sep 10 23:41:47.828708 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:47.828623    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t" event={"ID":"3022230f-59e6-437d-8aaa-64b8f8b939e7","Type":"ContainerStarted","Data":"7c08ae0c432158c57458ffe0bfb7844a7d599b3ed75be7e7588d843d5d9f95fd"}
Sep 10 23:41:49.940055 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:49.940025    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8"
Sep 10 23:41:50.073342 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:50.073306    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-util\") pod \"6bee5553-3f5c-4490-81cf-4d6a47dfa78e\" (UID: \"6bee5553-3f5c-4490-81cf-4d6a47dfa78e\") "
Sep 10 23:41:50.073342 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:50.073349    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cz8wt\" (UniqueName: \"kubernetes.io/projected/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-kube-api-access-cz8wt\") pod \"6bee5553-3f5c-4490-81cf-4d6a47dfa78e\" (UID: \"6bee5553-3f5c-4490-81cf-4d6a47dfa78e\") "
Sep 10 23:41:50.073516 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:50.073430    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-bundle\") pod \"6bee5553-3f5c-4490-81cf-4d6a47dfa78e\" (UID: \"6bee5553-3f5c-4490-81cf-4d6a47dfa78e\") "
Sep 10 23:41:50.074208 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:50.074183    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-bundle" (OuterVolumeSpecName: "bundle") pod "6bee5553-3f5c-4490-81cf-4d6a47dfa78e" (UID: "6bee5553-3f5c-4490-81cf-4d6a47dfa78e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:41:50.075595 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:50.075572    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-kube-api-access-cz8wt" (OuterVolumeSpecName: "kube-api-access-cz8wt") pod "6bee5553-3f5c-4490-81cf-4d6a47dfa78e" (UID: "6bee5553-3f5c-4490-81cf-4d6a47dfa78e"). InnerVolumeSpecName "kube-api-access-cz8wt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:41:50.174545 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:50.174473    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-bundle\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:41:50.174545 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:50.174500    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cz8wt\" (UniqueName: \"kubernetes.io/projected/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-kube-api-access-cz8wt\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:41:50.484364 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:50.484310    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-util" (OuterVolumeSpecName: "util") pod "6bee5553-3f5c-4490-81cf-4d6a47dfa78e" (UID: "6bee5553-3f5c-4490-81cf-4d6a47dfa78e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:41:50.577687 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:50.577650    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bee5553-3f5c-4490-81cf-4d6a47dfa78e-util\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:41:50.845498 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:50.845417    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8"
Sep 10 23:41:50.845498 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:50.845448    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0w7tc8" event={"ID":"6bee5553-3f5c-4490-81cf-4d6a47dfa78e","Type":"ContainerDied","Data":"56fab324396ede94b7c712f2550dd78d9a128de81689e026c522c8ede71f29d2"}
Sep 10 23:41:50.845498 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:50.845489    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56fab324396ede94b7c712f2550dd78d9a128de81689e026c522c8ede71f29d2"
Sep 10 23:41:50.847050 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:50.847026    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t" event={"ID":"3022230f-59e6-437d-8aaa-64b8f8b939e7","Type":"ContainerStarted","Data":"f8f443c407b4d35e76e89f3436ec22a48284c430a0e54d049fc096185e9084f1"}
Sep 10 23:41:51.858271 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:51.858241    2581 generic.go:356] "Generic (PLEG): container finished" podID="3022230f-59e6-437d-8aaa-64b8f8b939e7" containerID="f8f443c407b4d35e76e89f3436ec22a48284c430a0e54d049fc096185e9084f1" exitCode=0
Sep 10 23:41:51.858695 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:51.858331    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t" event={"ID":"3022230f-59e6-437d-8aaa-64b8f8b939e7","Type":"ContainerDied","Data":"f8f443c407b4d35e76e89f3436ec22a48284c430a0e54d049fc096185e9084f1"}
Sep 10 23:41:52.865136 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:52.865102    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t" event={"ID":"3022230f-59e6-437d-8aaa-64b8f8b939e7","Type":"ContainerStarted","Data":"73115d19234cc284ab1746fb8f1cd8df990bb73103c4d8ba02bc9c2ee9a4d3a4"}
Sep 10 23:41:52.865626 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:52.865257    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:41:52.939010 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:52.938960    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t" podStartSLOduration=2.6189126849999997 podStartE2EDuration="6.93894363s" totalImagesPullingTime="3.300952526s" totalInitContainerRuntime="1.019078419s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:41:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:41:52.938317844 +0000 UTC m=+312.979187149" watchObservedRunningTime="2026-09-10 23:41:52.93894363 +0000 UTC m=+312.979812935"
Sep 10 23:41:58.102145 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:58.102110    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:41:59.224545 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:41:59.224513    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:03.871057 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:03.871027    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f676b6c5d-ggk5t"
Sep 10 23:42:05.491733 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:05.491696    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:05.618315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:05.618277    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:08.547524 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.547490    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:08.587896 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.587861    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq"]
Sep 10 23:42:08.588135 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.588123    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bee5553-3f5c-4490-81cf-4d6a47dfa78e" containerName="pull"
Sep 10 23:42:08.588191 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.588137    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bee5553-3f5c-4490-81cf-4d6a47dfa78e" containerName="pull"
Sep 10 23:42:08.588191 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.588147    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bee5553-3f5c-4490-81cf-4d6a47dfa78e" containerName="util"
Sep 10 23:42:08.588191 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.588152    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bee5553-3f5c-4490-81cf-4d6a47dfa78e" containerName="util"
Sep 10 23:42:08.588191 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.588170    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bee5553-3f5c-4490-81cf-4d6a47dfa78e" containerName="extract"
Sep 10 23:42:08.588191 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.588175    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bee5553-3f5c-4490-81cf-4d6a47dfa78e" containerName="extract"
Sep 10 23:42:08.588365 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.588225    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bee5553-3f5c-4490-81cf-4d6a47dfa78e" containerName="extract"
Sep 10 23:42:08.591258 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.591241    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq"
Sep 10 23:42:08.594548 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.594528    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 23:42:08.594861 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.594843    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 23:42:08.594915 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.594872    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 23:42:08.595612 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.595599    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 23:42:08.595697 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.595664    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-s5q4r\""
Sep 10 23:42:08.608567 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.608541    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq"]
Sep 10 23:42:08.725933 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.725897    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psp6p\" (UniqueName: \"kubernetes.io/projected/12b76d4b-f7d8-4b8b-aed7-bf055f06aa05-kube-api-access-psp6p\") pod \"kube-auth-proxy-7d44b74856-lbqgq\" (UID: \"12b76d4b-f7d8-4b8b-aed7-bf055f06aa05\") " pod="openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq"
Sep 10 23:42:08.726098 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.725952    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12b76d4b-f7d8-4b8b-aed7-bf055f06aa05-tls-certs\") pod \"kube-auth-proxy-7d44b74856-lbqgq\" (UID: \"12b76d4b-f7d8-4b8b-aed7-bf055f06aa05\") " pod="openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq"
Sep 10 23:42:08.726098 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.725995    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12b76d4b-f7d8-4b8b-aed7-bf055f06aa05-tmp\") pod \"kube-auth-proxy-7d44b74856-lbqgq\" (UID: \"12b76d4b-f7d8-4b8b-aed7-bf055f06aa05\") " pod="openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq"
Sep 10 23:42:08.827226 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.827129    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12b76d4b-f7d8-4b8b-aed7-bf055f06aa05-tls-certs\") pod \"kube-auth-proxy-7d44b74856-lbqgq\" (UID: \"12b76d4b-f7d8-4b8b-aed7-bf055f06aa05\") " pod="openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq"
Sep 10 23:42:08.827226 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.827179    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12b76d4b-f7d8-4b8b-aed7-bf055f06aa05-tmp\") pod \"kube-auth-proxy-7d44b74856-lbqgq\" (UID: \"12b76d4b-f7d8-4b8b-aed7-bf055f06aa05\") " pod="openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq"
Sep 10 23:42:08.827439 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.827252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psp6p\" (UniqueName: \"kubernetes.io/projected/12b76d4b-f7d8-4b8b-aed7-bf055f06aa05-kube-api-access-psp6p\") pod \"kube-auth-proxy-7d44b74856-lbqgq\" (UID: \"12b76d4b-f7d8-4b8b-aed7-bf055f06aa05\") " pod="openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq"
Sep 10 23:42:08.829593 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.829565    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12b76d4b-f7d8-4b8b-aed7-bf055f06aa05-tmp\") pod \"kube-auth-proxy-7d44b74856-lbqgq\" (UID: \"12b76d4b-f7d8-4b8b-aed7-bf055f06aa05\") " pod="openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq"
Sep 10 23:42:08.829723 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.829708    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12b76d4b-f7d8-4b8b-aed7-bf055f06aa05-tls-certs\") pod \"kube-auth-proxy-7d44b74856-lbqgq\" (UID: \"12b76d4b-f7d8-4b8b-aed7-bf055f06aa05\") " pod="openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq"
Sep 10 23:42:08.835929 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.835904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psp6p\" (UniqueName: \"kubernetes.io/projected/12b76d4b-f7d8-4b8b-aed7-bf055f06aa05-kube-api-access-psp6p\") pod \"kube-auth-proxy-7d44b74856-lbqgq\" (UID: \"12b76d4b-f7d8-4b8b-aed7-bf055f06aa05\") " pod="openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq"
Sep 10 23:42:08.841458 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.841402    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:08.901002 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:08.900976    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq"
Sep 10 23:42:09.173306 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:09.173138    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq"]
Sep 10 23:42:09.175919 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:42:09.175895    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b76d4b_f7d8_4b8b_aed7_bf055f06aa05.slice/crio-c4c46612950d6c63bc8935b25c65ad22f7028e36668e34742b0e2b30ffd466a1 WatchSource:0}: Error finding container c4c46612950d6c63bc8935b25c65ad22f7028e36668e34742b0e2b30ffd466a1: Status 404 returned error can't find the container with id c4c46612950d6c63bc8935b25c65ad22f7028e36668e34742b0e2b30ffd466a1
Sep 10 23:42:09.945929 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:09.945873    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq" event={"ID":"12b76d4b-f7d8-4b8b-aed7-bf055f06aa05","Type":"ContainerStarted","Data":"c4c46612950d6c63bc8935b25c65ad22f7028e36668e34742b0e2b30ffd466a1"}
Sep 10 23:42:10.029747 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.029704    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"]
Sep 10 23:42:10.032994 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.032973    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.034971 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.034935    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:10.035549 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.035517    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 23:42:10.035653 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.035521    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 23:42:10.035653 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.035600    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-psxj5\""
Sep 10 23:42:10.036493 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.036476    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 23:42:10.036594 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.036576    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 23:42:10.047994 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.047964    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"]
Sep 10 23:42:10.114533 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.114493    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:10.136499 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.136408    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.136724 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.136534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/479856bf-dfde-4446-8983-2b1971df616a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.136724 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.136580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/479856bf-dfde-4446-8983-2b1971df616a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.136724 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.136613    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.136724 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.136634    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/479856bf-dfde-4446-8983-2b1971df616a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.136943 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.136746    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.136943 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.136778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mq4c\" (UniqueName: \"kubernetes.io/projected/479856bf-dfde-4446-8983-2b1971df616a-kube-api-access-7mq4c\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.238085 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.238051    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.238085 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.238088    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mq4c\" (UniqueName: \"kubernetes.io/projected/479856bf-dfde-4446-8983-2b1971df616a-kube-api-access-7mq4c\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.238344 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.238112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.238344 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.238215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/479856bf-dfde-4446-8983-2b1971df616a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.238344 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.238270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/479856bf-dfde-4446-8983-2b1971df616a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.238344 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.238305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.238344 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.238333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/479856bf-dfde-4446-8983-2b1971df616a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.239015 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.238943    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/479856bf-dfde-4446-8983-2b1971df616a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.240826 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.240785    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/479856bf-dfde-4446-8983-2b1971df616a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.241309 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.241289    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.241416 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.241314    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.241490 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.241442    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.246858 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.246831    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mq4c\" (UniqueName: \"kubernetes.io/projected/479856bf-dfde-4446-8983-2b1971df616a-kube-api-access-7mq4c\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.247154 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.247134    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/479856bf-dfde-4446-8983-2b1971df616a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2j4rk\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:10.344737 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:10.344700    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:11.310159 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:11.310116    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:11.888076 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:11.887991    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"]
Sep 10 23:42:11.891039 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:42:11.891014    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod479856bf_dfde_4446_8983_2b1971df616a.slice/crio-7aa98555bd26352d6a09a262d073141d168007692136c0eef8f01226fa117392 WatchSource:0}: Error finding container 7aa98555bd26352d6a09a262d073141d168007692136c0eef8f01226fa117392: Status 404 returned error can't find the container with id 7aa98555bd26352d6a09a262d073141d168007692136c0eef8f01226fa117392
Sep 10 23:42:11.955891 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:11.955852    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk" event={"ID":"479856bf-dfde-4446-8983-2b1971df616a","Type":"ContainerStarted","Data":"7aa98555bd26352d6a09a262d073141d168007692136c0eef8f01226fa117392"}
Sep 10 23:42:11.957378 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:11.957355    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq" event={"ID":"12b76d4b-f7d8-4b8b-aed7-bf055f06aa05","Type":"ContainerStarted","Data":"54373b8a10f3476efa415d7e246bc81090a8670ca65f3216db02291fa34e4d2e"}
Sep 10 23:42:11.986681 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:11.986627    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq" podStartSLOduration=1.505668421 podStartE2EDuration="3.986611313s" totalImagesPullingTime="2.480942892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:42:11.985758144 +0000 UTC m=+332.026627449" watchObservedRunningTime="2026-09-10 23:42:11.986611313 +0000 UTC m=+332.027480618"
Sep 10 23:42:14.467806 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:14.467768    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:42:14.468176 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:14.467848    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:42:14.979829 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:14.979724    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk" event={"ID":"479856bf-dfde-4446-8983-2b1971df616a","Type":"ContainerStarted","Data":"7ccc754f4b8572ed40bd5321a8741e04d496fc2be6f6e6377143145c8558f80f"}
Sep 10 23:42:14.980481 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:14.980462    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:15.006406 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:15.006332    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk" podStartSLOduration=2.431991522 podStartE2EDuration="5.006308316s" totalImagesPullingTime="2.574316794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:42:15.004176612 +0000 UTC m=+335.045045917" watchObservedRunningTime="2026-09-10 23:42:15.006308316 +0000 UTC m=+335.047177614"
Sep 10 23:42:15.029299 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:15.029267    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:15.129983 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:15.129937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:15.310911 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:15.310820    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:15.505205 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:15.505177    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:15.739339 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:15.739313    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:15.986172 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:15.986141    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:16.533789 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:16.533751    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:16.599894 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:16.599857    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:16.700053 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:16.700021    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:16.993549 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:16.993511    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:17.135571 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:17.135539    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6n4t6"]
Sep 10 23:42:17.139751 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:17.139736    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6n4t6"
Sep 10 23:42:17.142742 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:17.142720    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 10 23:42:17.159162 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:17.159138    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6n4t6"]
Sep 10 23:42:17.177604 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:17.177566    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:17.203873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:17.203847    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e501694-be14-440c-ba87-331079b592a0-tls-certs\") pod \"model-serving-api-54d89bd5fc-6n4t6\" (UID: \"0e501694-be14-440c-ba87-331079b592a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-6n4t6"
Sep 10 23:42:17.204034 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:17.203931    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgdmq\" (UniqueName: \"kubernetes.io/projected/0e501694-be14-440c-ba87-331079b592a0-kube-api-access-mgdmq\") pod \"model-serving-api-54d89bd5fc-6n4t6\" (UID: \"0e501694-be14-440c-ba87-331079b592a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-6n4t6"
Sep 10 23:42:17.277091 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:17.277011    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:17.305040 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:17.305011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgdmq\" (UniqueName: \"kubernetes.io/projected/0e501694-be14-440c-ba87-331079b592a0-kube-api-access-mgdmq\") pod \"model-serving-api-54d89bd5fc-6n4t6\" (UID: \"0e501694-be14-440c-ba87-331079b592a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-6n4t6"
Sep 10 23:42:17.305166 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:17.305056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e501694-be14-440c-ba87-331079b592a0-tls-certs\") pod \"model-serving-api-54d89bd5fc-6n4t6\" (UID: \"0e501694-be14-440c-ba87-331079b592a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-6n4t6"
Sep 10 23:42:17.307628 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:17.307607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e501694-be14-440c-ba87-331079b592a0-tls-certs\") pod \"model-serving-api-54d89bd5fc-6n4t6\" (UID: \"0e501694-be14-440c-ba87-331079b592a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-6n4t6"
Sep 10 23:42:17.313912 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:17.313890    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgdmq\" (UniqueName: \"kubernetes.io/projected/0e501694-be14-440c-ba87-331079b592a0-kube-api-access-mgdmq\") pod \"model-serving-api-54d89bd5fc-6n4t6\" (UID: \"0e501694-be14-440c-ba87-331079b592a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-6n4t6"
Sep 10 23:42:17.449743 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:17.449706    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6n4t6"
Sep 10 23:42:17.725275 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:17.725221    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6n4t6"]
Sep 10 23:42:17.727318 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:42:17.727288    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e501694_be14_440c_ba87_331079b592a0.slice/crio-6240459583f283d1142e414686e350d3f3c2f298c20d2ccaddd949d21064db69 WatchSource:0}: Error finding container 6240459583f283d1142e414686e350d3f3c2f298c20d2ccaddd949d21064db69: Status 404 returned error can't find the container with id 6240459583f283d1142e414686e350d3f3c2f298c20d2ccaddd949d21064db69
Sep 10 23:42:17.993986 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:17.993901    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6n4t6" event={"ID":"0e501694-be14-440c-ba87-331079b592a0","Type":"ContainerStarted","Data":"6240459583f283d1142e414686e350d3f3c2f298c20d2ccaddd949d21064db69"}
Sep 10 23:42:20.004447 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:20.004410    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6n4t6" event={"ID":"0e501694-be14-440c-ba87-331079b592a0","Type":"ContainerStarted","Data":"5d4e6bc2a014b95b18620dc517586c597647ba9ba6a03ed51e88e878db6eb5a4"}
Sep 10 23:42:20.004883 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:20.004553    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-6n4t6"
Sep 10 23:42:20.022018 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:20.021969    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-6n4t6" podStartSLOduration=1.499774438 podStartE2EDuration="3.021955957s" totalImagesPullingTime="1.522181519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:42:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:42:20.020175837 +0000 UTC m=+340.061045141" watchObservedRunningTime="2026-09-10 23:42:20.021955957 +0000 UTC m=+340.062825262"
Sep 10 23:42:21.019646 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:21.019615    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:26.903718 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:26.903635    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:26.947779 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:26.947662    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz"]
Sep 10 23:42:26.958142 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:26.958123    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz"
Sep 10 23:42:26.961391 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:26.961361    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 10 23:42:26.961806 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:26.961698    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-nzcd6\""
Sep 10 23:42:26.963482 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:26.963458    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz"]
Sep 10 23:42:26.969218 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:26.969189    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c9ab2ad-c6c2-4b31-a438-24a38381908c-cert\") pod \"kserve-controller-manager-d6f4b65b8-hsxdz\" (UID: \"4c9ab2ad-c6c2-4b31-a438-24a38381908c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz"
Sep 10 23:42:26.969303 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:26.969284    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6nbq\" (UniqueName: \"kubernetes.io/projected/4c9ab2ad-c6c2-4b31-a438-24a38381908c-kube-api-access-c6nbq\") pod \"kserve-controller-manager-d6f4b65b8-hsxdz\" (UID: \"4c9ab2ad-c6c2-4b31-a438-24a38381908c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz"
Sep 10 23:42:26.979509 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:26.979487    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fgvbh"]
Sep 10 23:42:26.982888 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:26.982873    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fgvbh"
Sep 10 23:42:26.986102 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:26.986078    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 10 23:42:26.986204 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:26.986083    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vmtb5\""
Sep 10 23:42:26.994614 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:26.994593    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fgvbh"]
Sep 10 23:42:27.000815 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.000786    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:27.070127 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.070103    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6nbq\" (UniqueName: \"kubernetes.io/projected/4c9ab2ad-c6c2-4b31-a438-24a38381908c-kube-api-access-c6nbq\") pod \"kserve-controller-manager-d6f4b65b8-hsxdz\" (UID: \"4c9ab2ad-c6c2-4b31-a438-24a38381908c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz"
Sep 10 23:42:27.070303 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.070146    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c9ab2ad-c6c2-4b31-a438-24a38381908c-cert\") pod \"kserve-controller-manager-d6f4b65b8-hsxdz\" (UID: \"4c9ab2ad-c6c2-4b31-a438-24a38381908c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz"
Sep 10 23:42:27.070303 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.070168    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f86489b8-963e-4a1e-aeb9-6819b98d34a5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fgvbh\" (UID: \"f86489b8-963e-4a1e-aeb9-6819b98d34a5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fgvbh"
Sep 10 23:42:27.070303 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.070205    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b46xd\" (UniqueName: \"kubernetes.io/projected/f86489b8-963e-4a1e-aeb9-6819b98d34a5-kube-api-access-b46xd\") pod \"llmisvc-controller-manager-777c6bd7d5-fgvbh\" (UID: \"f86489b8-963e-4a1e-aeb9-6819b98d34a5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fgvbh"
Sep 10 23:42:27.070470 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:42:27.070304    2581 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 10 23:42:27.070470 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:42:27.070373    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c9ab2ad-c6c2-4b31-a438-24a38381908c-cert podName:4c9ab2ad-c6c2-4b31-a438-24a38381908c nodeName:}" failed. No retries permitted until 2026-09-10 23:42:27.570351735 +0000 UTC m=+347.611221018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4c9ab2ad-c6c2-4b31-a438-24a38381908c-cert") pod "kserve-controller-manager-d6f4b65b8-hsxdz" (UID: "4c9ab2ad-c6c2-4b31-a438-24a38381908c") : secret "kserve-webhook-server-cert" not found
Sep 10 23:42:27.077627 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.077598    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:27.079895 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.079872    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6nbq\" (UniqueName: \"kubernetes.io/projected/4c9ab2ad-c6c2-4b31-a438-24a38381908c-kube-api-access-c6nbq\") pod \"kserve-controller-manager-d6f4b65b8-hsxdz\" (UID: \"4c9ab2ad-c6c2-4b31-a438-24a38381908c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz"
Sep 10 23:42:27.170988 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.170893    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b46xd\" (UniqueName: \"kubernetes.io/projected/f86489b8-963e-4a1e-aeb9-6819b98d34a5-kube-api-access-b46xd\") pod \"llmisvc-controller-manager-777c6bd7d5-fgvbh\" (UID: \"f86489b8-963e-4a1e-aeb9-6819b98d34a5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fgvbh"
Sep 10 23:42:27.170988 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.170986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f86489b8-963e-4a1e-aeb9-6819b98d34a5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fgvbh\" (UID: \"f86489b8-963e-4a1e-aeb9-6819b98d34a5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fgvbh"
Sep 10 23:42:27.173494 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.173470    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f86489b8-963e-4a1e-aeb9-6819b98d34a5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fgvbh\" (UID: \"f86489b8-963e-4a1e-aeb9-6819b98d34a5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fgvbh"
Sep 10 23:42:27.188180 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.188147    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b46xd\" (UniqueName: \"kubernetes.io/projected/f86489b8-963e-4a1e-aeb9-6819b98d34a5-kube-api-access-b46xd\") pod \"llmisvc-controller-manager-777c6bd7d5-fgvbh\" (UID: \"f86489b8-963e-4a1e-aeb9-6819b98d34a5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fgvbh"
Sep 10 23:42:27.292426 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.292384    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:27.294222 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.294193    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fgvbh"
Sep 10 23:42:27.568884 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.568690    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fgvbh"]
Sep 10 23:42:27.570913 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:42:27.570876    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf86489b8_963e_4a1e_aeb9_6819b98d34a5.slice/crio-1d92709b86fe660254727cca7f6b0710387d7642fce0506e95d6ef7e860311cd WatchSource:0}: Error finding container 1d92709b86fe660254727cca7f6b0710387d7642fce0506e95d6ef7e860311cd: Status 404 returned error can't find the container with id 1d92709b86fe660254727cca7f6b0710387d7642fce0506e95d6ef7e860311cd
Sep 10 23:42:27.574058 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.574037    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c9ab2ad-c6c2-4b31-a438-24a38381908c-cert\") pod \"kserve-controller-manager-d6f4b65b8-hsxdz\" (UID: \"4c9ab2ad-c6c2-4b31-a438-24a38381908c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz"
Sep 10 23:42:27.576520 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.576494    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c9ab2ad-c6c2-4b31-a438-24a38381908c-cert\") pod \"kserve-controller-manager-d6f4b65b8-hsxdz\" (UID: \"4c9ab2ad-c6c2-4b31-a438-24a38381908c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz"
Sep 10 23:42:27.869613 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:27.869524    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz"
Sep 10 23:42:28.041350 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:28.041308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fgvbh" event={"ID":"f86489b8-963e-4a1e-aeb9-6819b98d34a5","Type":"ContainerStarted","Data":"1d92709b86fe660254727cca7f6b0710387d7642fce0506e95d6ef7e860311cd"}
Sep 10 23:42:28.153071 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:28.153007    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz"]
Sep 10 23:42:28.155122 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:42:28.155095    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c9ab2ad_c6c2_4b31_a438_24a38381908c.slice/crio-4f8c177dab638623e7394644eb5e658324b5704bf4402e99a3bebbc8eee9f611 WatchSource:0}: Error finding container 4f8c177dab638623e7394644eb5e658324b5704bf4402e99a3bebbc8eee9f611: Status 404 returned error can't find the container with id 4f8c177dab638623e7394644eb5e658324b5704bf4402e99a3bebbc8eee9f611
Sep 10 23:42:28.246150 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:28.246080    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:28.345579 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:28.345541    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:28.445425 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:28.445075    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:42:29.047689 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:29.047636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz" event={"ID":"4c9ab2ad-c6c2-4b31-a438-24a38381908c","Type":"ContainerStarted","Data":"4f8c177dab638623e7394644eb5e658324b5704bf4402e99a3bebbc8eee9f611"}
Sep 10 23:42:29.538281 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:29.538244    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"]
Sep 10 23:42:29.538503 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:29.538476    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk" podUID="479856bf-dfde-4446-8983-2b1971df616a" containerName="discovery" containerID="cri-o://7ccc754f4b8572ed40bd5321a8741e04d496fc2be6f6e6377143145c8558f80f" gracePeriod=30
Sep 10 23:42:30.055658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.055623    2581 generic.go:356] "Generic (PLEG): container finished" podID="479856bf-dfde-4446-8983-2b1971df616a" containerID="7ccc754f4b8572ed40bd5321a8741e04d496fc2be6f6e6377143145c8558f80f" exitCode=0
Sep 10 23:42:30.056119 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.055704    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk" event={"ID":"479856bf-dfde-4446-8983-2b1971df616a","Type":"ContainerDied","Data":"7ccc754f4b8572ed40bd5321a8741e04d496fc2be6f6e6377143145c8558f80f"}
Sep 10 23:42:30.576997 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.576972    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:30.598353 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.598331    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/479856bf-dfde-4446-8983-2b1971df616a-istio-csr-ca-configmap\") pod \"479856bf-dfde-4446-8983-2b1971df616a\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") "
Sep 10 23:42:30.598445 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.598372    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-istio-csr-dns-cert\") pod \"479856bf-dfde-4446-8983-2b1971df616a\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") "
Sep 10 23:42:30.598445 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.598432    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/479856bf-dfde-4446-8983-2b1971df616a-local-certs\") pod \"479856bf-dfde-4446-8983-2b1971df616a\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") "
Sep 10 23:42:30.598563 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.598457    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mq4c\" (UniqueName: \"kubernetes.io/projected/479856bf-dfde-4446-8983-2b1971df616a-kube-api-access-7mq4c\") pod \"479856bf-dfde-4446-8983-2b1971df616a\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") "
Sep 10 23:42:30.598563 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.598517    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/479856bf-dfde-4446-8983-2b1971df616a-istio-token\") pod \"479856bf-dfde-4446-8983-2b1971df616a\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") "
Sep 10 23:42:30.598563 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.598557    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-cacerts\") pod \"479856bf-dfde-4446-8983-2b1971df616a\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") "
Sep 10 23:42:30.598806 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.598752    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/479856bf-dfde-4446-8983-2b1971df616a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "479856bf-dfde-4446-8983-2b1971df616a" (UID: "479856bf-dfde-4446-8983-2b1971df616a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:42:30.598915 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.598809    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-istio-kubeconfig\") pod \"479856bf-dfde-4446-8983-2b1971df616a\" (UID: \"479856bf-dfde-4446-8983-2b1971df616a\") "
Sep 10 23:42:30.599031 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.599001    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/479856bf-dfde-4446-8983-2b1971df616a-istio-csr-ca-configmap\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:42:30.601438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.601395    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "479856bf-dfde-4446-8983-2b1971df616a" (UID: "479856bf-dfde-4446-8983-2b1971df616a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:42:30.601438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.601418    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-cacerts" (OuterVolumeSpecName: "cacerts") pod "479856bf-dfde-4446-8983-2b1971df616a" (UID: "479856bf-dfde-4446-8983-2b1971df616a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:42:30.601550 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.601480    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "479856bf-dfde-4446-8983-2b1971df616a" (UID: "479856bf-dfde-4446-8983-2b1971df616a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:42:30.601793 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.601763    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/479856bf-dfde-4446-8983-2b1971df616a-istio-token" (OuterVolumeSpecName: "istio-token") pod "479856bf-dfde-4446-8983-2b1971df616a" (UID: "479856bf-dfde-4446-8983-2b1971df616a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:42:30.601868 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.601840    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/479856bf-dfde-4446-8983-2b1971df616a-local-certs" (OuterVolumeSpecName: "local-certs") pod "479856bf-dfde-4446-8983-2b1971df616a" (UID: "479856bf-dfde-4446-8983-2b1971df616a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:42:30.601925 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.601901    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/479856bf-dfde-4446-8983-2b1971df616a-kube-api-access-7mq4c" (OuterVolumeSpecName: "kube-api-access-7mq4c") pod "479856bf-dfde-4446-8983-2b1971df616a" (UID: "479856bf-dfde-4446-8983-2b1971df616a"). InnerVolumeSpecName "kube-api-access-7mq4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:42:30.699519 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.699495    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/479856bf-dfde-4446-8983-2b1971df616a-istio-token\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:42:30.699519 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.699517    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-cacerts\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:42:30.699676 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.699526    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-istio-kubeconfig\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:42:30.699676 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.699533    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/479856bf-dfde-4446-8983-2b1971df616a-istio-csr-dns-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:42:30.699676 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.699543    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/479856bf-dfde-4446-8983-2b1971df616a-local-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:42:30.699676 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:30.699551    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mq4c\" (UniqueName: \"kubernetes.io/projected/479856bf-dfde-4446-8983-2b1971df616a-kube-api-access-7mq4c\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:42:31.013069 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:31.013042    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-6n4t6"
Sep 10 23:42:31.062136 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:31.062102    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"
Sep 10 23:42:31.062136 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:31.062116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk" event={"ID":"479856bf-dfde-4446-8983-2b1971df616a","Type":"ContainerDied","Data":"7aa98555bd26352d6a09a262d073141d168007692136c0eef8f01226fa117392"}
Sep 10 23:42:31.062620 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:31.062185    2581 scope.go:117] "RemoveContainer" containerID="7ccc754f4b8572ed40bd5321a8741e04d496fc2be6f6e6377143145c8558f80f"
Sep 10 23:42:31.064010 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:31.063979    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fgvbh" event={"ID":"f86489b8-963e-4a1e-aeb9-6819b98d34a5","Type":"ContainerStarted","Data":"bbdc0b24c0a58e41d8a23a3e6d2104fd9ac7801b5989d49d60ff51446bf50676"}
Sep 10 23:42:31.064142 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:31.064064    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fgvbh"
Sep 10 23:42:31.067096 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:31.067068    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz" event={"ID":"4c9ab2ad-c6c2-4b31-a438-24a38381908c","Type":"ContainerStarted","Data":"10df31104511bc2addc25323fc80cbcdb897c4e55f5bbb3231907ce3b96616de"}
Sep 10 23:42:31.067216 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:31.067143    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz"
Sep 10 23:42:31.083756 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:31.083709    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fgvbh" podStartSLOduration=2.062561739 podStartE2EDuration="5.083688877s" totalImagesPullingTime="3.021127138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:42:31.082920516 +0000 UTC m=+351.123789823" watchObservedRunningTime="2026-09-10 23:42:31.083688877 +0000 UTC m=+351.124558175"
Sep 10 23:42:31.098834 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:31.098781    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz" podStartSLOduration=2.660542439 podStartE2EDuration="5.098764409s" totalImagesPullingTime="2.43822197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:42:31.098242492 +0000 UTC m=+351.139111798" watchObservedRunningTime="2026-09-10 23:42:31.098764409 +0000 UTC m=+351.139633714"
Sep 10 23:42:31.114433 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:31.114406    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"]
Sep 10 23:42:31.118201 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:31.118180    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk"]
Sep 10 23:42:32.487761 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:42:32.487549    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="479856bf-dfde-4446-8983-2b1971df616a" path="/var/lib/kubelet/pods/479856bf-dfde-4446-8983-2b1971df616a/volumes"
Sep 10 23:43:02.075788 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:02.075754    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fgvbh"
Sep 10 23:43:02.078701 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:02.078661    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hsxdz"
Sep 10 23:43:17.714467 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:17.714431    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:17.895206 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:17.895170    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:24.662268 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.662233    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq"]
Sep 10 23:43:24.662650 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.662558    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="479856bf-dfde-4446-8983-2b1971df616a" containerName="discovery"
Sep 10 23:43:24.662650 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.662570    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="479856bf-dfde-4446-8983-2b1971df616a" containerName="discovery"
Sep 10 23:43:24.662650 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.662632    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="479856bf-dfde-4446-8983-2b1971df616a" containerName="discovery"
Sep 10 23:43:24.665481 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.665465    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq"
Sep 10 23:43:24.668427 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.668406    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:43:24.668545 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.668498    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:43:24.669433 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.669412    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-49xzp\""
Sep 10 23:43:24.677874 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.677848    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq"]
Sep 10 23:43:24.739927 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.739895    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww"]
Sep 10 23:43:24.742126 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.742111    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww"
Sep 10 23:43:24.751716 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.751693    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww"]
Sep 10 23:43:24.778883 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.778855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq\" (UID: \"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq"
Sep 10 23:43:24.779026 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.778897    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11443906-db16-4962-8fb0-82df38abbefe-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww\" (UID: \"11443906-db16-4962-8fb0-82df38abbefe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww"
Sep 10 23:43:24.779026 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.778923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq\" (UID: \"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq"
Sep 10 23:43:24.779026 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.778989    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wctg\" (UniqueName: \"kubernetes.io/projected/11443906-db16-4962-8fb0-82df38abbefe-kube-api-access-4wctg\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww\" (UID: \"11443906-db16-4962-8fb0-82df38abbefe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww"
Sep 10 23:43:24.779026 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.779012    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11443906-db16-4962-8fb0-82df38abbefe-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww\" (UID: \"11443906-db16-4962-8fb0-82df38abbefe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww"
Sep 10 23:43:24.779189 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.779065    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjcsn\" (UniqueName: \"kubernetes.io/projected/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-kube-api-access-sjcsn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq\" (UID: \"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq"
Sep 10 23:43:24.843228 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.843200    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q"]
Sep 10 23:43:24.845387 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.845371    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q"
Sep 10 23:43:24.859062 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.859039    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q"]
Sep 10 23:43:24.879721 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.879694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq\" (UID: \"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq"
Sep 10 23:43:24.879853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.879737    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/519d0efe-770c-4d5f-a48c-02570ec7e7a3-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q\" (UID: \"519d0efe-770c-4d5f-a48c-02570ec7e7a3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q"
Sep 10 23:43:24.879853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.879770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5xkl\" (UniqueName: \"kubernetes.io/projected/519d0efe-770c-4d5f-a48c-02570ec7e7a3-kube-api-access-k5xkl\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q\" (UID: \"519d0efe-770c-4d5f-a48c-02570ec7e7a3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q"
Sep 10 23:43:24.879969 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.879861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wctg\" (UniqueName: \"kubernetes.io/projected/11443906-db16-4962-8fb0-82df38abbefe-kube-api-access-4wctg\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww\" (UID: \"11443906-db16-4962-8fb0-82df38abbefe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww"
Sep 10 23:43:24.879969 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.879901    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11443906-db16-4962-8fb0-82df38abbefe-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww\" (UID: \"11443906-db16-4962-8fb0-82df38abbefe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww"
Sep 10 23:43:24.879969 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.879933    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjcsn\" (UniqueName: \"kubernetes.io/projected/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-kube-api-access-sjcsn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq\" (UID: \"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq"
Sep 10 23:43:24.880122 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.879979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq\" (UID: \"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq"
Sep 10 23:43:24.880122 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.880026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11443906-db16-4962-8fb0-82df38abbefe-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww\" (UID: \"11443906-db16-4962-8fb0-82df38abbefe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww"
Sep 10 23:43:24.880122 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.880051    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/519d0efe-770c-4d5f-a48c-02570ec7e7a3-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q\" (UID: \"519d0efe-770c-4d5f-a48c-02570ec7e7a3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q"
Sep 10 23:43:24.880122 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.880101    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq\" (UID: \"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq"
Sep 10 23:43:24.880356 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.880220    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11443906-db16-4962-8fb0-82df38abbefe-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww\" (UID: \"11443906-db16-4962-8fb0-82df38abbefe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww"
Sep 10 23:43:24.880356 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.880317    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq\" (UID: \"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq"
Sep 10 23:43:24.880441 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.880368    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11443906-db16-4962-8fb0-82df38abbefe-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww\" (UID: \"11443906-db16-4962-8fb0-82df38abbefe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww"
Sep 10 23:43:24.897599 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.897573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjcsn\" (UniqueName: \"kubernetes.io/projected/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-kube-api-access-sjcsn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq\" (UID: \"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq"
Sep 10 23:43:24.897720 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.897656    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wctg\" (UniqueName: \"kubernetes.io/projected/11443906-db16-4962-8fb0-82df38abbefe-kube-api-access-4wctg\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww\" (UID: \"11443906-db16-4962-8fb0-82df38abbefe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww"
Sep 10 23:43:24.974584 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.974555    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq"
Sep 10 23:43:24.980558 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.980542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/519d0efe-770c-4d5f-a48c-02570ec7e7a3-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q\" (UID: \"519d0efe-770c-4d5f-a48c-02570ec7e7a3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q"
Sep 10 23:43:24.980616 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.980584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/519d0efe-770c-4d5f-a48c-02570ec7e7a3-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q\" (UID: \"519d0efe-770c-4d5f-a48c-02570ec7e7a3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q"
Sep 10 23:43:24.980616 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.980609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5xkl\" (UniqueName: \"kubernetes.io/projected/519d0efe-770c-4d5f-a48c-02570ec7e7a3-kube-api-access-k5xkl\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q\" (UID: \"519d0efe-770c-4d5f-a48c-02570ec7e7a3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q"
Sep 10 23:43:24.980889 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.980872    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/519d0efe-770c-4d5f-a48c-02570ec7e7a3-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q\" (UID: \"519d0efe-770c-4d5f-a48c-02570ec7e7a3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q"
Sep 10 23:43:24.980968 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.980949    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/519d0efe-770c-4d5f-a48c-02570ec7e7a3-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q\" (UID: \"519d0efe-770c-4d5f-a48c-02570ec7e7a3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q"
Sep 10 23:43:24.998608 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:24.998575    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5xkl\" (UniqueName: \"kubernetes.io/projected/519d0efe-770c-4d5f-a48c-02570ec7e7a3-kube-api-access-k5xkl\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q\" (UID: \"519d0efe-770c-4d5f-a48c-02570ec7e7a3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q"
Sep 10 23:43:25.010628 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.010596    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd"]
Sep 10 23:43:25.013449 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.013427    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd"
Sep 10 23:43:25.030445 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.030417    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd"]
Sep 10 23:43:25.051686 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.051456    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww"
Sep 10 23:43:25.081894 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.081866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d902a237-2b67-42b6-99f9-4b64633f22a1-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd\" (UID: \"d902a237-2b67-42b6-99f9-4b64633f22a1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd"
Sep 10 23:43:25.082062 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.081914    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knn5p\" (UniqueName: \"kubernetes.io/projected/d902a237-2b67-42b6-99f9-4b64633f22a1-kube-api-access-knn5p\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd\" (UID: \"d902a237-2b67-42b6-99f9-4b64633f22a1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd"
Sep 10 23:43:25.082062 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.081949    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d902a237-2b67-42b6-99f9-4b64633f22a1-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd\" (UID: \"d902a237-2b67-42b6-99f9-4b64633f22a1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd"
Sep 10 23:43:25.153548 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.153513    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q"
Sep 10 23:43:25.183344 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.183310    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d902a237-2b67-42b6-99f9-4b64633f22a1-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd\" (UID: \"d902a237-2b67-42b6-99f9-4b64633f22a1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd"
Sep 10 23:43:25.183510 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.183419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d902a237-2b67-42b6-99f9-4b64633f22a1-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd\" (UID: \"d902a237-2b67-42b6-99f9-4b64633f22a1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd"
Sep 10 23:43:25.183510 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.183488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knn5p\" (UniqueName: \"kubernetes.io/projected/d902a237-2b67-42b6-99f9-4b64633f22a1-kube-api-access-knn5p\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd\" (UID: \"d902a237-2b67-42b6-99f9-4b64633f22a1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd"
Sep 10 23:43:25.183762 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.183742    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d902a237-2b67-42b6-99f9-4b64633f22a1-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd\" (UID: \"d902a237-2b67-42b6-99f9-4b64633f22a1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd"
Sep 10 23:43:25.183762 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.183753    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d902a237-2b67-42b6-99f9-4b64633f22a1-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd\" (UID: \"d902a237-2b67-42b6-99f9-4b64633f22a1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd"
Sep 10 23:43:25.200322 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.200293    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knn5p\" (UniqueName: \"kubernetes.io/projected/d902a237-2b67-42b6-99f9-4b64633f22a1-kube-api-access-knn5p\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd\" (UID: \"d902a237-2b67-42b6-99f9-4b64633f22a1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd"
Sep 10 23:43:25.286033 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.286007    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq"]
Sep 10 23:43:25.287956 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:43:25.287929    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2c2d0f_3557_41c7_b7cf_4b8e990f0658.slice/crio-e6397dae26cc1ab55ebfb383964480d80b2b5c3aa0929d18991e5fbf3cf2f80e WatchSource:0}: Error finding container e6397dae26cc1ab55ebfb383964480d80b2b5c3aa0929d18991e5fbf3cf2f80e: Status 404 returned error can't find the container with id e6397dae26cc1ab55ebfb383964480d80b2b5c3aa0929d18991e5fbf3cf2f80e
Sep 10 23:43:25.315234 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.315204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq" event={"ID":"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658","Type":"ContainerStarted","Data":"e6397dae26cc1ab55ebfb383964480d80b2b5c3aa0929d18991e5fbf3cf2f80e"}
Sep 10 23:43:25.323431 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.323385    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd"
Sep 10 23:43:25.331799 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.331776    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww"]
Sep 10 23:43:25.341731 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:43:25.341708    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11443906_db16_4962_8fb0_82df38abbefe.slice/crio-95892465979c3f22e1ae309dd7c370c8309c2db9a3e47ae4036a3b672efaa830 WatchSource:0}: Error finding container 95892465979c3f22e1ae309dd7c370c8309c2db9a3e47ae4036a3b672efaa830: Status 404 returned error can't find the container with id 95892465979c3f22e1ae309dd7c370c8309c2db9a3e47ae4036a3b672efaa830
Sep 10 23:43:25.426961 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.426933    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q"]
Sep 10 23:43:25.481659 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:43:25.481625    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519d0efe_770c_4d5f_a48c_02570ec7e7a3.slice/crio-9bdb320eee59ba20c97219de562088977c2ddc8a198ea655081e0dcaf7ee7a7e WatchSource:0}: Error finding container 9bdb320eee59ba20c97219de562088977c2ddc8a198ea655081e0dcaf7ee7a7e: Status 404 returned error can't find the container with id 9bdb320eee59ba20c97219de562088977c2ddc8a198ea655081e0dcaf7ee7a7e
Sep 10 23:43:25.602227 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:25.602202    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd"]
Sep 10 23:43:25.647504 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:43:25.647479    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd902a237_2b67_42b6_99f9_4b64633f22a1.slice/crio-d637cb2398a2c10039e95de4d8f9a4683f03e689966479bdb5189b53b40c9de1 WatchSource:0}: Error finding container d637cb2398a2c10039e95de4d8f9a4683f03e689966479bdb5189b53b40c9de1: Status 404 returned error can't find the container with id d637cb2398a2c10039e95de4d8f9a4683f03e689966479bdb5189b53b40c9de1
Sep 10 23:43:26.321894 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:26.321862    2581 generic.go:356] "Generic (PLEG): container finished" podID="1b2c2d0f-3557-41c7-b7cf-4b8e990f0658" containerID="fbeefa48f41b5b2ef1a6344e283dff35b71f9c67b0bda879a8cd9c1a4abe657c" exitCode=0
Sep 10 23:43:26.322390 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:26.321940    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq" event={"ID":"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658","Type":"ContainerDied","Data":"fbeefa48f41b5b2ef1a6344e283dff35b71f9c67b0bda879a8cd9c1a4abe657c"}
Sep 10 23:43:26.323691 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:26.323646    2581 generic.go:356] "Generic (PLEG): container finished" podID="d902a237-2b67-42b6-99f9-4b64633f22a1" containerID="8e9d2a61400a5f64e2f840e4c83aaf9c171a2d52a0e2e1a0fcf5ad83e54a6b26" exitCode=0
Sep 10 23:43:26.323803 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:26.323707    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd" event={"ID":"d902a237-2b67-42b6-99f9-4b64633f22a1","Type":"ContainerDied","Data":"8e9d2a61400a5f64e2f840e4c83aaf9c171a2d52a0e2e1a0fcf5ad83e54a6b26"}
Sep 10 23:43:26.323803 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:26.323766    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd" event={"ID":"d902a237-2b67-42b6-99f9-4b64633f22a1","Type":"ContainerStarted","Data":"d637cb2398a2c10039e95de4d8f9a4683f03e689966479bdb5189b53b40c9de1"}
Sep 10 23:43:26.325303 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:26.325276    2581 generic.go:356] "Generic (PLEG): container finished" podID="11443906-db16-4962-8fb0-82df38abbefe" containerID="07329d83b3d68b0cccbcd946613a5a45ef298c2b093784d4fb53214240d9b504" exitCode=0
Sep 10 23:43:26.325393 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:26.325333    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww" event={"ID":"11443906-db16-4962-8fb0-82df38abbefe","Type":"ContainerDied","Data":"07329d83b3d68b0cccbcd946613a5a45ef298c2b093784d4fb53214240d9b504"}
Sep 10 23:43:26.325393 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:26.325378    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww" event={"ID":"11443906-db16-4962-8fb0-82df38abbefe","Type":"ContainerStarted","Data":"95892465979c3f22e1ae309dd7c370c8309c2db9a3e47ae4036a3b672efaa830"}
Sep 10 23:43:26.327245 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:26.327225    2581 generic.go:356] "Generic (PLEG): container finished" podID="519d0efe-770c-4d5f-a48c-02570ec7e7a3" containerID="6339bb2f1c253534529e3cdb4b53831f3354de8744df5a5b162cd5a23f390969" exitCode=0
Sep 10 23:43:26.327332 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:26.327292    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q" event={"ID":"519d0efe-770c-4d5f-a48c-02570ec7e7a3","Type":"ContainerDied","Data":"6339bb2f1c253534529e3cdb4b53831f3354de8744df5a5b162cd5a23f390969"}
Sep 10 23:43:26.327332 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:26.327317    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q" event={"ID":"519d0efe-770c-4d5f-a48c-02570ec7e7a3","Type":"ContainerStarted","Data":"9bdb320eee59ba20c97219de562088977c2ddc8a198ea655081e0dcaf7ee7a7e"}
Sep 10 23:43:27.334998 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:27.334904    2581 generic.go:356] "Generic (PLEG): container finished" podID="d902a237-2b67-42b6-99f9-4b64633f22a1" containerID="c8af19662c52bcaacaa9b49e4ec7efa2276b52d0ccab6f5744fd6c2387b91922" exitCode=0
Sep 10 23:43:27.334998 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:27.334950    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd" event={"ID":"d902a237-2b67-42b6-99f9-4b64633f22a1","Type":"ContainerDied","Data":"c8af19662c52bcaacaa9b49e4ec7efa2276b52d0ccab6f5744fd6c2387b91922"}
Sep 10 23:43:27.336959 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:27.336937    2581 generic.go:356] "Generic (PLEG): container finished" podID="11443906-db16-4962-8fb0-82df38abbefe" containerID="41e162b6cf184f71002277754ef6514cd371b23e02d1f9b042cdd1de8c960ebe" exitCode=0
Sep 10 23:43:27.337054 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:27.337030    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww" event={"ID":"11443906-db16-4962-8fb0-82df38abbefe","Type":"ContainerDied","Data":"41e162b6cf184f71002277754ef6514cd371b23e02d1f9b042cdd1de8c960ebe"}
Sep 10 23:43:27.338957 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:27.338938    2581 generic.go:356] "Generic (PLEG): container finished" podID="519d0efe-770c-4d5f-a48c-02570ec7e7a3" containerID="d22a438a6a45e6a4596613e579b36314b8630a7de4e809f5c3f9b42e20103641" exitCode=0
Sep 10 23:43:27.339053 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:27.339011    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q" event={"ID":"519d0efe-770c-4d5f-a48c-02570ec7e7a3","Type":"ContainerDied","Data":"d22a438a6a45e6a4596613e579b36314b8630a7de4e809f5c3f9b42e20103641"}
Sep 10 23:43:27.341121 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:27.341101    2581 generic.go:356] "Generic (PLEG): container finished" podID="1b2c2d0f-3557-41c7-b7cf-4b8e990f0658" containerID="879459091c99c39405c5cbcc42fe3ddf54a4b84eeb060b4da20e9f947a0abb30" exitCode=0
Sep 10 23:43:27.341223 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:27.341133    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq" event={"ID":"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658","Type":"ContainerDied","Data":"879459091c99c39405c5cbcc42fe3ddf54a4b84eeb060b4da20e9f947a0abb30"}
Sep 10 23:43:28.353932 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:28.353895    2581 generic.go:356] "Generic (PLEG): container finished" podID="519d0efe-770c-4d5f-a48c-02570ec7e7a3" containerID="7b7504c8e7e4fbba9fb2e4f98e12bcf95baf564e76f18ba047d53bb15f80b040" exitCode=0
Sep 10 23:43:28.354323 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:28.353973    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q" event={"ID":"519d0efe-770c-4d5f-a48c-02570ec7e7a3","Type":"ContainerDied","Data":"7b7504c8e7e4fbba9fb2e4f98e12bcf95baf564e76f18ba047d53bb15f80b040"}
Sep 10 23:43:28.356249 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:28.356226    2581 generic.go:356] "Generic (PLEG): container finished" podID="1b2c2d0f-3557-41c7-b7cf-4b8e990f0658" containerID="1b837fc541144ad523c3bc0dd4c98164dbe7ade40f33cfe1190d7a8d06375d43" exitCode=0
Sep 10 23:43:28.356325 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:28.356304    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq" event={"ID":"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658","Type":"ContainerDied","Data":"1b837fc541144ad523c3bc0dd4c98164dbe7ade40f33cfe1190d7a8d06375d43"}
Sep 10 23:43:28.358199 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:28.358175    2581 generic.go:356] "Generic (PLEG): container finished" podID="d902a237-2b67-42b6-99f9-4b64633f22a1" containerID="c9cb46885483ecc7890ca65ccba6ef6e334325215f6783ccdff1b9ecdaebb21d" exitCode=0
Sep 10 23:43:28.358332 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:28.358248    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd" event={"ID":"d902a237-2b67-42b6-99f9-4b64633f22a1","Type":"ContainerDied","Data":"c9cb46885483ecc7890ca65ccba6ef6e334325215f6783ccdff1b9ecdaebb21d"}
Sep 10 23:43:28.360251 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:28.360234    2581 generic.go:356] "Generic (PLEG): container finished" podID="11443906-db16-4962-8fb0-82df38abbefe" containerID="e9f3dfb699b8317aa85e07010548361c02f717b58769c4bd3180494040ae23fe" exitCode=0
Sep 10 23:43:28.360352 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:28.360274    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww" event={"ID":"11443906-db16-4962-8fb0-82df38abbefe","Type":"ContainerDied","Data":"e9f3dfb699b8317aa85e07010548361c02f717b58769c4bd3180494040ae23fe"}
Sep 10 23:43:29.519372 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.519346    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd"
Sep 10 23:43:29.572549 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.572513    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww"
Sep 10 23:43:29.576028 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.576005    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q"
Sep 10 23:43:29.579202 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.579184    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq"
Sep 10 23:43:29.622266 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.622192    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjcsn\" (UniqueName: \"kubernetes.io/projected/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-kube-api-access-sjcsn\") pod \"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658\" (UID: \"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658\") "
Sep 10 23:43:29.622266 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.622228    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/519d0efe-770c-4d5f-a48c-02570ec7e7a3-util\") pod \"519d0efe-770c-4d5f-a48c-02570ec7e7a3\" (UID: \"519d0efe-770c-4d5f-a48c-02570ec7e7a3\") "
Sep 10 23:43:29.622266 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.622253    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knn5p\" (UniqueName: \"kubernetes.io/projected/d902a237-2b67-42b6-99f9-4b64633f22a1-kube-api-access-knn5p\") pod \"d902a237-2b67-42b6-99f9-4b64633f22a1\" (UID: \"d902a237-2b67-42b6-99f9-4b64633f22a1\") "
Sep 10 23:43:29.622533 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.622299    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d902a237-2b67-42b6-99f9-4b64633f22a1-util\") pod \"d902a237-2b67-42b6-99f9-4b64633f22a1\" (UID: \"d902a237-2b67-42b6-99f9-4b64633f22a1\") "
Sep 10 23:43:29.622533 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.622323    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wctg\" (UniqueName: \"kubernetes.io/projected/11443906-db16-4962-8fb0-82df38abbefe-kube-api-access-4wctg\") pod \"11443906-db16-4962-8fb0-82df38abbefe\" (UID: \"11443906-db16-4962-8fb0-82df38abbefe\") "
Sep 10 23:43:29.622533 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.622348    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11443906-db16-4962-8fb0-82df38abbefe-util\") pod \"11443906-db16-4962-8fb0-82df38abbefe\" (UID: \"11443906-db16-4962-8fb0-82df38abbefe\") "
Sep 10 23:43:29.622533 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.622386    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/519d0efe-770c-4d5f-a48c-02570ec7e7a3-bundle\") pod \"519d0efe-770c-4d5f-a48c-02570ec7e7a3\" (UID: \"519d0efe-770c-4d5f-a48c-02570ec7e7a3\") "
Sep 10 23:43:29.622533 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.622409    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d902a237-2b67-42b6-99f9-4b64633f22a1-bundle\") pod \"d902a237-2b67-42b6-99f9-4b64633f22a1\" (UID: \"d902a237-2b67-42b6-99f9-4b64633f22a1\") "
Sep 10 23:43:29.622533 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.622435    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5xkl\" (UniqueName: \"kubernetes.io/projected/519d0efe-770c-4d5f-a48c-02570ec7e7a3-kube-api-access-k5xkl\") pod \"519d0efe-770c-4d5f-a48c-02570ec7e7a3\" (UID: \"519d0efe-770c-4d5f-a48c-02570ec7e7a3\") "
Sep 10 23:43:29.622533 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.622495    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11443906-db16-4962-8fb0-82df38abbefe-bundle\") pod \"11443906-db16-4962-8fb0-82df38abbefe\" (UID: \"11443906-db16-4962-8fb0-82df38abbefe\") "
Sep 10 23:43:29.622533 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.622528    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-bundle\") pod \"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658\" (UID: \"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658\") "
Sep 10 23:43:29.622915 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.622560    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-util\") pod \"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658\" (UID: \"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658\") "
Sep 10 23:43:29.623655 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.623619    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/519d0efe-770c-4d5f-a48c-02570ec7e7a3-bundle" (OuterVolumeSpecName: "bundle") pod "519d0efe-770c-4d5f-a48c-02570ec7e7a3" (UID: "519d0efe-770c-4d5f-a48c-02570ec7e7a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:43:29.623861 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.623832    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-bundle" (OuterVolumeSpecName: "bundle") pod "1b2c2d0f-3557-41c7-b7cf-4b8e990f0658" (UID: "1b2c2d0f-3557-41c7-b7cf-4b8e990f0658"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:43:29.624184 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.624042    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d902a237-2b67-42b6-99f9-4b64633f22a1-bundle" (OuterVolumeSpecName: "bundle") pod "d902a237-2b67-42b6-99f9-4b64633f22a1" (UID: "d902a237-2b67-42b6-99f9-4b64633f22a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:43:29.624184 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.624136    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11443906-db16-4962-8fb0-82df38abbefe-bundle" (OuterVolumeSpecName: "bundle") pod "11443906-db16-4962-8fb0-82df38abbefe" (UID: "11443906-db16-4962-8fb0-82df38abbefe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:43:29.625264 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.625236    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-kube-api-access-sjcsn" (OuterVolumeSpecName: "kube-api-access-sjcsn") pod "1b2c2d0f-3557-41c7-b7cf-4b8e990f0658" (UID: "1b2c2d0f-3557-41c7-b7cf-4b8e990f0658"). InnerVolumeSpecName "kube-api-access-sjcsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:43:29.626126 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.626101    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d902a237-2b67-42b6-99f9-4b64633f22a1-kube-api-access-knn5p" (OuterVolumeSpecName: "kube-api-access-knn5p") pod "d902a237-2b67-42b6-99f9-4b64633f22a1" (UID: "d902a237-2b67-42b6-99f9-4b64633f22a1"). InnerVolumeSpecName "kube-api-access-knn5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:43:29.626531 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.626507    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/519d0efe-770c-4d5f-a48c-02570ec7e7a3-kube-api-access-k5xkl" (OuterVolumeSpecName: "kube-api-access-k5xkl") pod "519d0efe-770c-4d5f-a48c-02570ec7e7a3" (UID: "519d0efe-770c-4d5f-a48c-02570ec7e7a3"). InnerVolumeSpecName "kube-api-access-k5xkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:43:29.627010 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.626975    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11443906-db16-4962-8fb0-82df38abbefe-kube-api-access-4wctg" (OuterVolumeSpecName: "kube-api-access-4wctg") pod "11443906-db16-4962-8fb0-82df38abbefe" (UID: "11443906-db16-4962-8fb0-82df38abbefe"). InnerVolumeSpecName "kube-api-access-4wctg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:43:29.632949 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.632897    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-util" (OuterVolumeSpecName: "util") pod "1b2c2d0f-3557-41c7-b7cf-4b8e990f0658" (UID: "1b2c2d0f-3557-41c7-b7cf-4b8e990f0658"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:43:29.633139 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.633109    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d902a237-2b67-42b6-99f9-4b64633f22a1-util" (OuterVolumeSpecName: "util") pod "d902a237-2b67-42b6-99f9-4b64633f22a1" (UID: "d902a237-2b67-42b6-99f9-4b64633f22a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:43:29.633139 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.633110    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11443906-db16-4962-8fb0-82df38abbefe-util" (OuterVolumeSpecName: "util") pod "11443906-db16-4962-8fb0-82df38abbefe" (UID: "11443906-db16-4962-8fb0-82df38abbefe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:43:29.633558 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.633366    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/519d0efe-770c-4d5f-a48c-02570ec7e7a3-util" (OuterVolumeSpecName: "util") pod "519d0efe-770c-4d5f-a48c-02570ec7e7a3" (UID: "519d0efe-770c-4d5f-a48c-02570ec7e7a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:43:29.724066 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.724034    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11443906-db16-4962-8fb0-82df38abbefe-bundle\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:43:29.724066 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.724064    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-bundle\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:43:29.724066 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.724073    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-util\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:43:29.724273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.724083    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjcsn\" (UniqueName: \"kubernetes.io/projected/1b2c2d0f-3557-41c7-b7cf-4b8e990f0658-kube-api-access-sjcsn\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:43:29.724273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.724094    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/519d0efe-770c-4d5f-a48c-02570ec7e7a3-util\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:43:29.724273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.724103    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knn5p\" (UniqueName: \"kubernetes.io/projected/d902a237-2b67-42b6-99f9-4b64633f22a1-kube-api-access-knn5p\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:43:29.724273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.724110    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d902a237-2b67-42b6-99f9-4b64633f22a1-util\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:43:29.724273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.724118    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wctg\" (UniqueName: \"kubernetes.io/projected/11443906-db16-4962-8fb0-82df38abbefe-kube-api-access-4wctg\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:43:29.724273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.724126    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11443906-db16-4962-8fb0-82df38abbefe-util\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:43:29.724273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.724134    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/519d0efe-770c-4d5f-a48c-02570ec7e7a3-bundle\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:43:29.724273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.724141    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d902a237-2b67-42b6-99f9-4b64633f22a1-bundle\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:43:29.724273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:29.724148    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5xkl\" (UniqueName: \"kubernetes.io/projected/519d0efe-770c-4d5f-a48c-02570ec7e7a3-kube-api-access-k5xkl\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:43:30.372888 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:30.372851    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq" event={"ID":"1b2c2d0f-3557-41c7-b7cf-4b8e990f0658","Type":"ContainerDied","Data":"e6397dae26cc1ab55ebfb383964480d80b2b5c3aa0929d18991e5fbf3cf2f80e"}
Sep 10 23:43:30.373078 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:30.372908    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6397dae26cc1ab55ebfb383964480d80b2b5c3aa0929d18991e5fbf3cf2f80e"
Sep 10 23:43:30.373078 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:30.372859    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc78tq"
Sep 10 23:43:30.374990 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:30.374967    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd" event={"ID":"d902a237-2b67-42b6-99f9-4b64633f22a1","Type":"ContainerDied","Data":"d637cb2398a2c10039e95de4d8f9a4683f03e689966479bdb5189b53b40c9de1"}
Sep 10 23:43:30.375099 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:30.375008    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d637cb2398a2c10039e95de4d8f9a4683f03e689966479bdb5189b53b40c9de1"
Sep 10 23:43:30.375099 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:30.374971    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnqcd"
Sep 10 23:43:30.377078 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:30.377061    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww"
Sep 10 23:43:30.377190 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:30.377081    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g2nww" event={"ID":"11443906-db16-4962-8fb0-82df38abbefe","Type":"ContainerDied","Data":"95892465979c3f22e1ae309dd7c370c8309c2db9a3e47ae4036a3b672efaa830"}
Sep 10 23:43:30.377190 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:30.377120    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95892465979c3f22e1ae309dd7c370c8309c2db9a3e47ae4036a3b672efaa830"
Sep 10 23:43:30.379113 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:30.379092    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q" event={"ID":"519d0efe-770c-4d5f-a48c-02570ec7e7a3","Type":"ContainerDied","Data":"9bdb320eee59ba20c97219de562088977c2ddc8a198ea655081e0dcaf7ee7a7e"}
Sep 10 23:43:30.379190 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:30.379127    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bdb320eee59ba20c97219de562088977c2ddc8a198ea655081e0dcaf7ee7a7e"
Sep 10 23:43:30.379190 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:30.379098    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847acjj9q"
Sep 10 23:43:34.030506 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.030464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:34.723525 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723490    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d7b78fc47-kfvrj"]
Sep 10 23:43:34.723818 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723806    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b2c2d0f-3557-41c7-b7cf-4b8e990f0658" containerName="pull"
Sep 10 23:43:34.723873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723820    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b2c2d0f-3557-41c7-b7cf-4b8e990f0658" containerName="pull"
Sep 10 23:43:34.723873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723828    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d902a237-2b67-42b6-99f9-4b64633f22a1" containerName="extract"
Sep 10 23:43:34.723873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723834    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d902a237-2b67-42b6-99f9-4b64633f22a1" containerName="extract"
Sep 10 23:43:34.723873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723841    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11443906-db16-4962-8fb0-82df38abbefe" containerName="extract"
Sep 10 23:43:34.723873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723846    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="11443906-db16-4962-8fb0-82df38abbefe" containerName="extract"
Sep 10 23:43:34.723873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723853    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11443906-db16-4962-8fb0-82df38abbefe" containerName="util"
Sep 10 23:43:34.723873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723858    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="11443906-db16-4962-8fb0-82df38abbefe" containerName="util"
Sep 10 23:43:34.723873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723869    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519d0efe-770c-4d5f-a48c-02570ec7e7a3" containerName="extract"
Sep 10 23:43:34.723873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723873    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="519d0efe-770c-4d5f-a48c-02570ec7e7a3" containerName="extract"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723880    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d902a237-2b67-42b6-99f9-4b64633f22a1" containerName="util"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723886    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d902a237-2b67-42b6-99f9-4b64633f22a1" containerName="util"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723891    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b2c2d0f-3557-41c7-b7cf-4b8e990f0658" containerName="util"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723896    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b2c2d0f-3557-41c7-b7cf-4b8e990f0658" containerName="util"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723903    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11443906-db16-4962-8fb0-82df38abbefe" containerName="pull"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723907    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="11443906-db16-4962-8fb0-82df38abbefe" containerName="pull"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723915    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d902a237-2b67-42b6-99f9-4b64633f22a1" containerName="pull"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723919    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d902a237-2b67-42b6-99f9-4b64633f22a1" containerName="pull"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723924    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b2c2d0f-3557-41c7-b7cf-4b8e990f0658" containerName="extract"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723929    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b2c2d0f-3557-41c7-b7cf-4b8e990f0658" containerName="extract"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723934    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519d0efe-770c-4d5f-a48c-02570ec7e7a3" containerName="pull"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723938    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="519d0efe-770c-4d5f-a48c-02570ec7e7a3" containerName="pull"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723943    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519d0efe-770c-4d5f-a48c-02570ec7e7a3" containerName="util"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723948    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="519d0efe-770c-4d5f-a48c-02570ec7e7a3" containerName="util"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.723992    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b2c2d0f-3557-41c7-b7cf-4b8e990f0658" containerName="extract"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.724000    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d902a237-2b67-42b6-99f9-4b64633f22a1" containerName="extract"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.724007    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="11443906-db16-4962-8fb0-82df38abbefe" containerName="extract"
Sep 10 23:43:34.724165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.724013    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="519d0efe-770c-4d5f-a48c-02570ec7e7a3" containerName="extract"
Sep 10 23:43:34.727049 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.727034    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.741540 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.741517    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7b78fc47-kfvrj"]
Sep 10 23:43:34.797800 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.797763    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:34.866297 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.866260    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxsjz\" (UniqueName: \"kubernetes.io/projected/2b94b452-7aa9-442b-86f2-816e1e38de53-kube-api-access-xxsjz\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.866465 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.866323    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b94b452-7aa9-442b-86f2-816e1e38de53-oauth-serving-cert\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.866465 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.866391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b94b452-7aa9-442b-86f2-816e1e38de53-console-config\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.866465 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.866420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b94b452-7aa9-442b-86f2-816e1e38de53-console-oauth-config\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.866576 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.866482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b94b452-7aa9-442b-86f2-816e1e38de53-trusted-ca-bundle\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.866576 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.866511    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b94b452-7aa9-442b-86f2-816e1e38de53-service-ca\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.866576 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.866530    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b94b452-7aa9-442b-86f2-816e1e38de53-console-serving-cert\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.898305 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.898256    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:34.967516 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.967482    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxsjz\" (UniqueName: \"kubernetes.io/projected/2b94b452-7aa9-442b-86f2-816e1e38de53-kube-api-access-xxsjz\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.967731 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.967541    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b94b452-7aa9-442b-86f2-816e1e38de53-oauth-serving-cert\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.967731 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.967652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b94b452-7aa9-442b-86f2-816e1e38de53-console-config\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.967731 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.967717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b94b452-7aa9-442b-86f2-816e1e38de53-console-oauth-config\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.967871 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.967760    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b94b452-7aa9-442b-86f2-816e1e38de53-trusted-ca-bundle\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.967871 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.967794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b94b452-7aa9-442b-86f2-816e1e38de53-service-ca\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.968216 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.968193    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b94b452-7aa9-442b-86f2-816e1e38de53-console-serving-cert\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.974970 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.968794    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b94b452-7aa9-442b-86f2-816e1e38de53-console-config\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.974970 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.968798    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b94b452-7aa9-442b-86f2-816e1e38de53-oauth-serving-cert\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.974970 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.969339    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b94b452-7aa9-442b-86f2-816e1e38de53-service-ca\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.974970 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.970357    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b94b452-7aa9-442b-86f2-816e1e38de53-trusted-ca-bundle\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.974970 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.971210    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b94b452-7aa9-442b-86f2-816e1e38de53-console-oauth-config\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.974970 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.971491    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b94b452-7aa9-442b-86f2-816e1e38de53-console-serving-cert\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:34.976698 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:34.976646    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxsjz\" (UniqueName: \"kubernetes.io/projected/2b94b452-7aa9-442b-86f2-816e1e38de53-kube-api-access-xxsjz\") pod \"console-6d7b78fc47-kfvrj\" (UID: \"2b94b452-7aa9-442b-86f2-816e1e38de53\") " pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:35.037205 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:35.037179    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:35.311892 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:35.311855    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7b78fc47-kfvrj"]
Sep 10 23:43:35.313326 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:43:35.313300    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b94b452_7aa9_442b_86f2_816e1e38de53.slice/crio-43c336ff0b0cfbf0d727727ce265e262ff21270abf10defadffd3f188c1eeadd WatchSource:0}: Error finding container 43c336ff0b0cfbf0d727727ce265e262ff21270abf10defadffd3f188c1eeadd: Status 404 returned error can't find the container with id 43c336ff0b0cfbf0d727727ce265e262ff21270abf10defadffd3f188c1eeadd
Sep 10 23:43:35.408390 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:35.408356    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7b78fc47-kfvrj" event={"ID":"2b94b452-7aa9-442b-86f2-816e1e38de53","Type":"ContainerStarted","Data":"2ea126accb2c26be2a2911ed8de0d84747f2e5648b72273282901e5fa17193df"}
Sep 10 23:43:35.408555 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:35.408413    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7b78fc47-kfvrj" event={"ID":"2b94b452-7aa9-442b-86f2-816e1e38de53","Type":"ContainerStarted","Data":"43c336ff0b0cfbf0d727727ce265e262ff21270abf10defadffd3f188c1eeadd"}
Sep 10 23:43:35.430871 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:35.430824    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d7b78fc47-kfvrj" podStartSLOduration=1.430808079 podStartE2EDuration="1.430808079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:43:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:43:35.430012198 +0000 UTC m=+415.470881503" watchObservedRunningTime="2026-09-10 23:43:35.430808079 +0000 UTC m=+415.471677384"
Sep 10 23:43:37.272761 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:37.272725    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-zr8lv"]
Sep 10 23:43:37.276014 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:37.275997    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-zr8lv"
Sep 10 23:43:37.281449 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:37.281422    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 23:43:37.281597 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:37.281467    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dn9db\""
Sep 10 23:43:37.282385 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:37.282368    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 23:43:37.296617 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:37.296590    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-zr8lv"]
Sep 10 23:43:37.389095 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:37.389062    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv4q7\" (UniqueName: \"kubernetes.io/projected/00503007-5080-4b58-b417-2e56da51cc4c-kube-api-access-wv4q7\") pod \"authorino-operator-76b478bd78-zr8lv\" (UID: \"00503007-5080-4b58-b417-2e56da51cc4c\") " pod="kuadrant-system/authorino-operator-76b478bd78-zr8lv"
Sep 10 23:43:37.490497 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:37.490464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv4q7\" (UniqueName: \"kubernetes.io/projected/00503007-5080-4b58-b417-2e56da51cc4c-kube-api-access-wv4q7\") pod \"authorino-operator-76b478bd78-zr8lv\" (UID: \"00503007-5080-4b58-b417-2e56da51cc4c\") " pod="kuadrant-system/authorino-operator-76b478bd78-zr8lv"
Sep 10 23:43:37.508461 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:37.508433    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv4q7\" (UniqueName: \"kubernetes.io/projected/00503007-5080-4b58-b417-2e56da51cc4c-kube-api-access-wv4q7\") pod \"authorino-operator-76b478bd78-zr8lv\" (UID: \"00503007-5080-4b58-b417-2e56da51cc4c\") " pod="kuadrant-system/authorino-operator-76b478bd78-zr8lv"
Sep 10 23:43:37.586321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:37.586255    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-zr8lv"
Sep 10 23:43:37.849374 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:37.849298    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:37.871653 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:37.871625    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-zr8lv"]
Sep 10 23:43:37.875320 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:43:37.875297    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00503007_5080_4b58_b417_2e56da51cc4c.slice/crio-4b2823c256338c52ecd931e997d68431940019482296ea71b5735c5dd6869f74 WatchSource:0}: Error finding container 4b2823c256338c52ecd931e997d68431940019482296ea71b5735c5dd6869f74: Status 404 returned error can't find the container with id 4b2823c256338c52ecd931e997d68431940019482296ea71b5735c5dd6869f74
Sep 10 23:43:38.005398 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:38.005352    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:38.426940 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:38.426887    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-zr8lv" event={"ID":"00503007-5080-4b58-b417-2e56da51cc4c","Type":"ContainerStarted","Data":"4b2823c256338c52ecd931e997d68431940019482296ea71b5735c5dd6869f74"}
Sep 10 23:43:39.481770 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:39.481737    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"]
Sep 10 23:43:39.491446 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:39.491422    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"
Sep 10 23:43:39.494349 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:39.494301    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-4fz9t\""
Sep 10 23:43:39.496469 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:39.496399    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"]
Sep 10 23:43:39.611297 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:39.611254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpwn6\" (UniqueName: \"kubernetes.io/projected/93881622-90ee-4803-8ee2-88a6b37f9d76-kube-api-access-kpwn6\") pod \"limitador-operator-controller-manager-74495c69f8-gdczb\" (UID: \"93881622-90ee-4803-8ee2-88a6b37f9d76\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"
Sep 10 23:43:39.712049 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:39.712004    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpwn6\" (UniqueName: \"kubernetes.io/projected/93881622-90ee-4803-8ee2-88a6b37f9d76-kube-api-access-kpwn6\") pod \"limitador-operator-controller-manager-74495c69f8-gdczb\" (UID: \"93881622-90ee-4803-8ee2-88a6b37f9d76\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"
Sep 10 23:43:39.720784 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:39.720755    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpwn6\" (UniqueName: \"kubernetes.io/projected/93881622-90ee-4803-8ee2-88a6b37f9d76-kube-api-access-kpwn6\") pod \"limitador-operator-controller-manager-74495c69f8-gdczb\" (UID: \"93881622-90ee-4803-8ee2-88a6b37f9d76\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"
Sep 10 23:43:39.805572 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:39.805492    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"
Sep 10 23:43:39.837134 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:39.837090    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:39.996215 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:39.996181    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:40.274645 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:40.274611    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"]
Sep 10 23:43:40.277608 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:43:40.277584    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93881622_90ee_4803_8ee2_88a6b37f9d76.slice/crio-310cb8f58144342b90df5093371ebcbc98dc070d8d136600de0c417dac6e3f9c WatchSource:0}: Error finding container 310cb8f58144342b90df5093371ebcbc98dc070d8d136600de0c417dac6e3f9c: Status 404 returned error can't find the container with id 310cb8f58144342b90df5093371ebcbc98dc070d8d136600de0c417dac6e3f9c
Sep 10 23:43:40.437409 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:40.437325    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb" event={"ID":"93881622-90ee-4803-8ee2-88a6b37f9d76","Type":"ContainerStarted","Data":"310cb8f58144342b90df5093371ebcbc98dc070d8d136600de0c417dac6e3f9c"}
Sep 10 23:43:40.438986 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:40.438961    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-zr8lv" event={"ID":"00503007-5080-4b58-b417-2e56da51cc4c","Type":"ContainerStarted","Data":"13caae0f9edc0b3673f90c345968d1a8acaf281682708e6416a5cc9e1f4477bb"}
Sep 10 23:43:40.439109 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:40.439093    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-zr8lv"
Sep 10 23:43:40.459835 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:40.459790    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-zr8lv" podStartSLOduration=1.2724121720000001 podStartE2EDuration="3.459776127s" totalImagesPullingTime="2.187363955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:43:40.458432751 +0000 UTC m=+420.499302055" watchObservedRunningTime="2026-09-10 23:43:40.459776127 +0000 UTC m=+420.500645433"
Sep 10 23:43:40.592538 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:40.592505    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:40.826902 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:40.826872    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:40.919527 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:40.919490    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:41.021603 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:41.021570    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:41.124309 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:41.124225    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:42.451467 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:42.451435    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb" event={"ID":"93881622-90ee-4803-8ee2-88a6b37f9d76","Type":"ContainerStarted","Data":"d32b02fc5f10c31ffaf47826c33241e104fb89e2d8f08cafbb889455aa20f5bc"}
Sep 10 23:43:42.451856 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:42.451541    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"
Sep 10 23:43:42.480761 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:42.480716    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb" podStartSLOduration=2.142263316 podStartE2EDuration="3.480696365s" totalImagesPullingTime="1.338433049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:43:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:43:42.478372761 +0000 UTC m=+422.519242066" watchObservedRunningTime="2026-09-10 23:43:42.480696365 +0000 UTC m=+422.521565671"
Sep 10 23:43:44.006210 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:44.006176    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"]
Sep 10 23:43:44.011937 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:44.011814    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:43:44.015454 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:44.015431    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-55njz\""
Sep 10 23:43:44.030028 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:44.029996    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"]
Sep 10 23:43:44.146476 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:44.146443    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrqlg\" (UniqueName: \"kubernetes.io/projected/6c8644e1-5665-4f4f-80db-ece53608a06d-kube-api-access-qrqlg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nsg69\" (UID: \"6c8644e1-5665-4f4f-80db-ece53608a06d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:43:44.146659 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:44.146496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c8644e1-5665-4f4f-80db-ece53608a06d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nsg69\" (UID: \"6c8644e1-5665-4f4f-80db-ece53608a06d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:43:44.247796 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:44.247756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrqlg\" (UniqueName: \"kubernetes.io/projected/6c8644e1-5665-4f4f-80db-ece53608a06d-kube-api-access-qrqlg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nsg69\" (UID: \"6c8644e1-5665-4f4f-80db-ece53608a06d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:43:44.247968 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:44.247824    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c8644e1-5665-4f4f-80db-ece53608a06d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nsg69\" (UID: \"6c8644e1-5665-4f4f-80db-ece53608a06d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:43:44.248203 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:44.248183    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c8644e1-5665-4f4f-80db-ece53608a06d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nsg69\" (UID: \"6c8644e1-5665-4f4f-80db-ece53608a06d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:43:44.264296 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:44.264232    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrqlg\" (UniqueName: \"kubernetes.io/projected/6c8644e1-5665-4f4f-80db-ece53608a06d-kube-api-access-qrqlg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nsg69\" (UID: \"6c8644e1-5665-4f4f-80db-ece53608a06d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:43:44.323390 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:44.323356    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:43:44.444438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:44.444391    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:44.608741 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:44.608715    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"]
Sep 10 23:43:44.611655 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:43:44.611626    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8644e1_5665_4f4f_80db_ece53608a06d.slice/crio-2f1c4bd3fe1e0cd2bff00ce0e3e593931b46e8e5e33589755c4727825d52db4e WatchSource:0}: Error finding container 2f1c4bd3fe1e0cd2bff00ce0e3e593931b46e8e5e33589755c4727825d52db4e: Status 404 returned error can't find the container with id 2f1c4bd3fe1e0cd2bff00ce0e3e593931b46e8e5e33589755c4727825d52db4e
Sep 10 23:43:45.037521 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:45.037486    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:45.038019 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:45.037558    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:45.042440 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:45.042418    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:45.113571 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:45.113540    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:45.468776 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:45.468731    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69" event={"ID":"6c8644e1-5665-4f4f-80db-ece53608a06d","Type":"ContainerStarted","Data":"2f1c4bd3fe1e0cd2bff00ce0e3e593931b46e8e5e33589755c4727825d52db4e"}
Sep 10 23:43:45.473795 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:45.473767    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d7b78fc47-kfvrj"
Sep 10 23:43:45.536880 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:45.536849    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-546bd7c44f-fvp8g"]
Sep 10 23:43:45.694855 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:45.694796    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:45.803312 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:45.803214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:45.889807 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:45.889770    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:46.415395 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:46.415354    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:46.516905 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:46.516871    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:47.418339 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:47.418286    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:47.511124 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:47.511089    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:47.851013 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:47.850979    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:47.958516 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:47.958490    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:48.493036 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:48.493001    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69" event={"ID":"6c8644e1-5665-4f4f-80db-ece53608a06d","Type":"ContainerStarted","Data":"96c6870f0f768d8d40e30759597953d0725d076fff0fe9e2cf7568b5d1468106"}
Sep 10 23:43:48.493421 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:48.493112    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:43:48.514853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:48.514803    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69" podStartSLOduration=2.072874778 podStartE2EDuration="5.514787266s" totalImagesPullingTime="3.441912488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:43:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:43:48.513223442 +0000 UTC m=+428.554092748" watchObservedRunningTime="2026-09-10 23:43:48.514787266 +0000 UTC m=+428.555656571"
Sep 10 23:43:50.772935 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:50.772903    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:50.993424 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:50.993389    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:51.094163 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:51.094071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:51.219655 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:51.219621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:51.448337 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:51.448261    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-zr8lv"
Sep 10 23:43:53.459391 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:53.459364    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"
Sep 10 23:43:54.882464 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:54.882429    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:54.975536 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:54.975496    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:43:59.500975 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:43:59.500944    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:44:00.990046 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:00.990015    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xqpfj"]
Sep 10 23:44:00.994807 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:00.994784    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xqpfj"
Sep 10 23:44:01.022986 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.022955    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xqpfj"]
Sep 10 23:44:01.093335 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.093301    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4655b7e-eb70-4f04-b727-610bb9f18dc4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xqpfj\" (UID: \"c4655b7e-eb70-4f04-b727-610bb9f18dc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xqpfj"
Sep 10 23:44:01.093335 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.093339    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dplwm\" (UniqueName: \"kubernetes.io/projected/c4655b7e-eb70-4f04-b727-610bb9f18dc4-kube-api-access-dplwm\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xqpfj\" (UID: \"c4655b7e-eb70-4f04-b727-610bb9f18dc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xqpfj"
Sep 10 23:44:01.104078 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.104049    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xqpfj"]
Sep 10 23:44:01.104306 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:44:01.104289    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-dplwm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xqpfj" podUID="c4655b7e-eb70-4f04-b727-610bb9f18dc4"
Sep 10 23:44:01.194226 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.194185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4655b7e-eb70-4f04-b727-610bb9f18dc4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xqpfj\" (UID: \"c4655b7e-eb70-4f04-b727-610bb9f18dc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xqpfj"
Sep 10 23:44:01.194226 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.194227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dplwm\" (UniqueName: \"kubernetes.io/projected/c4655b7e-eb70-4f04-b727-610bb9f18dc4-kube-api-access-dplwm\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xqpfj\" (UID: \"c4655b7e-eb70-4f04-b727-610bb9f18dc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xqpfj"
Sep 10 23:44:01.194627 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.194604    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4655b7e-eb70-4f04-b727-610bb9f18dc4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xqpfj\" (UID: \"c4655b7e-eb70-4f04-b727-610bb9f18dc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xqpfj"
Sep 10 23:44:01.206694 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.206652    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dplwm\" (UniqueName: \"kubernetes.io/projected/c4655b7e-eb70-4f04-b727-610bb9f18dc4-kube-api-access-dplwm\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xqpfj\" (UID: \"c4655b7e-eb70-4f04-b727-610bb9f18dc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xqpfj"
Sep 10 23:44:01.379483 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.379398    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:01.478597 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.478559    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:01.558422 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.558357    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xqpfj"
Sep 10 23:44:01.566891 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.566864    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xqpfj"
Sep 10 23:44:01.697902 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.697811    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4655b7e-eb70-4f04-b727-610bb9f18dc4-extensions-socket-volume\") pod \"c4655b7e-eb70-4f04-b727-610bb9f18dc4\" (UID: \"c4655b7e-eb70-4f04-b727-610bb9f18dc4\") "
Sep 10 23:44:01.697902 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.697890    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dplwm\" (UniqueName: \"kubernetes.io/projected/c4655b7e-eb70-4f04-b727-610bb9f18dc4-kube-api-access-dplwm\") pod \"c4655b7e-eb70-4f04-b727-610bb9f18dc4\" (UID: \"c4655b7e-eb70-4f04-b727-610bb9f18dc4\") "
Sep 10 23:44:01.698099 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.698071    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4655b7e-eb70-4f04-b727-610bb9f18dc4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c4655b7e-eb70-4f04-b727-610bb9f18dc4" (UID: "c4655b7e-eb70-4f04-b727-610bb9f18dc4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:44:01.700170 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.700137    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4655b7e-eb70-4f04-b727-610bb9f18dc4-kube-api-access-dplwm" (OuterVolumeSpecName: "kube-api-access-dplwm") pod "c4655b7e-eb70-4f04-b727-610bb9f18dc4" (UID: "c4655b7e-eb70-4f04-b727-610bb9f18dc4"). InnerVolumeSpecName "kube-api-access-dplwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:44:01.791718 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.791688    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xqpfj"]
Sep 10 23:44:01.798621 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.798596    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4655b7e-eb70-4f04-b727-610bb9f18dc4-extensions-socket-volume\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:44:01.798621 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.798622    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dplwm\" (UniqueName: \"kubernetes.io/projected/c4655b7e-eb70-4f04-b727-610bb9f18dc4-kube-api-access-dplwm\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:44:01.800968 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.800943    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xqpfj"]
Sep 10 23:44:01.816390 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.816355    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"]
Sep 10 23:44:01.816587 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.816564    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69" podUID="6c8644e1-5665-4f4f-80db-ece53608a06d" containerName="manager" containerID="cri-o://96c6870f0f768d8d40e30759597953d0725d076fff0fe9e2cf7568b5d1468106" gracePeriod=2
Sep 10 23:44:01.832663 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.832632    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"]
Sep 10 23:44:01.849723 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.849683    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"]
Sep 10 23:44:01.849989 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.849960    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb" podUID="93881622-90ee-4803-8ee2-88a6b37f9d76" containerName="manager" containerID="cri-o://d32b02fc5f10c31ffaf47826c33241e104fb89e2d8f08cafbb889455aa20f5bc" gracePeriod=2
Sep 10 23:44:01.856376 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.856347    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"]
Sep 10 23:44:01.856748 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.856732    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c8644e1-5665-4f4f-80db-ece53608a06d" containerName="manager"
Sep 10 23:44:01.856802 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.856750    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c8644e1-5665-4f4f-80db-ece53608a06d" containerName="manager"
Sep 10 23:44:01.856853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.856817    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c8644e1-5665-4f4f-80db-ece53608a06d" containerName="manager"
Sep 10 23:44:01.858527 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:44:01.858484    2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6c8644e1-5665-4f4f-80db-ece53608a06d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-nsg69\": pods \"kuadrant-operator-controller-manager-76f8f686bf-nsg69\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:44:01.860771 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.860745    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"]
Sep 10 23:44:01.860877 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.860860    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"
Sep 10 23:44:01.861093 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:44:01.861068    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-gdczb\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="93881622-90ee-4803-8ee2-88a6b37f9d76" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"
Sep 10 23:44:01.863157 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:44:01.863136    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nsg69\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="6c8644e1-5665-4f4f-80db-ece53608a06d" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:44:01.865094 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:44:01.865064    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-gdczb\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="93881622-90ee-4803-8ee2-88a6b37f9d76" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"
Sep 10 23:44:01.867905 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:44:01.867866    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nsg69\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="6c8644e1-5665-4f4f-80db-ece53608a06d" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:44:01.878470 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.878442    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"]
Sep 10 23:44:01.897312 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.897286    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bbn8x"]
Sep 10 23:44:01.898109 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.898055    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93881622-90ee-4803-8ee2-88a6b37f9d76" containerName="manager"
Sep 10 23:44:01.898109 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.898087    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="93881622-90ee-4803-8ee2-88a6b37f9d76" containerName="manager"
Sep 10 23:44:01.898341 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.898286    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="93881622-90ee-4803-8ee2-88a6b37f9d76" containerName="manager"
Sep 10 23:44:01.903330 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.903308    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bbn8x"
Sep 10 23:44:01.912963 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:01.912933    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bbn8x"]
Sep 10 23:44:01.931363 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:44:01.931332    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-gdczb\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="93881622-90ee-4803-8ee2-88a6b37f9d76" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"
Sep 10 23:44:01.933190 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:44:01.933162    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nsg69\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="6c8644e1-5665-4f4f-80db-ece53608a06d" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:44:02.000290 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.000255    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-tzp46\" (UID: \"7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"
Sep 10 23:44:02.000721 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.000303    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wh7r\" (UniqueName: \"kubernetes.io/projected/7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb-kube-api-access-9wh7r\") pod \"kuadrant-operator-controller-manager-76f8f686bf-tzp46\" (UID: \"7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"
Sep 10 23:44:02.081298 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.081269    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:44:02.083537 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:44:02.083503    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-gdczb\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="93881622-90ee-4803-8ee2-88a6b37f9d76" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"
Sep 10 23:44:02.085290 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:44:02.085267    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nsg69\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="6c8644e1-5665-4f4f-80db-ece53608a06d" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:44:02.089151 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.089124    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"
Sep 10 23:44:02.091194 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:44:02.091173    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-gdczb\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="93881622-90ee-4803-8ee2-88a6b37f9d76" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"
Sep 10 23:44:02.093024 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:44:02.093004    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nsg69\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="6c8644e1-5665-4f4f-80db-ece53608a06d" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:44:02.101390 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.101364    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-tzp46\" (UID: \"7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"
Sep 10 23:44:02.101493 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.101407    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wh7r\" (UniqueName: \"kubernetes.io/projected/7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb-kube-api-access-9wh7r\") pod \"kuadrant-operator-controller-manager-76f8f686bf-tzp46\" (UID: \"7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"
Sep 10 23:44:02.101493 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.101476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psbgl\" (UniqueName: \"kubernetes.io/projected/128b9ff1-6e85-4e87-b4b3-24eccd54c85b-kube-api-access-psbgl\") pod \"limitador-operator-controller-manager-74495c69f8-bbn8x\" (UID: \"128b9ff1-6e85-4e87-b4b3-24eccd54c85b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bbn8x"
Sep 10 23:44:02.101770 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.101750    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-tzp46\" (UID: \"7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"
Sep 10 23:44:02.116083 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.116053    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wh7r\" (UniqueName: \"kubernetes.io/projected/7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb-kube-api-access-9wh7r\") pod \"kuadrant-operator-controller-manager-76f8f686bf-tzp46\" (UID: \"7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"
Sep 10 23:44:02.202767 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.202730    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c8644e1-5665-4f4f-80db-ece53608a06d-extensions-socket-volume\") pod \"6c8644e1-5665-4f4f-80db-ece53608a06d\" (UID: \"6c8644e1-5665-4f4f-80db-ece53608a06d\") "
Sep 10 23:44:02.202957 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.202799    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrqlg\" (UniqueName: \"kubernetes.io/projected/6c8644e1-5665-4f4f-80db-ece53608a06d-kube-api-access-qrqlg\") pod \"6c8644e1-5665-4f4f-80db-ece53608a06d\" (UID: \"6c8644e1-5665-4f4f-80db-ece53608a06d\") "
Sep 10 23:44:02.202957 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.202846    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpwn6\" (UniqueName: \"kubernetes.io/projected/93881622-90ee-4803-8ee2-88a6b37f9d76-kube-api-access-kpwn6\") pod \"93881622-90ee-4803-8ee2-88a6b37f9d76\" (UID: \"93881622-90ee-4803-8ee2-88a6b37f9d76\") "
Sep 10 23:44:02.203089 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.203015    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psbgl\" (UniqueName: \"kubernetes.io/projected/128b9ff1-6e85-4e87-b4b3-24eccd54c85b-kube-api-access-psbgl\") pod \"limitador-operator-controller-manager-74495c69f8-bbn8x\" (UID: \"128b9ff1-6e85-4e87-b4b3-24eccd54c85b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bbn8x"
Sep 10 23:44:02.203304 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.203277    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c8644e1-5665-4f4f-80db-ece53608a06d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6c8644e1-5665-4f4f-80db-ece53608a06d" (UID: "6c8644e1-5665-4f4f-80db-ece53608a06d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:44:02.205285 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.205260    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c8644e1-5665-4f4f-80db-ece53608a06d-kube-api-access-qrqlg" (OuterVolumeSpecName: "kube-api-access-qrqlg") pod "6c8644e1-5665-4f4f-80db-ece53608a06d" (UID: "6c8644e1-5665-4f4f-80db-ece53608a06d"). InnerVolumeSpecName "kube-api-access-qrqlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:44:02.205352 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.205289    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93881622-90ee-4803-8ee2-88a6b37f9d76-kube-api-access-kpwn6" (OuterVolumeSpecName: "kube-api-access-kpwn6") pod "93881622-90ee-4803-8ee2-88a6b37f9d76" (UID: "93881622-90ee-4803-8ee2-88a6b37f9d76"). InnerVolumeSpecName "kube-api-access-kpwn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:44:02.223181 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.223151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psbgl\" (UniqueName: \"kubernetes.io/projected/128b9ff1-6e85-4e87-b4b3-24eccd54c85b-kube-api-access-psbgl\") pod \"limitador-operator-controller-manager-74495c69f8-bbn8x\" (UID: \"128b9ff1-6e85-4e87-b4b3-24eccd54c85b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bbn8x"
Sep 10 23:44:02.245481 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.245446    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"
Sep 10 23:44:02.250423 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.250403    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bbn8x"
Sep 10 23:44:02.304938 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.304456    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c8644e1-5665-4f4f-80db-ece53608a06d-extensions-socket-volume\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:44:02.304938 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.304513    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrqlg\" (UniqueName: \"kubernetes.io/projected/6c8644e1-5665-4f4f-80db-ece53608a06d-kube-api-access-qrqlg\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:44:02.304938 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.304531    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpwn6\" (UniqueName: \"kubernetes.io/projected/93881622-90ee-4803-8ee2-88a6b37f9d76-kube-api-access-kpwn6\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:44:02.483643 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.483567    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c8644e1-5665-4f4f-80db-ece53608a06d" path="/var/lib/kubelet/pods/6c8644e1-5665-4f4f-80db-ece53608a06d/volumes"
Sep 10 23:44:02.483943 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.483929    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93881622-90ee-4803-8ee2-88a6b37f9d76" path="/var/lib/kubelet/pods/93881622-90ee-4803-8ee2-88a6b37f9d76/volumes"
Sep 10 23:44:02.484249 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.484225    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4655b7e-eb70-4f04-b727-610bb9f18dc4" path="/var/lib/kubelet/pods/c4655b7e-eb70-4f04-b727-610bb9f18dc4/volumes"
Sep 10 23:44:02.539598 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.539574    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"]
Sep 10 23:44:02.541501 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:44:02.541475    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2aa8a9_5f0c_46e8_a2cd_58ddb4c249cb.slice/crio-2ba64f931be446c940d6f324e636b8a872bc7d69d122317f6fc8efec95bbbb9f WatchSource:0}: Error finding container 2ba64f931be446c940d6f324e636b8a872bc7d69d122317f6fc8efec95bbbb9f: Status 404 returned error can't find the container with id 2ba64f931be446c940d6f324e636b8a872bc7d69d122317f6fc8efec95bbbb9f
Sep 10 23:44:02.549848 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.549824    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bbn8x"]
Sep 10 23:44:02.552630 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:44:02.552606    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128b9ff1_6e85_4e87_b4b3_24eccd54c85b.slice/crio-9a169695bc7b7f570fb269860d3f930a97bfe1305e59122d2cc94a87abdc9493 WatchSource:0}: Error finding container 9a169695bc7b7f570fb269860d3f930a97bfe1305e59122d2cc94a87abdc9493: Status 404 returned error can't find the container with id 9a169695bc7b7f570fb269860d3f930a97bfe1305e59122d2cc94a87abdc9493
Sep 10 23:44:02.570562 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.570532    2581 generic.go:356] "Generic (PLEG): container finished" podID="93881622-90ee-4803-8ee2-88a6b37f9d76" containerID="d32b02fc5f10c31ffaf47826c33241e104fb89e2d8f08cafbb889455aa20f5bc" exitCode=0
Sep 10 23:44:02.570707 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.570597    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gdczb"
Sep 10 23:44:02.570707 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.570623    2581 scope.go:117] "RemoveContainer" containerID="d32b02fc5f10c31ffaf47826c33241e104fb89e2d8f08cafbb889455aa20f5bc"
Sep 10 23:44:02.572999 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.572691    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46" event={"ID":"7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb","Type":"ContainerStarted","Data":"2ba64f931be446c940d6f324e636b8a872bc7d69d122317f6fc8efec95bbbb9f"}
Sep 10 23:44:02.574337 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.574312    2581 generic.go:356] "Generic (PLEG): container finished" podID="6c8644e1-5665-4f4f-80db-ece53608a06d" containerID="96c6870f0f768d8d40e30759597953d0725d076fff0fe9e2cf7568b5d1468106" exitCode=0
Sep 10 23:44:02.574449 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.574391    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nsg69"
Sep 10 23:44:02.575853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.575825    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xqpfj"
Sep 10 23:44:02.575950 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.575854    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bbn8x" event={"ID":"128b9ff1-6e85-4e87-b4b3-24eccd54c85b","Type":"ContainerStarted","Data":"9a169695bc7b7f570fb269860d3f930a97bfe1305e59122d2cc94a87abdc9493"}
Sep 10 23:44:02.588637 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.588544    2581 scope.go:117] "RemoveContainer" containerID="d32b02fc5f10c31ffaf47826c33241e104fb89e2d8f08cafbb889455aa20f5bc"
Sep 10 23:44:02.589103 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:44:02.589072    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d32b02fc5f10c31ffaf47826c33241e104fb89e2d8f08cafbb889455aa20f5bc\": container with ID starting with d32b02fc5f10c31ffaf47826c33241e104fb89e2d8f08cafbb889455aa20f5bc not found: ID does not exist" containerID="d32b02fc5f10c31ffaf47826c33241e104fb89e2d8f08cafbb889455aa20f5bc"
Sep 10 23:44:02.589200 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.589106    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d32b02fc5f10c31ffaf47826c33241e104fb89e2d8f08cafbb889455aa20f5bc"} err="failed to get container status \"d32b02fc5f10c31ffaf47826c33241e104fb89e2d8f08cafbb889455aa20f5bc\": rpc error: code = NotFound desc = could not find container \"d32b02fc5f10c31ffaf47826c33241e104fb89e2d8f08cafbb889455aa20f5bc\": container with ID starting with d32b02fc5f10c31ffaf47826c33241e104fb89e2d8f08cafbb889455aa20f5bc not found: ID does not exist"
Sep 10 23:44:02.589200 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.589137    2581 scope.go:117] "RemoveContainer" containerID="96c6870f0f768d8d40e30759597953d0725d076fff0fe9e2cf7568b5d1468106"
Sep 10 23:44:02.599661 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.599643    2581 scope.go:117] "RemoveContainer" containerID="96c6870f0f768d8d40e30759597953d0725d076fff0fe9e2cf7568b5d1468106"
Sep 10 23:44:02.600018 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:44:02.599998    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96c6870f0f768d8d40e30759597953d0725d076fff0fe9e2cf7568b5d1468106\": container with ID starting with 96c6870f0f768d8d40e30759597953d0725d076fff0fe9e2cf7568b5d1468106 not found: ID does not exist" containerID="96c6870f0f768d8d40e30759597953d0725d076fff0fe9e2cf7568b5d1468106"
Sep 10 23:44:02.600077 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:02.600025    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96c6870f0f768d8d40e30759597953d0725d076fff0fe9e2cf7568b5d1468106"} err="failed to get container status \"96c6870f0f768d8d40e30759597953d0725d076fff0fe9e2cf7568b5d1468106\": rpc error: code = NotFound desc = could not find container \"96c6870f0f768d8d40e30759597953d0725d076fff0fe9e2cf7568b5d1468106\": container with ID starting with 96c6870f0f768d8d40e30759597953d0725d076fff0fe9e2cf7568b5d1468106 not found: ID does not exist"
Sep 10 23:44:03.583745 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:03.583710    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46" event={"ID":"7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb","Type":"ContainerStarted","Data":"0cd4322e4358b74bdda89f1109b5ede572d055d2f54785237c4329aff1e6e34d"}
Sep 10 23:44:03.584207 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:03.583822    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"
Sep 10 23:44:03.586483 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:03.586462    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bbn8x" event={"ID":"128b9ff1-6e85-4e87-b4b3-24eccd54c85b","Type":"ContainerStarted","Data":"298219a2486ec19b7ce25d5053e4bfbda499303976a195778518de37f6130bb6"}
Sep 10 23:44:03.586600 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:03.586580    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bbn8x"
Sep 10 23:44:03.604417 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:03.604368    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46" podStartSLOduration=2.6043567789999997 podStartE2EDuration="2.604356779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:03.602402451 +0000 UTC m=+443.643271756" watchObservedRunningTime="2026-09-10 23:44:03.604356779 +0000 UTC m=+443.645226083"
Sep 10 23:44:03.623951 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:03.623908    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bbn8x" podStartSLOduration=2.623888152 podStartE2EDuration="2.623888152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:03.623220674 +0000 UTC m=+443.664089979" watchObservedRunningTime="2026-09-10 23:44:03.623888152 +0000 UTC m=+443.664757457"
Sep 10 23:44:07.094480 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:07.094448    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:07.150071 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:07.150026    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:07.692003 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:07.691970    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:07.749776 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:07.749738    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:10.564479 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.564436    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-546bd7c44f-fvp8g" podUID="3bac376d-f518-4a04-bfa9-b21237c97a92" containerName="console" containerID="cri-o://a79e8710aa19f23d14855d315d0fa278f970257e3d8118fd7992498f2e05af55" gracePeriod=15
Sep 10 23:44:10.824628 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.824571    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:44:10.873086 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.873057    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-oauth-serving-cert\") pod \"3bac376d-f518-4a04-bfa9-b21237c97a92\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") "
Sep 10 23:44:10.873243 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.873091    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-console-config\") pod \"3bac376d-f518-4a04-bfa9-b21237c97a92\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") "
Sep 10 23:44:10.873243 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.873136    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bac376d-f518-4a04-bfa9-b21237c97a92-console-serving-cert\") pod \"3bac376d-f518-4a04-bfa9-b21237c97a92\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") "
Sep 10 23:44:10.873243 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.873198    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwkww\" (UniqueName: \"kubernetes.io/projected/3bac376d-f518-4a04-bfa9-b21237c97a92-kube-api-access-dwkww\") pod \"3bac376d-f518-4a04-bfa9-b21237c97a92\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") "
Sep 10 23:44:10.873380 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.873262    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-trusted-ca-bundle\") pod \"3bac376d-f518-4a04-bfa9-b21237c97a92\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") "
Sep 10 23:44:10.873380 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.873291    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-service-ca\") pod \"3bac376d-f518-4a04-bfa9-b21237c97a92\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") "
Sep 10 23:44:10.873380 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.873318    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3bac376d-f518-4a04-bfa9-b21237c97a92-console-oauth-config\") pod \"3bac376d-f518-4a04-bfa9-b21237c97a92\" (UID: \"3bac376d-f518-4a04-bfa9-b21237c97a92\") "
Sep 10 23:44:10.873592 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.873501    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-console-config" (OuterVolumeSpecName: "console-config") pod "3bac376d-f518-4a04-bfa9-b21237c97a92" (UID: "3bac376d-f518-4a04-bfa9-b21237c97a92"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:44:10.873592 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.873527    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3bac376d-f518-4a04-bfa9-b21237c97a92" (UID: "3bac376d-f518-4a04-bfa9-b21237c97a92"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:44:10.873720 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.873581    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-console-config\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:44:10.873821 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.873792    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-service-ca" (OuterVolumeSpecName: "service-ca") pod "3bac376d-f518-4a04-bfa9-b21237c97a92" (UID: "3bac376d-f518-4a04-bfa9-b21237c97a92"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:44:10.873862 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.873795    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3bac376d-f518-4a04-bfa9-b21237c97a92" (UID: "3bac376d-f518-4a04-bfa9-b21237c97a92"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:44:10.875487 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.875454    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bac376d-f518-4a04-bfa9-b21237c97a92-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3bac376d-f518-4a04-bfa9-b21237c97a92" (UID: "3bac376d-f518-4a04-bfa9-b21237c97a92"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:44:10.875603 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.875519    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bac376d-f518-4a04-bfa9-b21237c97a92-kube-api-access-dwkww" (OuterVolumeSpecName: "kube-api-access-dwkww") pod "3bac376d-f518-4a04-bfa9-b21237c97a92" (UID: "3bac376d-f518-4a04-bfa9-b21237c97a92"). InnerVolumeSpecName "kube-api-access-dwkww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:44:10.875651 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.875607    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bac376d-f518-4a04-bfa9-b21237c97a92-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3bac376d-f518-4a04-bfa9-b21237c97a92" (UID: "3bac376d-f518-4a04-bfa9-b21237c97a92"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:44:10.974207 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.974175    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwkww\" (UniqueName: \"kubernetes.io/projected/3bac376d-f518-4a04-bfa9-b21237c97a92-kube-api-access-dwkww\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:44:10.974207 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.974200    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-trusted-ca-bundle\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:44:10.974207 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.974212    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-service-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:44:10.974426 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.974221    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3bac376d-f518-4a04-bfa9-b21237c97a92-console-oauth-config\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:44:10.974426 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.974230    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3bac376d-f518-4a04-bfa9-b21237c97a92-oauth-serving-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:44:10.974426 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:10.974238    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bac376d-f518-4a04-bfa9-b21237c97a92-console-serving-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:44:11.100738 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:11.100634    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:11.202360 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:11.202321    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:11.633763 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:11.633726    2581 generic.go:356] "Generic (PLEG): container finished" podID="3bac376d-f518-4a04-bfa9-b21237c97a92" containerID="a79e8710aa19f23d14855d315d0fa278f970257e3d8118fd7992498f2e05af55" exitCode=0
Sep 10 23:44:11.634175 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:11.633768    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-546bd7c44f-fvp8g"
Sep 10 23:44:11.634175 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:11.633810    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-546bd7c44f-fvp8g" event={"ID":"3bac376d-f518-4a04-bfa9-b21237c97a92","Type":"ContainerDied","Data":"a79e8710aa19f23d14855d315d0fa278f970257e3d8118fd7992498f2e05af55"}
Sep 10 23:44:11.634175 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:11.633864    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-546bd7c44f-fvp8g" event={"ID":"3bac376d-f518-4a04-bfa9-b21237c97a92","Type":"ContainerDied","Data":"4cfe981f6f619983d54cde0513fb8153cce30e3a64b1a5963f33412118f3e2df"}
Sep 10 23:44:11.634175 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:11.633889    2581 scope.go:117] "RemoveContainer" containerID="a79e8710aa19f23d14855d315d0fa278f970257e3d8118fd7992498f2e05af55"
Sep 10 23:44:11.643318 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:11.643294    2581 scope.go:117] "RemoveContainer" containerID="a79e8710aa19f23d14855d315d0fa278f970257e3d8118fd7992498f2e05af55"
Sep 10 23:44:11.643601 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:44:11.643582    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a79e8710aa19f23d14855d315d0fa278f970257e3d8118fd7992498f2e05af55\": container with ID starting with a79e8710aa19f23d14855d315d0fa278f970257e3d8118fd7992498f2e05af55 not found: ID does not exist" containerID="a79e8710aa19f23d14855d315d0fa278f970257e3d8118fd7992498f2e05af55"
Sep 10 23:44:11.643682 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:11.643610    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a79e8710aa19f23d14855d315d0fa278f970257e3d8118fd7992498f2e05af55"} err="failed to get container status \"a79e8710aa19f23d14855d315d0fa278f970257e3d8118fd7992498f2e05af55\": rpc error: code = NotFound desc = could not find container \"a79e8710aa19f23d14855d315d0fa278f970257e3d8118fd7992498f2e05af55\": container with ID starting with a79e8710aa19f23d14855d315d0fa278f970257e3d8118fd7992498f2e05af55 not found: ID does not exist"
Sep 10 23:44:11.655403 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:11.655378    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-546bd7c44f-fvp8g"]
Sep 10 23:44:11.668305 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:11.668253    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-546bd7c44f-fvp8g"]
Sep 10 23:44:12.483649 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:12.483617    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bac376d-f518-4a04-bfa9-b21237c97a92" path="/var/lib/kubelet/pods/3bac376d-f518-4a04-bfa9-b21237c97a92/volumes"
Sep 10 23:44:12.801393 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:12.801305    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:12.861112 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:12.861079    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:14.593815 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:14.593784    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bbn8x"
Sep 10 23:44:14.594187 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:14.593852    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"
Sep 10 23:44:15.116631 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:15.116595    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:15.211377 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:15.211343    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:15.311663 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:15.311634    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:15.413551 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:15.413470    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:15.516711 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:15.516656    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:15.613413 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:15.613387    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:17.436491 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.436456    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"]
Sep 10 23:44:17.436936 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.436650    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46" podUID="7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb" containerName="manager" containerID="cri-o://0cd4322e4358b74bdda89f1109b5ede572d055d2f54785237c4329aff1e6e34d" gracePeriod=10
Sep 10 23:44:17.668469 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.668440    2581 generic.go:356] "Generic (PLEG): container finished" podID="7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb" containerID="0cd4322e4358b74bdda89f1109b5ede572d055d2f54785237c4329aff1e6e34d" exitCode=0
Sep 10 23:44:17.668610 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.668523    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46" event={"ID":"7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb","Type":"ContainerDied","Data":"0cd4322e4358b74bdda89f1109b5ede572d055d2f54785237c4329aff1e6e34d"}
Sep 10 23:44:17.668610 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.668606    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46" event={"ID":"7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb","Type":"ContainerDied","Data":"2ba64f931be446c940d6f324e636b8a872bc7d69d122317f6fc8efec95bbbb9f"}
Sep 10 23:44:17.668722 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.668624    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ba64f931be446c940d6f324e636b8a872bc7d69d122317f6fc8efec95bbbb9f"
Sep 10 23:44:17.673184 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.673162    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"
Sep 10 23:44:17.702028 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.701998    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"]
Sep 10 23:44:17.702337 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.702323    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bac376d-f518-4a04-bfa9-b21237c97a92" containerName="console"
Sep 10 23:44:17.702337 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.702337    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bac376d-f518-4a04-bfa9-b21237c97a92" containerName="console"
Sep 10 23:44:17.702471 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.702346    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb" containerName="manager"
Sep 10 23:44:17.702471 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.702351    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb" containerName="manager"
Sep 10 23:44:17.702471 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.702404    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bac376d-f518-4a04-bfa9-b21237c97a92" containerName="console"
Sep 10 23:44:17.702471 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.702411    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb" containerName="manager"
Sep 10 23:44:17.704108 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.704087    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"
Sep 10 23:44:17.719299 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.719278    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"]
Sep 10 23:44:17.727964 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.727939    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wh7r\" (UniqueName: \"kubernetes.io/projected/7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb-kube-api-access-9wh7r\") pod \"7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb\" (UID: \"7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb\") "
Sep 10 23:44:17.728087 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.727974    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb-extensions-socket-volume\") pod \"7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb\" (UID: \"7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb\") "
Sep 10 23:44:17.728153 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.728129    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20b7692c-ed7d-4be2-9c8d-f2223313b6a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8gxps\" (UID: \"20b7692c-ed7d-4be2-9c8d-f2223313b6a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"
Sep 10 23:44:17.728214 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.728195    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt6jq\" (UniqueName: \"kubernetes.io/projected/20b7692c-ed7d-4be2-9c8d-f2223313b6a6-kube-api-access-dt6jq\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8gxps\" (UID: \"20b7692c-ed7d-4be2-9c8d-f2223313b6a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"
Sep 10 23:44:17.728479 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.728449    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb" (UID: "7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:44:17.730199 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.730179    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb-kube-api-access-9wh7r" (OuterVolumeSpecName: "kube-api-access-9wh7r") pod "7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb" (UID: "7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb"). InnerVolumeSpecName "kube-api-access-9wh7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:44:17.829494 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.829464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20b7692c-ed7d-4be2-9c8d-f2223313b6a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8gxps\" (UID: \"20b7692c-ed7d-4be2-9c8d-f2223313b6a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"
Sep 10 23:44:17.829640 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.829512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt6jq\" (UniqueName: \"kubernetes.io/projected/20b7692c-ed7d-4be2-9c8d-f2223313b6a6-kube-api-access-dt6jq\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8gxps\" (UID: \"20b7692c-ed7d-4be2-9c8d-f2223313b6a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"
Sep 10 23:44:17.829640 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.829571    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wh7r\" (UniqueName: \"kubernetes.io/projected/7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb-kube-api-access-9wh7r\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:44:17.829640 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.829582    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb-extensions-socket-volume\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:44:17.829870 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.829840    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20b7692c-ed7d-4be2-9c8d-f2223313b6a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8gxps\" (UID: \"20b7692c-ed7d-4be2-9c8d-f2223313b6a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"
Sep 10 23:44:17.854628 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:17.854600    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt6jq\" (UniqueName: \"kubernetes.io/projected/20b7692c-ed7d-4be2-9c8d-f2223313b6a6-kube-api-access-dt6jq\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8gxps\" (UID: \"20b7692c-ed7d-4be2-9c8d-f2223313b6a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"
Sep 10 23:44:18.014013 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:18.013930    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"
Sep 10 23:44:18.292012 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:18.291985    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"]
Sep 10 23:44:18.292879 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:44:18.292844    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20b7692c_ed7d_4be2_9c8d_f2223313b6a6.slice/crio-968b695b098d52572d1f6c1b2699079dca1ea78d3cab3ecab255ab80fbea855b WatchSource:0}: Error finding container 968b695b098d52572d1f6c1b2699079dca1ea78d3cab3ecab255ab80fbea855b: Status 404 returned error can't find the container with id 968b695b098d52572d1f6c1b2699079dca1ea78d3cab3ecab255ab80fbea855b
Sep 10 23:44:18.676550 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:18.676458    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps" event={"ID":"20b7692c-ed7d-4be2-9c8d-f2223313b6a6","Type":"ContainerStarted","Data":"5a8fa28d9d1c629fdd718d14102b4a9da2e09f7a81b754cd130da07fce1c6603"}
Sep 10 23:44:18.676550 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:18.676505    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"
Sep 10 23:44:18.676550 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:18.676524    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps" event={"ID":"20b7692c-ed7d-4be2-9c8d-f2223313b6a6","Type":"ContainerStarted","Data":"968b695b098d52572d1f6c1b2699079dca1ea78d3cab3ecab255ab80fbea855b"}
Sep 10 23:44:18.677168 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:18.676702    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"
Sep 10 23:44:18.700431 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:18.700324    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps" podStartSLOduration=1.7003061019999999 podStartE2EDuration="1.700306102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:18.698442295 +0000 UTC m=+458.739311618" watchObservedRunningTime="2026-09-10 23:44:18.700306102 +0000 UTC m=+458.741175409"
Sep 10 23:44:18.722170 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:18.722142    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"]
Sep 10 23:44:18.728326 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:18.728302    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tzp46"]
Sep 10 23:44:20.484742 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:20.484698    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb" path="/var/lib/kubelet/pods/7d2aa8a9-5f0c-46e8-a2cd-58ddb4c249cb/volumes"
Sep 10 23:44:21.399343 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:21.399301    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:21.495593 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:21.495555    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:29.684252 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:29.684220    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"
Sep 10 23:44:33.705766 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.705732    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"]
Sep 10 23:44:33.709054 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.709032    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.711492 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.711467    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tsq8t\""
Sep 10 23:44:33.711904 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.711887    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 23:44:33.723131 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.723112    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"]
Sep 10 23:44:33.744203 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.744178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:33.765704 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.765661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74c9942a-1bb3-4968-8e95-3d119c0810a0-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.765835 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.765712    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74c9942a-1bb3-4968-8e95-3d119c0810a0-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.765835 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.765746    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74c9942a-1bb3-4968-8e95-3d119c0810a0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.765835 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.765772    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74c9942a-1bb3-4968-8e95-3d119c0810a0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.765835 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.765790    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74c9942a-1bb3-4968-8e95-3d119c0810a0-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.765835 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.765812    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd6kc\" (UniqueName: \"kubernetes.io/projected/74c9942a-1bb3-4968-8e95-3d119c0810a0-kube-api-access-pd6kc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.766033 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.765896    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74c9942a-1bb3-4968-8e95-3d119c0810a0-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.766033 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.765928    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74c9942a-1bb3-4968-8e95-3d119c0810a0-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.766033 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.765958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74c9942a-1bb3-4968-8e95-3d119c0810a0-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.867088 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.867058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74c9942a-1bb3-4968-8e95-3d119c0810a0-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.867259 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.867101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74c9942a-1bb3-4968-8e95-3d119c0810a0-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.867259 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.867120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74c9942a-1bb3-4968-8e95-3d119c0810a0-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.867259 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.867141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74c9942a-1bb3-4968-8e95-3d119c0810a0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.867259 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.867161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74c9942a-1bb3-4968-8e95-3d119c0810a0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.867259 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.867183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74c9942a-1bb3-4968-8e95-3d119c0810a0-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.867259 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.867219    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd6kc\" (UniqueName: \"kubernetes.io/projected/74c9942a-1bb3-4968-8e95-3d119c0810a0-kube-api-access-pd6kc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.867259 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.867260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74c9942a-1bb3-4968-8e95-3d119c0810a0-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.867617 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.867292    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74c9942a-1bb3-4968-8e95-3d119c0810a0-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.867617 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.867525    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74c9942a-1bb3-4968-8e95-3d119c0810a0-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.867617 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.867595    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74c9942a-1bb3-4968-8e95-3d119c0810a0-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.867857 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.867644    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74c9942a-1bb3-4968-8e95-3d119c0810a0-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.867857 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.867704    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74c9942a-1bb3-4968-8e95-3d119c0810a0-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.867939 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.867903    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74c9942a-1bb3-4968-8e95-3d119c0810a0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.869811 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.869786    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74c9942a-1bb3-4968-8e95-3d119c0810a0-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.869923 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.869817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74c9942a-1bb3-4968-8e95-3d119c0810a0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.877248 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.877223    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd6kc\" (UniqueName: \"kubernetes.io/projected/74c9942a-1bb3-4968-8e95-3d119c0810a0-kube-api-access-pd6kc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:33.877342 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:33.877261    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74c9942a-1bb3-4968-8e95-3d119c0810a0-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2fjbr\" (UID: \"74c9942a-1bb3-4968-8e95-3d119c0810a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:34.020298 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:34.020207    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:34.123090 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:34.123057    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:34.299954 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:34.299926    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"]
Sep 10 23:44:34.301852 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:44:34.301815    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74c9942a_1bb3_4968_8e95_3d119c0810a0.slice/crio-dcb6254d6581016996c6d09f308ec1a7c193f5fecd03e20051a8022c8695193f WatchSource:0}: Error finding container dcb6254d6581016996c6d09f308ec1a7c193f5fecd03e20051a8022c8695193f: Status 404 returned error can't find the container with id dcb6254d6581016996c6d09f308ec1a7c193f5fecd03e20051a8022c8695193f
Sep 10 23:44:34.766746 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:34.766710    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr" event={"ID":"74c9942a-1bb3-4968-8e95-3d119c0810a0","Type":"ContainerStarted","Data":"dcb6254d6581016996c6d09f308ec1a7c193f5fecd03e20051a8022c8695193f"}
Sep 10 23:44:36.876085 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:36.876053    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:44:36.876335 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:36.876121    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:44:36.876335 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:36.876147    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:44:37.787687 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:37.787641    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr" event={"ID":"74c9942a-1bb3-4968-8e95-3d119c0810a0","Type":"ContainerStarted","Data":"a8f1b06d769b2761944a4c914ecbfb6c624c1edaa5b084245d166d897a37a71b"}
Sep 10 23:44:37.825625 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:37.825573    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr" podStartSLOduration=2.253532715 podStartE2EDuration="4.82555792s" totalImagesPullingTime="2.572025205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:37.823906535 +0000 UTC m=+477.864775854" watchObservedRunningTime="2026-09-10 23:44:37.82555792 +0000 UTC m=+477.866427224"
Sep 10 23:44:38.020846 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:38.020812    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:38.026213 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:38.026186    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:38.793392 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:38.793359    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:38.794485 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:38.794467    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:44:47.815537 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:47.815502    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:47.922018 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:47.921968    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:48.027740 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.027701    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:48.223150 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.223110    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:44:48.228352 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.228326    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"
Sep 10 23:44:48.230867 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.230842    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mxc26\""
Sep 10 23:44:48.231191 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.231172    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 23:44:48.238218 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.238192    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:44:48.271255 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.271214    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:44:48.393248 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.393216    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e073421f-408c-4203-a20b-b0c65a4beae1-config-file\") pod \"limitador-limitador-84994f7ffc-x2wnt\" (UID: \"e073421f-408c-4203-a20b-b0c65a4beae1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"
Sep 10 23:44:48.393426 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.393306    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwpxv\" (UniqueName: \"kubernetes.io/projected/e073421f-408c-4203-a20b-b0c65a4beae1-kube-api-access-gwpxv\") pod \"limitador-limitador-84994f7ffc-x2wnt\" (UID: \"e073421f-408c-4203-a20b-b0c65a4beae1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"
Sep 10 23:44:48.494017 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.493926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwpxv\" (UniqueName: \"kubernetes.io/projected/e073421f-408c-4203-a20b-b0c65a4beae1-kube-api-access-gwpxv\") pod \"limitador-limitador-84994f7ffc-x2wnt\" (UID: \"e073421f-408c-4203-a20b-b0c65a4beae1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"
Sep 10 23:44:48.494017 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.493976    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e073421f-408c-4203-a20b-b0c65a4beae1-config-file\") pod \"limitador-limitador-84994f7ffc-x2wnt\" (UID: \"e073421f-408c-4203-a20b-b0c65a4beae1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"
Sep 10 23:44:48.494596 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.494560    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e073421f-408c-4203-a20b-b0c65a4beae1-config-file\") pod \"limitador-limitador-84994f7ffc-x2wnt\" (UID: \"e073421f-408c-4203-a20b-b0c65a4beae1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"
Sep 10 23:44:48.504793 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.504767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwpxv\" (UniqueName: \"kubernetes.io/projected/e073421f-408c-4203-a20b-b0c65a4beae1-kube-api-access-gwpxv\") pod \"limitador-limitador-84994f7ffc-x2wnt\" (UID: \"e073421f-408c-4203-a20b-b0c65a4beae1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"
Sep 10 23:44:48.540315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.540278    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"
Sep 10 23:44:48.668755 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.668712    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-5nnsb"]
Sep 10 23:44:48.673465 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.673441    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-5nnsb"
Sep 10 23:44:48.676068 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.676049    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9nnd4\""
Sep 10 23:44:48.681562 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.681540    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-5nnsb"]
Sep 10 23:44:48.710657 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.710625    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:48.797132 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.797020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb5sd\" (UniqueName: \"kubernetes.io/projected/6b778eed-bce7-4df4-8404-b54a449560cf-kube-api-access-jb5sd\") pod \"authorino-7bcfd8f9cd-5nnsb\" (UID: \"6b778eed-bce7-4df4-8404-b54a449560cf\") " pod="kuadrant-system/authorino-7bcfd8f9cd-5nnsb"
Sep 10 23:44:48.812005 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.811969    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-wvmt5"]
Sep 10 23:44:48.815335 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.815310    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-wvmt5"
Sep 10 23:44:48.823408 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.823380    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:44:48.832285 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.832261    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-wvmt5"]
Sep 10 23:44:48.853799 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.853774    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:44:48.855877 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:44:48.855847    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode073421f_408c_4203_a20b_b0c65a4beae1.slice/crio-58a0dfb30f56bc35c62a9bd287d5a0d35c3c2ca9f86a71ed838d1bd31d4c11ef WatchSource:0}: Error finding container 58a0dfb30f56bc35c62a9bd287d5a0d35c3c2ca9f86a71ed838d1bd31d4c11ef: Status 404 returned error can't find the container with id 58a0dfb30f56bc35c62a9bd287d5a0d35c3c2ca9f86a71ed838d1bd31d4c11ef
Sep 10 23:44:48.897731 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.897701    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb5sd\" (UniqueName: \"kubernetes.io/projected/6b778eed-bce7-4df4-8404-b54a449560cf-kube-api-access-jb5sd\") pod \"authorino-7bcfd8f9cd-5nnsb\" (UID: \"6b778eed-bce7-4df4-8404-b54a449560cf\") " pod="kuadrant-system/authorino-7bcfd8f9cd-5nnsb"
Sep 10 23:44:48.897902 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.897742    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q42lb\" (UniqueName: \"kubernetes.io/projected/75e01bd4-6f65-4d3a-91e2-11c5fa282da4-kube-api-access-q42lb\") pod \"authorino-59c974bd48-wvmt5\" (UID: \"75e01bd4-6f65-4d3a-91e2-11c5fa282da4\") " pod="kuadrant-system/authorino-59c974bd48-wvmt5"
Sep 10 23:44:48.913367 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.913335    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb5sd\" (UniqueName: \"kubernetes.io/projected/6b778eed-bce7-4df4-8404-b54a449560cf-kube-api-access-jb5sd\") pod \"authorino-7bcfd8f9cd-5nnsb\" (UID: \"6b778eed-bce7-4df4-8404-b54a449560cf\") " pod="kuadrant-system/authorino-7bcfd8f9cd-5nnsb"
Sep 10 23:44:48.983950 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.983919    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-5nnsb"
Sep 10 23:44:48.998303 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:48.998278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q42lb\" (UniqueName: \"kubernetes.io/projected/75e01bd4-6f65-4d3a-91e2-11c5fa282da4-kube-api-access-q42lb\") pod \"authorino-59c974bd48-wvmt5\" (UID: \"75e01bd4-6f65-4d3a-91e2-11c5fa282da4\") " pod="kuadrant-system/authorino-59c974bd48-wvmt5"
Sep 10 23:44:49.008392 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:49.008359    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q42lb\" (UniqueName: \"kubernetes.io/projected/75e01bd4-6f65-4d3a-91e2-11c5fa282da4-kube-api-access-q42lb\") pod \"authorino-59c974bd48-wvmt5\" (UID: \"75e01bd4-6f65-4d3a-91e2-11c5fa282da4\") " pod="kuadrant-system/authorino-59c974bd48-wvmt5"
Sep 10 23:44:49.125027 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:49.124948    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-wvmt5"
Sep 10 23:44:49.255438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:49.255412    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-5nnsb"]
Sep 10 23:44:49.256880 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:44:49.256854    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b778eed_bce7_4df4_8404_b54a449560cf.slice/crio-8921ff00d01b78a3715ec1c837beea7a87c521e5a857582bfe2ea456e7d5d75c WatchSource:0}: Error finding container 8921ff00d01b78a3715ec1c837beea7a87c521e5a857582bfe2ea456e7d5d75c: Status 404 returned error can't find the container with id 8921ff00d01b78a3715ec1c837beea7a87c521e5a857582bfe2ea456e7d5d75c
Sep 10 23:44:49.396639 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:49.396609    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-wvmt5"]
Sep 10 23:44:49.398452 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:44:49.398429    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75e01bd4_6f65_4d3a_91e2_11c5fa282da4.slice/crio-671f89ebdc7d8e65a79bfff65fd972e4643313d35c71d15169029f115bcb8bcc WatchSource:0}: Error finding container 671f89ebdc7d8e65a79bfff65fd972e4643313d35c71d15169029f115bcb8bcc: Status 404 returned error can't find the container with id 671f89ebdc7d8e65a79bfff65fd972e4643313d35c71d15169029f115bcb8bcc
Sep 10 23:44:49.855758 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:49.855706    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-wvmt5" event={"ID":"75e01bd4-6f65-4d3a-91e2-11c5fa282da4","Type":"ContainerStarted","Data":"671f89ebdc7d8e65a79bfff65fd972e4643313d35c71d15169029f115bcb8bcc"}
Sep 10 23:44:49.859497 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:49.859464    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-5nnsb" event={"ID":"6b778eed-bce7-4df4-8404-b54a449560cf","Type":"ContainerStarted","Data":"8921ff00d01b78a3715ec1c837beea7a87c521e5a857582bfe2ea456e7d5d75c"}
Sep 10 23:44:49.862929 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:49.862548    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-x2wnt" event={"ID":"e073421f-408c-4203-a20b-b0c65a4beae1","Type":"ContainerStarted","Data":"58a0dfb30f56bc35c62a9bd287d5a0d35c3c2ca9f86a71ed838d1bd31d4c11ef"}
Sep 10 23:44:50.870047 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:50.870009    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-x2wnt" event={"ID":"e073421f-408c-4203-a20b-b0c65a4beae1","Type":"ContainerStarted","Data":"94bcd2bdfb998577dc6bfeb4db2f9ce7d04fbec634ab83f003cc7584272c7e10"}
Sep 10 23:44:50.870455 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:50.870079    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"
Sep 10 23:44:50.891927 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:50.891612    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-x2wnt" podStartSLOduration=1.925541033 podStartE2EDuration="2.891593347s" totalImagesPullingTime="966.052314ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:50.890939943 +0000 UTC m=+490.931809248" watchObservedRunningTime="2026-09-10 23:44:50.891593347 +0000 UTC m=+490.932462654"
Sep 10 23:44:51.877694 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:51.877638    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-wvmt5" event={"ID":"75e01bd4-6f65-4d3a-91e2-11c5fa282da4","Type":"ContainerStarted","Data":"b869b0998218d63242d2d394333820a90377b0f64c4f3b7141c9f5dbee960ddf"}
Sep 10 23:44:51.879193 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:51.879162    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-5nnsb" event={"ID":"6b778eed-bce7-4df4-8404-b54a449560cf","Type":"ContainerStarted","Data":"123e1c19b6ea8ef5818072e7b6bc253a239fe4ee39d206d69052cda99d626a1d"}
Sep 10 23:44:51.894343 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:51.894302    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-wvmt5" podStartSLOduration=2.372168684 podStartE2EDuration="3.894286564s" totalImagesPullingTime="1.52211788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:51.892362023 +0000 UTC m=+491.933231330" watchObservedRunningTime="2026-09-10 23:44:51.894286564 +0000 UTC m=+491.935155868"
Sep 10 23:44:51.908232 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:51.908185    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-5nnsb" podStartSLOduration=2.249490887 podStartE2EDuration="3.908168873s" totalImagesPullingTime="1.658677986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:51.906146089 +0000 UTC m=+491.947015399" watchObservedRunningTime="2026-09-10 23:44:51.908168873 +0000 UTC m=+491.949038177"
Sep 10 23:44:51.934404 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:51.934375    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-5nnsb"]
Sep 10 23:44:53.889295 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:53.889254    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-5nnsb" podUID="6b778eed-bce7-4df4-8404-b54a449560cf" containerName="authorino" containerID="cri-o://123e1c19b6ea8ef5818072e7b6bc253a239fe4ee39d206d69052cda99d626a1d" gracePeriod=30
Sep 10 23:44:54.138347 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:54.138325    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-5nnsb"
Sep 10 23:44:54.241924 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:54.241892    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb5sd\" (UniqueName: \"kubernetes.io/projected/6b778eed-bce7-4df4-8404-b54a449560cf-kube-api-access-jb5sd\") pod \"6b778eed-bce7-4df4-8404-b54a449560cf\" (UID: \"6b778eed-bce7-4df4-8404-b54a449560cf\") "
Sep 10 23:44:54.244102 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:54.244075    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b778eed-bce7-4df4-8404-b54a449560cf-kube-api-access-jb5sd" (OuterVolumeSpecName: "kube-api-access-jb5sd") pod "6b778eed-bce7-4df4-8404-b54a449560cf" (UID: "6b778eed-bce7-4df4-8404-b54a449560cf"). InnerVolumeSpecName "kube-api-access-jb5sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:44:54.342851 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:54.342818    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb5sd\" (UniqueName: \"kubernetes.io/projected/6b778eed-bce7-4df4-8404-b54a449560cf-kube-api-access-jb5sd\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:44:54.895489 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:54.895451    2581 generic.go:356] "Generic (PLEG): container finished" podID="6b778eed-bce7-4df4-8404-b54a449560cf" containerID="123e1c19b6ea8ef5818072e7b6bc253a239fe4ee39d206d69052cda99d626a1d" exitCode=0
Sep 10 23:44:54.896055 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:54.895497    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-5nnsb"
Sep 10 23:44:54.896055 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:54.895540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-5nnsb" event={"ID":"6b778eed-bce7-4df4-8404-b54a449560cf","Type":"ContainerDied","Data":"123e1c19b6ea8ef5818072e7b6bc253a239fe4ee39d206d69052cda99d626a1d"}
Sep 10 23:44:54.896055 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:54.895587    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-5nnsb" event={"ID":"6b778eed-bce7-4df4-8404-b54a449560cf","Type":"ContainerDied","Data":"8921ff00d01b78a3715ec1c837beea7a87c521e5a857582bfe2ea456e7d5d75c"}
Sep 10 23:44:54.896055 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:54.895613    2581 scope.go:117] "RemoveContainer" containerID="123e1c19b6ea8ef5818072e7b6bc253a239fe4ee39d206d69052cda99d626a1d"
Sep 10 23:44:54.910826 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:54.910804    2581 scope.go:117] "RemoveContainer" containerID="123e1c19b6ea8ef5818072e7b6bc253a239fe4ee39d206d69052cda99d626a1d"
Sep 10 23:44:54.911104 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:44:54.911086    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"123e1c19b6ea8ef5818072e7b6bc253a239fe4ee39d206d69052cda99d626a1d\": container with ID starting with 123e1c19b6ea8ef5818072e7b6bc253a239fe4ee39d206d69052cda99d626a1d not found: ID does not exist" containerID="123e1c19b6ea8ef5818072e7b6bc253a239fe4ee39d206d69052cda99d626a1d"
Sep 10 23:44:54.911146 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:54.911114    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123e1c19b6ea8ef5818072e7b6bc253a239fe4ee39d206d69052cda99d626a1d"} err="failed to get container status \"123e1c19b6ea8ef5818072e7b6bc253a239fe4ee39d206d69052cda99d626a1d\": rpc error: code = NotFound desc = could not find container \"123e1c19b6ea8ef5818072e7b6bc253a239fe4ee39d206d69052cda99d626a1d\": container with ID starting with 123e1c19b6ea8ef5818072e7b6bc253a239fe4ee39d206d69052cda99d626a1d not found: ID does not exist"
Sep 10 23:44:54.917495 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:54.917473    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-5nnsb"]
Sep 10 23:44:54.920285 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:54.920265    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-5nnsb"]
Sep 10 23:44:56.484042 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:44:56.484004    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b778eed-bce7-4df4-8404-b54a449560cf" path="/var/lib/kubelet/pods/6b778eed-bce7-4df4-8404-b54a449560cf/volumes"
Sep 10 23:45:01.880160 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:01.880129    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"
Sep 10 23:45:05.258590 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:05.258552    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:05.388069 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:05.388027    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:05.756354 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:05.756298    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:15.024085 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:15.024045    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:15.148447 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:15.148407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:15.546745 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:15.546716    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65cb576478-sc9kk"]
Sep 10 23:45:15.547157 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:15.547140    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b778eed-bce7-4df4-8404-b54a449560cf" containerName="authorino"
Sep 10 23:45:15.547248 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:15.547160    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b778eed-bce7-4df4-8404-b54a449560cf" containerName="authorino"
Sep 10 23:45:15.547302 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:15.547265    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b778eed-bce7-4df4-8404-b54a449560cf" containerName="authorino"
Sep 10 23:45:15.551258 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:15.551238    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65cb576478-sc9kk"
Sep 10 23:45:15.553935 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:15.553916    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 10 23:45:15.559085 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:15.559059    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65cb576478-sc9kk"]
Sep 10 23:45:15.618503 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:15.618470    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45ddc19c-81e2-4322-94bd-d01b09d7a064-tls-cert\") pod \"authorino-65cb576478-sc9kk\" (UID: \"45ddc19c-81e2-4322-94bd-d01b09d7a064\") " pod="kuadrant-system/authorino-65cb576478-sc9kk"
Sep 10 23:45:15.618503 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:15.618508    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8qpb\" (UniqueName: \"kubernetes.io/projected/45ddc19c-81e2-4322-94bd-d01b09d7a064-kube-api-access-r8qpb\") pod \"authorino-65cb576478-sc9kk\" (UID: \"45ddc19c-81e2-4322-94bd-d01b09d7a064\") " pod="kuadrant-system/authorino-65cb576478-sc9kk"
Sep 10 23:45:15.719960 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:15.719918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45ddc19c-81e2-4322-94bd-d01b09d7a064-tls-cert\") pod \"authorino-65cb576478-sc9kk\" (UID: \"45ddc19c-81e2-4322-94bd-d01b09d7a064\") " pod="kuadrant-system/authorino-65cb576478-sc9kk"
Sep 10 23:45:15.720141 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:15.719988    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8qpb\" (UniqueName: \"kubernetes.io/projected/45ddc19c-81e2-4322-94bd-d01b09d7a064-kube-api-access-r8qpb\") pod \"authorino-65cb576478-sc9kk\" (UID: \"45ddc19c-81e2-4322-94bd-d01b09d7a064\") " pod="kuadrant-system/authorino-65cb576478-sc9kk"
Sep 10 23:45:15.722603 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:15.722580    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45ddc19c-81e2-4322-94bd-d01b09d7a064-tls-cert\") pod \"authorino-65cb576478-sc9kk\" (UID: \"45ddc19c-81e2-4322-94bd-d01b09d7a064\") " pod="kuadrant-system/authorino-65cb576478-sc9kk"
Sep 10 23:45:15.727961 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:15.727942    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8qpb\" (UniqueName: \"kubernetes.io/projected/45ddc19c-81e2-4322-94bd-d01b09d7a064-kube-api-access-r8qpb\") pod \"authorino-65cb576478-sc9kk\" (UID: \"45ddc19c-81e2-4322-94bd-d01b09d7a064\") " pod="kuadrant-system/authorino-65cb576478-sc9kk"
Sep 10 23:45:15.860523 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:15.860419    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65cb576478-sc9kk"
Sep 10 23:45:16.129485 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:16.129463    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65cb576478-sc9kk"]
Sep 10 23:45:16.131108 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:45:16.131075    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45ddc19c_81e2_4322_94bd_d01b09d7a064.slice/crio-08b34275cec4721efd096fd76e1c0d1966593cfc34cf94bd278aeba942b4ef83 WatchSource:0}: Error finding container 08b34275cec4721efd096fd76e1c0d1966593cfc34cf94bd278aeba942b4ef83: Status 404 returned error can't find the container with id 08b34275cec4721efd096fd76e1c0d1966593cfc34cf94bd278aeba942b4ef83
Sep 10 23:45:17.017960 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:17.017931    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65cb576478-sc9kk" event={"ID":"45ddc19c-81e2-4322-94bd-d01b09d7a064","Type":"ContainerStarted","Data":"b8cb1897c8616793b7ca8b959b1ec0e1053605acdeb18f9020ecfdede5da4f89"}
Sep 10 23:45:17.018134 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:17.017969    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65cb576478-sc9kk" event={"ID":"45ddc19c-81e2-4322-94bd-d01b09d7a064","Type":"ContainerStarted","Data":"08b34275cec4721efd096fd76e1c0d1966593cfc34cf94bd278aeba942b4ef83"}
Sep 10 23:45:17.036794 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:17.036746    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65cb576478-sc9kk" podStartSLOduration=1.635080335 podStartE2EDuration="2.036729908s" totalImagesPullingTime="401.649573ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:45:17.0346955 +0000 UTC m=+517.075564805" watchObservedRunningTime="2026-09-10 23:45:17.036729908 +0000 UTC m=+517.077599239"
Sep 10 23:45:17.062628 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:17.062594    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-wvmt5"]
Sep 10 23:45:17.062936 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:17.062874    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-wvmt5" podUID="75e01bd4-6f65-4d3a-91e2-11c5fa282da4" containerName="authorino" containerID="cri-o://b869b0998218d63242d2d394333820a90377b0f64c4f3b7141c9f5dbee960ddf" gracePeriod=30
Sep 10 23:45:17.129928 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:17.129894    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:17.313139 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:17.313115    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-wvmt5"
Sep 10 23:45:17.334802 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:17.334780    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q42lb\" (UniqueName: \"kubernetes.io/projected/75e01bd4-6f65-4d3a-91e2-11c5fa282da4-kube-api-access-q42lb\") pod \"75e01bd4-6f65-4d3a-91e2-11c5fa282da4\" (UID: \"75e01bd4-6f65-4d3a-91e2-11c5fa282da4\") "
Sep 10 23:45:17.336977 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:17.336955    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75e01bd4-6f65-4d3a-91e2-11c5fa282da4-kube-api-access-q42lb" (OuterVolumeSpecName: "kube-api-access-q42lb") pod "75e01bd4-6f65-4d3a-91e2-11c5fa282da4" (UID: "75e01bd4-6f65-4d3a-91e2-11c5fa282da4"). InnerVolumeSpecName "kube-api-access-q42lb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:45:17.435801 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:17.435767    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q42lb\" (UniqueName: \"kubernetes.io/projected/75e01bd4-6f65-4d3a-91e2-11c5fa282da4-kube-api-access-q42lb\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:45:18.025113 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:18.025075    2581 generic.go:356] "Generic (PLEG): container finished" podID="75e01bd4-6f65-4d3a-91e2-11c5fa282da4" containerID="b869b0998218d63242d2d394333820a90377b0f64c4f3b7141c9f5dbee960ddf" exitCode=0
Sep 10 23:45:18.025322 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:18.025120    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-wvmt5"
Sep 10 23:45:18.025322 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:18.025155    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-wvmt5" event={"ID":"75e01bd4-6f65-4d3a-91e2-11c5fa282da4","Type":"ContainerDied","Data":"b869b0998218d63242d2d394333820a90377b0f64c4f3b7141c9f5dbee960ddf"}
Sep 10 23:45:18.025322 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:18.025209    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-wvmt5" event={"ID":"75e01bd4-6f65-4d3a-91e2-11c5fa282da4","Type":"ContainerDied","Data":"671f89ebdc7d8e65a79bfff65fd972e4643313d35c71d15169029f115bcb8bcc"}
Sep 10 23:45:18.025322 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:18.025227    2581 scope.go:117] "RemoveContainer" containerID="b869b0998218d63242d2d394333820a90377b0f64c4f3b7141c9f5dbee960ddf"
Sep 10 23:45:18.034386 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:18.034371    2581 scope.go:117] "RemoveContainer" containerID="b869b0998218d63242d2d394333820a90377b0f64c4f3b7141c9f5dbee960ddf"
Sep 10 23:45:18.034660 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:45:18.034640    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b869b0998218d63242d2d394333820a90377b0f64c4f3b7141c9f5dbee960ddf\": container with ID starting with b869b0998218d63242d2d394333820a90377b0f64c4f3b7141c9f5dbee960ddf not found: ID does not exist" containerID="b869b0998218d63242d2d394333820a90377b0f64c4f3b7141c9f5dbee960ddf"
Sep 10 23:45:18.034820 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:18.034792    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b869b0998218d63242d2d394333820a90377b0f64c4f3b7141c9f5dbee960ddf"} err="failed to get container status \"b869b0998218d63242d2d394333820a90377b0f64c4f3b7141c9f5dbee960ddf\": rpc error: code = NotFound desc = could not find container \"b869b0998218d63242d2d394333820a90377b0f64c4f3b7141c9f5dbee960ddf\": container with ID starting with b869b0998218d63242d2d394333820a90377b0f64c4f3b7141c9f5dbee960ddf not found: ID does not exist"
Sep 10 23:45:18.045663 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:18.045634    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-wvmt5"]
Sep 10 23:45:18.048910 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:18.048889    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-wvmt5"]
Sep 10 23:45:18.483494 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:18.483458    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75e01bd4-6f65-4d3a-91e2-11c5fa282da4" path="/var/lib/kubelet/pods/75e01bd4-6f65-4d3a-91e2-11c5fa282da4/volumes"
Sep 10 23:45:22.135218 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:22.135181    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:22.208275 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:22.208242    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:22.257698 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:22.257649    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:22.557448 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:22.557415    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:26.204814 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:26.204744    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:26.308989 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:26.308948    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:58.329166 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:58.329134    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:58.428084 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:58.428049    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:59.835898 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:59.835858    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:45:59.915551 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:45:59.915518    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:00.084036 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:00.083999    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:00.323196 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:00.323154    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:00.449809 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:00.449779    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:00.541332 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:00.541300    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:00.714136 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:00.714107    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:46:09.835866 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:09.835817    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2fjbr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 23:46:09.836309 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:09.835906    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr" podUID="74c9942a-1bb3-4968-8e95-3d119c0810a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 23:46:10.316008 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:10.315916    2581 generic.go:356] "Generic (PLEG): container finished" podID="74c9942a-1bb3-4968-8e95-3d119c0810a0" containerID="a8f1b06d769b2761944a4c914ecbfb6c624c1edaa5b084245d166d897a37a71b" exitCode=0
Sep 10 23:46:10.316008 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:10.315966    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr" event={"ID":"74c9942a-1bb3-4968-8e95-3d119c0810a0","Type":"ContainerDied","Data":"a8f1b06d769b2761944a4c914ecbfb6c624c1edaa5b084245d166d897a37a71b"}
Sep 10 23:46:10.316357 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:10.316340    2581 scope.go:117] "RemoveContainer" containerID="a8f1b06d769b2761944a4c914ecbfb6c624c1edaa5b084245d166d897a37a71b"
Sep 10 23:46:10.317480 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:10.317449    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:46:10.317548 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:10.317526    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:46:10.317588 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:10.317559    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:46:11.004760 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:11.004716    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:11.104850 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:11.104804    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:11.323372 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:11.323274    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr" event={"ID":"74c9942a-1bb3-4968-8e95-3d119c0810a0","Type":"ContainerStarted","Data":"8de97ace5095131d41060fe5c1f2398710bc3a81cc87bc17975c291f38f3d9a2"}
Sep 10 23:46:12.020642 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:12.020605    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:46:12.021129 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:12.020835    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2fjbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 10 23:46:12.021129 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:12.020908    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr" podUID="74c9942a-1bb3-4968-8e95-3d119c0810a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 10 23:46:13.021199 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:13.021163    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2fjbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 10 23:46:13.021609 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:13.021225    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr" podUID="74c9942a-1bb3-4968-8e95-3d119c0810a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 10 23:46:14.020790 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:14.020755    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2fjbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 10 23:46:14.020982 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:14.020810    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr" podUID="74c9942a-1bb3-4968-8e95-3d119c0810a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 10 23:46:15.020616 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:15.020579    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2fjbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 10 23:46:15.021022 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:15.020637    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr" podUID="74c9942a-1bb3-4968-8e95-3d119c0810a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 10 23:46:16.021320 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:16.021279    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2fjbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 10 23:46:16.021729 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:16.021372    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr" podUID="74c9942a-1bb3-4968-8e95-3d119c0810a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 10 23:46:17.024270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:17.024242    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:46:17.024684 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:17.024650    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:46:17.025483 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:17.025466    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr"
Sep 10 23:46:20.618907 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:20.618868    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:21.124772 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:21.124739    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:46:29.947991 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:29.947959    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:30.718589 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:30.718540    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:46:38.111856 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:38.111812    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:39.853207 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:39.853155    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:39.910993 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:39.910958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:40.113307 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:40.113222    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:40.624143 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:40.624111    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:46:50.925647 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:50.925574    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:50.982604 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:50.982572    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:52.967071 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:52.967038    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"]
Sep 10 23:46:52.967591 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:52.967570    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75e01bd4-6f65-4d3a-91e2-11c5fa282da4" containerName="authorino"
Sep 10 23:46:52.967693 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:52.967594    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="75e01bd4-6f65-4d3a-91e2-11c5fa282da4" containerName="authorino"
Sep 10 23:46:52.967792 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:52.967772    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="75e01bd4-6f65-4d3a-91e2-11c5fa282da4" containerName="authorino"
Sep 10 23:46:52.971159 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:52.971118    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:52.973607 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:52.973586    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rg6w4\""
Sep 10 23:46:52.973719 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:52.973588    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 23:46:52.974428 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:52.974409    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 10 23:46:52.974486 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:52.974459    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 23:46:52.979786 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:52.979762    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"]
Sep 10 23:46:52.999990 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:52.999918    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:46:53.140785 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.140749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.140958 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.140794    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.140958 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.140814    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hslw\" (UniqueName: \"kubernetes.io/projected/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-kube-api-access-6hslw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.140958 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.140843    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.140958 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.140905    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.140958 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.140935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.241461 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.241369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.241461 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.241411    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.241461 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.241429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hslw\" (UniqueName: \"kubernetes.io/projected/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-kube-api-access-6hslw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.241461 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.241455    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.241837 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.241487    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.241837 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.241523    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.241964 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.241870    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.241964 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.241938    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.242066 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.242004    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.244522 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.244499    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.244646 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.244630    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.249909 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.249894    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hslw\" (UniqueName: \"kubernetes.io/projected/4f4a6c32-fd33-4d31-8e8d-0258d69594a0-kube-api-access-6hslw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rfw\" (UID: \"4f4a6c32-fd33-4d31-8e8d-0258d69594a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.283491 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.283458    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:46:53.555505 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.555466    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"]
Sep 10 23:46:53.556773 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:46:53.556744    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f4a6c32_fd33_4d31_8e8d_0258d69594a0.slice/crio-a9f6c19dc8f7984feae86991b9d60a738ca336734cb62b1a59e4460255908cd9 WatchSource:0}: Error finding container a9f6c19dc8f7984feae86991b9d60a738ca336734cb62b1a59e4460255908cd9: Status 404 returned error can't find the container with id a9f6c19dc8f7984feae86991b9d60a738ca336734cb62b1a59e4460255908cd9
Sep 10 23:46:53.558146 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:53.558126    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:46:54.420145 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:54.420107    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:46:54.553178 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:54.553153    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw" event={"ID":"4f4a6c32-fd33-4d31-8e8d-0258d69594a0","Type":"ContainerStarted","Data":"a9f6c19dc8f7984feae86991b9d60a738ca336734cb62b1a59e4460255908cd9"}
Sep 10 23:46:55.560330 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:55.560292    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw" event={"ID":"4f4a6c32-fd33-4d31-8e8d-0258d69594a0","Type":"ContainerStarted","Data":"4f78210254480b828aeba1b6b60cf9999b23949c09cd3f09b89c5afe282f2e9c"}
Sep 10 23:46:55.580621 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:46:55.580570    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw" podStartSLOduration=2.593611647 podStartE2EDuration="3.580554807s" totalImagesPullingTime="986.94316ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:55.57852549 +0000 UTC m=+615.619394807" watchObservedRunningTime="2026-09-10 23:46:55.580554807 +0000 UTC m=+615.621424106"
Sep 10 23:47:03.284044 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:03.283958    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:47:03.284433 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:03.284053    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:47:03.296847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:03.296825    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:47:03.616553 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:03.616470    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rfw"
Sep 10 23:47:07.550591 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:07.550553    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:09.119266 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:09.119231    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:47:10.434346 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:10.434305    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:10.537144 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:10.537099    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:19.028508 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.028474    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"]
Sep 10 23:47:19.032076 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.032055    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.034753 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.034733    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 10 23:47:19.041399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.041380    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"]
Sep 10 23:47:19.054012 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.053985    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:19.157953 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.157916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.158130 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.157969    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.158130 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.158088    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.158243 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.158132    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.158243 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.158152    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqmkm\" (UniqueName: \"kubernetes.io/projected/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-kube-api-access-xqmkm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.158243 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.158219    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.258921 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.258880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.258921 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.258923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqmkm\" (UniqueName: \"kubernetes.io/projected/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-kube-api-access-xqmkm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.259127 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.258951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.259127 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.258978    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.259127 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.259080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.259269 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.259172    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.259490 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.259464    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.259620 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.259511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.259620 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.259537    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.261396 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.261373    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.261641 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.261623    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.267331 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.267297    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqmkm\" (UniqueName: \"kubernetes.io/projected/b935f0f8-a7e8-4a86-9899-0f5a5c51b7af-kube-api-access-xqmkm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49ckq\" (UID: \"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.343439 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.343341    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:19.617378 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.617355    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"]
Sep 10 23:47:19.619625 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:47:19.619597    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb935f0f8_a7e8_4a86_9899_0f5a5c51b7af.slice/crio-8230540b3514183b7572a908ae1571caa36939c09ab01204a759c8ef19477e85 WatchSource:0}: Error finding container 8230540b3514183b7572a908ae1571caa36939c09ab01204a759c8ef19477e85: Status 404 returned error can't find the container with id 8230540b3514183b7572a908ae1571caa36939c09ab01204a759c8ef19477e85
Sep 10 23:47:19.688457 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:19.688423    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq" event={"ID":"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af","Type":"ContainerStarted","Data":"8230540b3514183b7572a908ae1571caa36939c09ab01204a759c8ef19477e85"}
Sep 10 23:47:20.695531 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:20.695494    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq" event={"ID":"b935f0f8-a7e8-4a86-9899-0f5a5c51b7af","Type":"ContainerStarted","Data":"e25e84083b43462e48319832526ebf111377757236ebf1718e29c3e9902614e5"}
Sep 10 23:47:20.713758 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:20.713709    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq" podStartSLOduration=1.530962582 podStartE2EDuration="1.713690215s" totalImagesPullingTime="182.727633ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:47:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:47:20.711518418 +0000 UTC m=+640.752387735" watchObservedRunningTime="2026-09-10 23:47:20.713690215 +0000 UTC m=+640.754559518"
Sep 10 23:47:21.027511 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:21.027480    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:47:29.344315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:29.344278    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:29.344873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:29.344571    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:29.356965 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:29.356932    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:29.762272 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:29.762246    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49ckq"
Sep 10 23:47:43.953616 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:43.953581    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:47:46.327985 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:47:46.327949    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:49:29.430159 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:29.430114    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d46bc7b5f-plkxb"]
Sep 10 23:49:29.433510 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:29.433493    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d46bc7b5f-plkxb"
Sep 10 23:49:29.456839 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:29.456809    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d46bc7b5f-plkxb"]
Sep 10 23:49:29.586449 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:29.586415    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvpbj\" (UniqueName: \"kubernetes.io/projected/1560ea5b-6035-49ec-9fdb-9b3fb597a8ad-kube-api-access-vvpbj\") pod \"authorino-6d46bc7b5f-plkxb\" (UID: \"1560ea5b-6035-49ec-9fdb-9b3fb597a8ad\") " pod="kuadrant-system/authorino-6d46bc7b5f-plkxb"
Sep 10 23:49:29.586614 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:29.586481    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1560ea5b-6035-49ec-9fdb-9b3fb597a8ad-tls-cert\") pod \"authorino-6d46bc7b5f-plkxb\" (UID: \"1560ea5b-6035-49ec-9fdb-9b3fb597a8ad\") " pod="kuadrant-system/authorino-6d46bc7b5f-plkxb"
Sep 10 23:49:29.687512 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:29.687430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1560ea5b-6035-49ec-9fdb-9b3fb597a8ad-tls-cert\") pod \"authorino-6d46bc7b5f-plkxb\" (UID: \"1560ea5b-6035-49ec-9fdb-9b3fb597a8ad\") " pod="kuadrant-system/authorino-6d46bc7b5f-plkxb"
Sep 10 23:49:29.687651 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:29.687514    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvpbj\" (UniqueName: \"kubernetes.io/projected/1560ea5b-6035-49ec-9fdb-9b3fb597a8ad-kube-api-access-vvpbj\") pod \"authorino-6d46bc7b5f-plkxb\" (UID: \"1560ea5b-6035-49ec-9fdb-9b3fb597a8ad\") " pod="kuadrant-system/authorino-6d46bc7b5f-plkxb"
Sep 10 23:49:29.690078 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:29.690058    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1560ea5b-6035-49ec-9fdb-9b3fb597a8ad-tls-cert\") pod \"authorino-6d46bc7b5f-plkxb\" (UID: \"1560ea5b-6035-49ec-9fdb-9b3fb597a8ad\") " pod="kuadrant-system/authorino-6d46bc7b5f-plkxb"
Sep 10 23:49:29.695465 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:29.695441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvpbj\" (UniqueName: \"kubernetes.io/projected/1560ea5b-6035-49ec-9fdb-9b3fb597a8ad-kube-api-access-vvpbj\") pod \"authorino-6d46bc7b5f-plkxb\" (UID: \"1560ea5b-6035-49ec-9fdb-9b3fb597a8ad\") " pod="kuadrant-system/authorino-6d46bc7b5f-plkxb"
Sep 10 23:49:29.742308 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:29.742281    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d46bc7b5f-plkxb"
Sep 10 23:49:30.014553 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:30.014531    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d46bc7b5f-plkxb"]
Sep 10 23:49:30.016605 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:49:30.016576    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1560ea5b_6035_49ec_9fdb_9b3fb597a8ad.slice/crio-57fbf4c2c1e8903dbd7e2d43b49866909609b79cb9780ec0bb56fa5bf51fa3f4 WatchSource:0}: Error finding container 57fbf4c2c1e8903dbd7e2d43b49866909609b79cb9780ec0bb56fa5bf51fa3f4: Status 404 returned error can't find the container with id 57fbf4c2c1e8903dbd7e2d43b49866909609b79cb9780ec0bb56fa5bf51fa3f4
Sep 10 23:49:30.427165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:30.427069    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d46bc7b5f-plkxb" event={"ID":"1560ea5b-6035-49ec-9fdb-9b3fb597a8ad","Type":"ContainerStarted","Data":"57fbf4c2c1e8903dbd7e2d43b49866909609b79cb9780ec0bb56fa5bf51fa3f4"}
Sep 10 23:49:31.438328 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:31.438241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d46bc7b5f-plkxb" event={"ID":"1560ea5b-6035-49ec-9fdb-9b3fb597a8ad","Type":"ContainerStarted","Data":"c8c51679204a4cbd52f668cfef0f66cb6823680332ec717559954112231911d0"}
Sep 10 23:49:31.457174 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:31.457096    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d46bc7b5f-plkxb" podStartSLOduration=1.8838695140000001 podStartE2EDuration="2.457072465s" totalImagesPullingTime="573.202951ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:49:31.455531044 +0000 UTC m=+771.496400346" watchObservedRunningTime="2026-09-10 23:49:31.457072465 +0000 UTC m=+771.497941772"
Sep 10 23:49:31.497702 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:31.495243    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65cb576478-sc9kk"]
Sep 10 23:49:31.497702 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:31.495475    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-65cb576478-sc9kk" podUID="45ddc19c-81e2-4322-94bd-d01b09d7a064" containerName="authorino" containerID="cri-o://b8cb1897c8616793b7ca8b959b1ec0e1053605acdeb18f9020ecfdede5da4f89" gracePeriod=30
Sep 10 23:49:31.754280 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:31.754257    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65cb576478-sc9kk"
Sep 10 23:49:31.803406 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:31.803378    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8qpb\" (UniqueName: \"kubernetes.io/projected/45ddc19c-81e2-4322-94bd-d01b09d7a064-kube-api-access-r8qpb\") pod \"45ddc19c-81e2-4322-94bd-d01b09d7a064\" (UID: \"45ddc19c-81e2-4322-94bd-d01b09d7a064\") "
Sep 10 23:49:31.805563 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:31.805534    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45ddc19c-81e2-4322-94bd-d01b09d7a064-kube-api-access-r8qpb" (OuterVolumeSpecName: "kube-api-access-r8qpb") pod "45ddc19c-81e2-4322-94bd-d01b09d7a064" (UID: "45ddc19c-81e2-4322-94bd-d01b09d7a064"). InnerVolumeSpecName "kube-api-access-r8qpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:49:31.904270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:31.904240    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45ddc19c-81e2-4322-94bd-d01b09d7a064-tls-cert\") pod \"45ddc19c-81e2-4322-94bd-d01b09d7a064\" (UID: \"45ddc19c-81e2-4322-94bd-d01b09d7a064\") "
Sep 10 23:49:31.904513 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:31.904496    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8qpb\" (UniqueName: \"kubernetes.io/projected/45ddc19c-81e2-4322-94bd-d01b09d7a064-kube-api-access-r8qpb\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:49:31.915805 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:31.915776    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45ddc19c-81e2-4322-94bd-d01b09d7a064-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "45ddc19c-81e2-4322-94bd-d01b09d7a064" (UID: "45ddc19c-81e2-4322-94bd-d01b09d7a064"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:49:32.005329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:32.005242    2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45ddc19c-81e2-4322-94bd-d01b09d7a064-tls-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:49:32.045687 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:32.045645    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:32.136087 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:32.136053    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:32.446946 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:32.446855    2581 generic.go:356] "Generic (PLEG): container finished" podID="45ddc19c-81e2-4322-94bd-d01b09d7a064" containerID="b8cb1897c8616793b7ca8b959b1ec0e1053605acdeb18f9020ecfdede5da4f89" exitCode=0
Sep 10 23:49:32.446946 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:32.446915    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65cb576478-sc9kk"
Sep 10 23:49:32.447415 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:32.446947    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65cb576478-sc9kk" event={"ID":"45ddc19c-81e2-4322-94bd-d01b09d7a064","Type":"ContainerDied","Data":"b8cb1897c8616793b7ca8b959b1ec0e1053605acdeb18f9020ecfdede5da4f89"}
Sep 10 23:49:32.447415 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:32.446989    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65cb576478-sc9kk" event={"ID":"45ddc19c-81e2-4322-94bd-d01b09d7a064","Type":"ContainerDied","Data":"08b34275cec4721efd096fd76e1c0d1966593cfc34cf94bd278aeba942b4ef83"}
Sep 10 23:49:32.447415 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:32.447012    2581 scope.go:117] "RemoveContainer" containerID="b8cb1897c8616793b7ca8b959b1ec0e1053605acdeb18f9020ecfdede5da4f89"
Sep 10 23:49:32.461006 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:32.456796    2581 scope.go:117] "RemoveContainer" containerID="b8cb1897c8616793b7ca8b959b1ec0e1053605acdeb18f9020ecfdede5da4f89"
Sep 10 23:49:32.461006 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:49:32.460945    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8cb1897c8616793b7ca8b959b1ec0e1053605acdeb18f9020ecfdede5da4f89\": container with ID starting with b8cb1897c8616793b7ca8b959b1ec0e1053605acdeb18f9020ecfdede5da4f89 not found: ID does not exist" containerID="b8cb1897c8616793b7ca8b959b1ec0e1053605acdeb18f9020ecfdede5da4f89"
Sep 10 23:49:32.461006 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:32.460986    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8cb1897c8616793b7ca8b959b1ec0e1053605acdeb18f9020ecfdede5da4f89"} err="failed to get container status \"b8cb1897c8616793b7ca8b959b1ec0e1053605acdeb18f9020ecfdede5da4f89\": rpc error: code = NotFound desc = could not find container \"b8cb1897c8616793b7ca8b959b1ec0e1053605acdeb18f9020ecfdede5da4f89\": container with ID starting with b8cb1897c8616793b7ca8b959b1ec0e1053605acdeb18f9020ecfdede5da4f89 not found: ID does not exist"
Sep 10 23:49:32.485770 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:32.485743    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65cb576478-sc9kk"]
Sep 10 23:49:32.485770 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:32.485776    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-65cb576478-sc9kk"]
Sep 10 23:49:33.054395 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:33.054361    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:33.140306 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:33.140235    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:34.483059 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:34.483027    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45ddc19c-81e2-4322-94bd-d01b09d7a064" path="/var/lib/kubelet/pods/45ddc19c-81e2-4322-94bd-d01b09d7a064/volumes"
Sep 10 23:49:48.535640 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:48.535607    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:48.638108 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:48.638075    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:48.849210 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:48.849139    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:49.837813 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:49.837762    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:50.012213 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:50.012171    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:50.302156 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:50.302120    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:52.287220 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:52.287184    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:52.350619 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:52.350585    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:49:52.393234 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:52.393198    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:53.731271 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:53.731230    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:53.832312 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:53.832278    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:54.572985 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:54.572939    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:54.676450 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:54.676416    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:55.044565 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:55.044530    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7850-a37b3d"]
Sep 10 23:49:55.045012 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:55.044961    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45ddc19c-81e2-4322-94bd-d01b09d7a064" containerName="authorino"
Sep 10 23:49:55.045012 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:55.044980    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="45ddc19c-81e2-4322-94bd-d01b09d7a064" containerName="authorino"
Sep 10 23:49:55.045098 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:55.045071    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="45ddc19c-81e2-4322-94bd-d01b09d7a064" containerName="authorino"
Sep 10 23:49:55.049744 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:55.049724    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7850-a37b3d"
Sep 10 23:49:55.052028 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:55.052010    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k9g2h\""
Sep 10 23:49:55.055860 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:55.055837    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7850-a37b3d"]
Sep 10 23:49:55.109250 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:55.109221    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bstz9\" (UniqueName: \"kubernetes.io/projected/63d2274f-9e1f-424d-9cab-c20fb6f6dd95-kube-api-access-bstz9\") pod \"test-curl-7850-a37b3d\" (UID: \"63d2274f-9e1f-424d-9cab-c20fb6f6dd95\") " pod="opendatahub/test-curl-7850-a37b3d"
Sep 10 23:49:55.210754 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:55.210720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bstz9\" (UniqueName: \"kubernetes.io/projected/63d2274f-9e1f-424d-9cab-c20fb6f6dd95-kube-api-access-bstz9\") pod \"test-curl-7850-a37b3d\" (UID: \"63d2274f-9e1f-424d-9cab-c20fb6f6dd95\") " pod="opendatahub/test-curl-7850-a37b3d"
Sep 10 23:49:55.219146 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:55.219114    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bstz9\" (UniqueName: \"kubernetes.io/projected/63d2274f-9e1f-424d-9cab-c20fb6f6dd95-kube-api-access-bstz9\") pod \"test-curl-7850-a37b3d\" (UID: \"63d2274f-9e1f-424d-9cab-c20fb6f6dd95\") " pod="opendatahub/test-curl-7850-a37b3d"
Sep 10 23:49:55.359995 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:55.359909    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7850-a37b3d"
Sep 10 23:49:55.641051 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:55.641026    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7850-a37b3d"]
Sep 10 23:49:55.643364 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:49:55.643337    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63d2274f_9e1f_424d_9cab_c20fb6f6dd95.slice/crio-363fcd34ac14e91096e274f203d07ea53a34f51070aa6441150e160ac985645f WatchSource:0}: Error finding container 363fcd34ac14e91096e274f203d07ea53a34f51070aa6441150e160ac985645f: Status 404 returned error can't find the container with id 363fcd34ac14e91096e274f203d07ea53a34f51070aa6441150e160ac985645f
Sep 10 23:49:56.595304 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:56.595257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7850-a37b3d" event={"ID":"63d2274f-9e1f-424d-9cab-c20fb6f6dd95","Type":"ContainerStarted","Data":"363fcd34ac14e91096e274f203d07ea53a34f51070aa6441150e160ac985645f"}
Sep 10 23:49:56.596374 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:56.596348    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:56.681145 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:56.681094    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:56.882783 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:56.882700    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:57.189291 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.189205    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"]
Sep 10 23:49:57.197753 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.197726    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.200468 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.200447    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-643c297d-openshift-default-dockercfg-55dp5\""
Sep 10 23:49:57.206609 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.206574    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"]
Sep 10 23:49:57.226137 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.226104    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:57.331395 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.331365    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-envoy\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.331395 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.331399    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c63353e-c8ce-4544-a38c-437fb8f5d266-istiod-ca-cert\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.331628 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.331428    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75wcn\" (UniqueName: \"kubernetes.io/projected/3c63353e-c8ce-4544-a38c-437fb8f5d266-kube-api-access-75wcn\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.331628 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.331454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-podinfo\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.331628 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.331511    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-credential-socket\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.331628 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.331535    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-workload-socket\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.331628 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.331567    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-workload-certs\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.331628 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.331587    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-data\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.331628 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.331609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-token\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.432802 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.432770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-token\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.433002 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.432870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-envoy\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.433002 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.432905    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c63353e-c8ce-4544-a38c-437fb8f5d266-istiod-ca-cert\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.433002 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.432942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75wcn\" (UniqueName: \"kubernetes.io/projected/3c63353e-c8ce-4544-a38c-437fb8f5d266-kube-api-access-75wcn\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.433002 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.432969    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-podinfo\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.433289 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.433012    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-credential-socket\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.433289 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.433038    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-workload-socket\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.433289 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.433087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-workload-certs\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.433289 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.433125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-data\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.433508 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.433427    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-credential-socket\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.433508 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.433438    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-workload-socket\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.433612 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.433531    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-data\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.433700 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.433661    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-workload-certs\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.433766 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.433744    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c63353e-c8ce-4544-a38c-437fb8f5d266-istiod-ca-cert\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.435589 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.435565    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-envoy\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.436368 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.436345    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-podinfo\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.443788 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.443734    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75wcn\" (UniqueName: \"kubernetes.io/projected/3c63353e-c8ce-4544-a38c-437fb8f5d266-kube-api-access-75wcn\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.444547 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.444523    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-token\") pod \"e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") " pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.509466 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.509433    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:49:57.512320 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.512292    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:57.942562 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.942539    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"]
Sep 10 23:49:57.945261 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:49:57.945235    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c63353e_c8ce_4544_a38c_437fb8f5d266.slice/crio-baf05567de27688bd9b7bf3bd799969de1145138f8455f34c59c0e7ad0d04acb WatchSource:0}: Error finding container baf05567de27688bd9b7bf3bd799969de1145138f8455f34c59c0e7ad0d04acb: Status 404 returned error can't find the container with id baf05567de27688bd9b7bf3bd799969de1145138f8455f34c59c0e7ad0d04acb
Sep 10 23:49:57.947470 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.947442    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:49:57.947522 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.947509    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:49:57.947562 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:57.947535    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:49:58.613240 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:58.613204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7850-a37b3d" event={"ID":"63d2274f-9e1f-424d-9cab-c20fb6f6dd95","Type":"ContainerStarted","Data":"2979dc97c96cad1e7678ce3ab557aeeb4ea7b555acbdfe1b767c898222f8dab0"}
Sep 10 23:49:58.614737 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:58.614711    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m" event={"ID":"3c63353e-c8ce-4544-a38c-437fb8f5d266","Type":"ContainerStarted","Data":"1be375a552b19fc3bd15435523c26494a24f2a180e32e2a826fa8b72461f82c1"}
Sep 10 23:49:58.614863 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:58.614755    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m" event={"ID":"3c63353e-c8ce-4544-a38c-437fb8f5d266","Type":"ContainerStarted","Data":"baf05567de27688bd9b7bf3bd799969de1145138f8455f34c59c0e7ad0d04acb"}
Sep 10 23:49:58.637270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:58.637226    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7850-a37b3d" podStartSLOduration=1.5696384700000001 podStartE2EDuration="3.637212972s" totalImagesPullingTime="2.067574502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:49:58.636231884 +0000 UTC m=+798.677101188" watchObservedRunningTime="2026-09-10 23:49:58.637212972 +0000 UTC m=+798.678082277"
Sep 10 23:49:58.668279 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:58.668221    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m" podStartSLOduration=1.668202266 podStartE2EDuration="1.668202266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:49:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:49:58.668105193 +0000 UTC m=+798.708974498" watchObservedRunningTime="2026-09-10 23:49:58.668202266 +0000 UTC m=+798.709071572"
Sep 10 23:49:59.513036 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:59.512997    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:59.518993 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:59.518968    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:59.533590 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:59.533553    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7850-a37b3d"]
Sep 10 23:49:59.537571 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:59.537502    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7850-a37b3d"]
Sep 10 23:49:59.620652 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:59.620621    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:49:59.620851 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:49:59.620687    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7850-a37b3d" container="test-curl-7850-a37b3d"
Sep 10 23:49:59.621808 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:49:59.621785    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:50:00.132282 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.132247    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:00.225808 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.225773    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:00.439893 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.439802    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"]
Sep 10 23:50:00.440295 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.440274    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d2274f-9e1f-424d-9cab-c20fb6f6dd95" containerName="test-curl-7850-a37b3d"
Sep 10 23:50:00.440393 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.440296    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d2274f-9e1f-424d-9cab-c20fb6f6dd95" containerName="test-curl-7850-a37b3d"
Sep 10 23:50:00.440447 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.440420    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d2274f-9e1f-424d-9cab-c20fb6f6dd95" containerName="test-curl-7850-a37b3d"
Sep 10 23:50:00.443719 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.443695    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.450040 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.450015    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-66836f-openshift-default-dockercfg-nldcl\""
Sep 10 23:50:00.473333 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.473296    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"]
Sep 10 23:50:00.487097 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.487071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:00.564421 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.564386    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-credential-socket\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.564936 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.564446    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-workload-certs\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.564936 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.564464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istiod-ca-cert\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.564936 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.564485    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-envoy\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.564936 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.564498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-data\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.564936 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.564579    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-workload-socket\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.564936 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.564708    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-token\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.564936 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.564750    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzp66\" (UniqueName: \"kubernetes.io/projected/fd1d5ee3-383a-44db-8a7d-7711673c28a6-kube-api-access-xzp66\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.564936 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.564832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-podinfo\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.626300 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.626242    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7850-a37b3d" podUID="63d2274f-9e1f-424d-9cab-c20fb6f6dd95" containerName="test-curl-7850-a37b3d" containerID="cri-o://2979dc97c96cad1e7678ce3ab557aeeb4ea7b555acbdfe1b767c898222f8dab0" gracePeriod=2
Sep 10 23:50:00.628655 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:50:00.628634    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7850-a37b3d\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="63d2274f-9e1f-424d-9cab-c20fb6f6dd95" pod="opendatahub/test-curl-7850-a37b3d"
Sep 10 23:50:00.666051 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.666025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-credential-socket\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.666051 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.666056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-workload-certs\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.666270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.666071    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istiod-ca-cert\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.666270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.666095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-envoy\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.666270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.666118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-data\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.666270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.666198    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-workload-socket\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.666270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.666239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-token\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.666270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.666263    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzp66\" (UniqueName: \"kubernetes.io/projected/fd1d5ee3-383a-44db-8a7d-7711673c28a6-kube-api-access-xzp66\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.666569 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.666298    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-podinfo\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.666742 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.666718    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-credential-socket\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.666831 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.666812    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istiod-ca-cert\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.667025 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.667005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-workload-socket\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.667206 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.667179    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-data\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.667351 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.667331    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-workload-certs\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.669787 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.669763    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-envoy\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.669974 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.669954    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-podinfo\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.676904 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.676867    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-token\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.677030 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.677005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzp66\" (UniqueName: \"kubernetes.io/projected/fd1d5ee3-383a-44db-8a7d-7711673c28a6-kube-api-access-xzp66\") pod \"e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") " pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.754244 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.754221    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:00.791425 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:00.791397    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:01.041110 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:01.041086    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"]
Sep 10 23:50:01.043195 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:50:01.043167    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1d5ee3_383a_44db_8a7d_7711673c28a6.slice/crio-9cbe0ae4b0bcfe8322f5c791624c11eb33394b4e4fca898c4217a01fa37ad63d WatchSource:0}: Error finding container 9cbe0ae4b0bcfe8322f5c791624c11eb33394b4e4fca898c4217a01fa37ad63d: Status 404 returned error can't find the container with id 9cbe0ae4b0bcfe8322f5c791624c11eb33394b4e4fca898c4217a01fa37ad63d
Sep 10 23:50:01.046422 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:01.046385    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:01.046501 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:01.046467    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:01.046545 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:01.046510    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:01.464968 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:01.464900    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:01.571321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:01.571229    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:01.634197 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:01.634158    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b" event={"ID":"fd1d5ee3-383a-44db-8a7d-7711673c28a6","Type":"ContainerStarted","Data":"04bb5e5cf0b90bc16afb8620b8a6683adf6b5a220fd7dfff7ec8328a2da446b9"}
Sep 10 23:50:01.634371 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:01.634218    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b" event={"ID":"fd1d5ee3-383a-44db-8a7d-7711673c28a6","Type":"ContainerStarted","Data":"9cbe0ae4b0bcfe8322f5c791624c11eb33394b4e4fca898c4217a01fa37ad63d"}
Sep 10 23:50:01.657928 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:01.657880    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b" podStartSLOduration=1.657858691 podStartE2EDuration="1.657858691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:50:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:50:01.656734031 +0000 UTC m=+801.697603337" watchObservedRunningTime="2026-09-10 23:50:01.657858691 +0000 UTC m=+801.698727995"
Sep 10 23:50:01.659741 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:50:01.659711    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7850-a37b3d\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="63d2274f-9e1f-424d-9cab-c20fb6f6dd95" pod="opendatahub/test-curl-7850-a37b3d"
Sep 10 23:50:01.755205 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:01.755121    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:02.113379 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:02.113299    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:02.218398 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:02.218370    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:02.358082 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:02.358046    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:02.760293 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:02.760269    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:02.826221 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:02.826191    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7850-a37b3d"
Sep 10 23:50:02.828969 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:50:02.828946    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7850-a37b3d\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="63d2274f-9e1f-424d-9cab-c20fb6f6dd95" pod="opendatahub/test-curl-7850-a37b3d"
Sep 10 23:50:02.990364 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:02.990330    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bstz9\" (UniqueName: \"kubernetes.io/projected/63d2274f-9e1f-424d-9cab-c20fb6f6dd95-kube-api-access-bstz9\") pod \"63d2274f-9e1f-424d-9cab-c20fb6f6dd95\" (UID: \"63d2274f-9e1f-424d-9cab-c20fb6f6dd95\") "
Sep 10 23:50:02.992622 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:02.992594    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63d2274f-9e1f-424d-9cab-c20fb6f6dd95-kube-api-access-bstz9" (OuterVolumeSpecName: "kube-api-access-bstz9") pod "63d2274f-9e1f-424d-9cab-c20fb6f6dd95" (UID: "63d2274f-9e1f-424d-9cab-c20fb6f6dd95"). InnerVolumeSpecName "kube-api-access-bstz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:50:03.091315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:03.091269    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bstz9\" (UniqueName: \"kubernetes.io/projected/63d2274f-9e1f-424d-9cab-c20fb6f6dd95-kube-api-access-bstz9\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:50:03.645864 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:03.645828    2581 generic.go:356] "Generic (PLEG): container finished" podID="63d2274f-9e1f-424d-9cab-c20fb6f6dd95" containerID="2979dc97c96cad1e7678ce3ab557aeeb4ea7b555acbdfe1b767c898222f8dab0" exitCode=137
Sep 10 23:50:03.646061 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:03.645872    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7850-a37b3d"
Sep 10 23:50:03.646061 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:03.645927    2581 scope.go:117] "RemoveContainer" containerID="2979dc97c96cad1e7678ce3ab557aeeb4ea7b555acbdfe1b767c898222f8dab0"
Sep 10 23:50:03.646323 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:03.646304    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:03.647581 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:03.647559    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:03.647987 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:50:03.647960    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7850-a37b3d\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="63d2274f-9e1f-424d-9cab-c20fb6f6dd95" pod="opendatahub/test-curl-7850-a37b3d"
Sep 10 23:50:03.649949 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:50:03.649926    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7850-a37b3d\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="63d2274f-9e1f-424d-9cab-c20fb6f6dd95" pod="opendatahub/test-curl-7850-a37b3d"
Sep 10 23:50:03.655900 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:03.655886    2581 scope.go:117] "RemoveContainer" containerID="2979dc97c96cad1e7678ce3ab557aeeb4ea7b555acbdfe1b767c898222f8dab0"
Sep 10 23:50:03.656164 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:50:03.656144    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2979dc97c96cad1e7678ce3ab557aeeb4ea7b555acbdfe1b767c898222f8dab0\": container with ID starting with 2979dc97c96cad1e7678ce3ab557aeeb4ea7b555acbdfe1b767c898222f8dab0 not found: ID does not exist" containerID="2979dc97c96cad1e7678ce3ab557aeeb4ea7b555acbdfe1b767c898222f8dab0"
Sep 10 23:50:03.656250 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:03.656171    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2979dc97c96cad1e7678ce3ab557aeeb4ea7b555acbdfe1b767c898222f8dab0"} err="failed to get container status \"2979dc97c96cad1e7678ce3ab557aeeb4ea7b555acbdfe1b767c898222f8dab0\": rpc error: code = NotFound desc = could not find container \"2979dc97c96cad1e7678ce3ab557aeeb4ea7b555acbdfe1b767c898222f8dab0\": container with ID starting with 2979dc97c96cad1e7678ce3ab557aeeb4ea7b555acbdfe1b767c898222f8dab0 not found: ID does not exist"
Sep 10 23:50:03.676836 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:50:03.676806    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7850-a37b3d\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="63d2274f-9e1f-424d-9cab-c20fb6f6dd95" pod="opendatahub/test-curl-7850-a37b3d"
Sep 10 23:50:03.852206 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:03.852169    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:03.948090 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:03.948004    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:04.484133 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:04.484099    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63d2274f-9e1f-424d-9cab-c20fb6f6dd95" path="/var/lib/kubelet/pods/63d2274f-9e1f-424d-9cab-c20fb6f6dd95/volumes"
Sep 10 23:50:05.078531 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:05.078498    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:05.156702 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:05.156647    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:05.304892 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:05.304852    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:05.676894 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:05.676863    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:05.769055 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:05.769017    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:07.436147 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:07.436114    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:07.601990 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:07.601958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:07.760350 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:07.760321    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:07.891776 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:07.891731    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:08.889198 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:08.889164    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:50:10.584997 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:10.584898    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:12.188137 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:12.188093    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:14.058174 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:14.058138    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:14.181485 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:14.181421    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:14.286435 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:14.286407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:16.450082 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:16.450049    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:17.114603 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.114545    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"]
Sep 10 23:50:17.119364 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.119338    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.122451 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.122427    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-d43a0552-kserve-self-signed-certs\""
Sep 10 23:50:17.132844 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.132816    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"]
Sep 10 23:50:17.236279 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.236238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5f8bf95-e74f-499d-af29-7d3a91a88f45-tls-certs\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.236487 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.236297    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-dshm\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.236487 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.236372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-model-cache\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.236487 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.236401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-home\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.236655 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.236491    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95nq4\" (UniqueName: \"kubernetes.io/projected/a5f8bf95-e74f-499d-af29-7d3a91a88f45-kube-api-access-95nq4\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.236655 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.236536    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-tmp-dir\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.337706 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.337646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95nq4\" (UniqueName: \"kubernetes.io/projected/a5f8bf95-e74f-499d-af29-7d3a91a88f45-kube-api-access-95nq4\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.337924 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.337729    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-tmp-dir\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.337924 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.337770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5f8bf95-e74f-499d-af29-7d3a91a88f45-tls-certs\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.337924 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.337810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-dshm\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.337924 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.337843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-model-cache\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.337924 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.337865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-home\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.338230 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.338204    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-tmp-dir\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.338319 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.338299    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-home\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.338406 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.338379    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-model-cache\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.340431 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.340404    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-dshm\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.340993 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.340968    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5f8bf95-e74f-499d-af29-7d3a91a88f45-tls-certs\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.348984 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.348955    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95nq4\" (UniqueName: \"kubernetes.io/projected/a5f8bf95-e74f-499d-af29-7d3a91a88f45-kube-api-access-95nq4\") pod \"e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") " pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.431871 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.431764    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:17.457464 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.457433    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:17.727119 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.727085    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"]
Sep 10 23:50:17.727966 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:50:17.727935    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5f8bf95_e74f_499d_af29_7d3a91a88f45.slice/crio-a00b0de4ae8791771b77572b425c45f2d40160ec55de9794da49691d8b556eff WatchSource:0}: Error finding container a00b0de4ae8791771b77572b425c45f2d40160ec55de9794da49691d8b556eff: Status 404 returned error can't find the container with id a00b0de4ae8791771b77572b425c45f2d40160ec55de9794da49691d8b556eff
Sep 10 23:50:17.747657 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:17.747538    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5" event={"ID":"a5f8bf95-e74f-499d-af29-7d3a91a88f45","Type":"ContainerStarted","Data":"a00b0de4ae8791771b77572b425c45f2d40160ec55de9794da49691d8b556eff"}
Sep 10 23:50:18.757136 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:18.757087    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5" event={"ID":"a5f8bf95-e74f-499d-af29-7d3a91a88f45","Type":"ContainerStarted","Data":"a3c83e7749d5e238702f75185fb737ba4ce8f92496b481afb335ddd0ee570445"}
Sep 10 23:50:18.783873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:18.783815    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5" podStartSLOduration=1.783799199 podStartE2EDuration="1.783799199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:50:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:50:18.781785017 +0000 UTC m=+818.822654324" watchObservedRunningTime="2026-09-10 23:50:18.783799199 +0000 UTC m=+818.824668505"
Sep 10 23:50:19.515352 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:19.515317    2581 patch_prober.go:28] interesting pod/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": read tcp 10.133.0.2:35484->10.133.0.55:15021: read: connection reset by peer" start-of-body=
Sep 10 23:50:19.515551 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:19.515392    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b" podUID="fd1d5ee3-383a-44db-8a7d-7711673c28a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": read tcp 10.133.0.2:35484->10.133.0.55:15021: read: connection reset by peer"
Sep 10 23:50:19.763963 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:19.763925    2581 generic.go:356] "Generic (PLEG): container finished" podID="3c63353e-c8ce-4544-a38c-437fb8f5d266" containerID="1be375a552b19fc3bd15435523c26494a24f2a180e32e2a826fa8b72461f82c1" exitCode=0
Sep 10 23:50:19.764448 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:19.764012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m" event={"ID":"3c63353e-c8ce-4544-a38c-437fb8f5d266","Type":"ContainerDied","Data":"1be375a552b19fc3bd15435523c26494a24f2a180e32e2a826fa8b72461f82c1"}
Sep 10 23:50:19.764524 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:19.764477    2581 scope.go:117] "RemoveContainer" containerID="1be375a552b19fc3bd15435523c26494a24f2a180e32e2a826fa8b72461f82c1"
Sep 10 23:50:19.766060 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:19.765891    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:19.766060 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:19.765977    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:19.766060 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:19.766024    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:19.766602 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:19.766529    2581 generic.go:356] "Generic (PLEG): container finished" podID="fd1d5ee3-383a-44db-8a7d-7711673c28a6" containerID="04bb5e5cf0b90bc16afb8620b8a6683adf6b5a220fd7dfff7ec8328a2da446b9" exitCode=0
Sep 10 23:50:19.766786 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:19.766723    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b" event={"ID":"fd1d5ee3-383a-44db-8a7d-7711673c28a6","Type":"ContainerDied","Data":"04bb5e5cf0b90bc16afb8620b8a6683adf6b5a220fd7dfff7ec8328a2da446b9"}
Sep 10 23:50:19.767426 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:19.767235    2581 scope.go:117] "RemoveContainer" containerID="04bb5e5cf0b90bc16afb8620b8a6683adf6b5a220fd7dfff7ec8328a2da446b9"
Sep 10 23:50:19.768417 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:19.768384    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:19.768500 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:19.768476    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:19.768545 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:19.768523    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:20.777072 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:20.777036    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m" event={"ID":"3c63353e-c8ce-4544-a38c-437fb8f5d266","Type":"ContainerStarted","Data":"e89bdbafa7865ba128674bfdd78b8c9275c38675e33a3964e26a45bcf6708ada"}
Sep 10 23:50:20.779370 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:20.779345    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b" event={"ID":"fd1d5ee3-383a-44db-8a7d-7711673c28a6","Type":"ContainerStarted","Data":"df16f7e460631dd324b10bc3569919b33b5d8b9f1bdde9f2c7cb85ced5e2c2e2"}
Sep 10 23:50:20.849730 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:20.839365    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:20.951880 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:20.950938    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:21.040325 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:21.040239    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:21.215647 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:21.215593    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:21.513768 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:21.513730    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:50:21.513961 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:21.513862    2581 patch_prober.go:28] interesting pod/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 23:50:21.513961 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:21.513934    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m" podUID="3c63353e-c8ce-4544-a38c-437fb8f5d266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 23:50:21.755153 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:21.755109    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:21.755490 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:21.755470    2581 patch_prober.go:28] interesting pod/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 23:50:21.755574 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:21.755515    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b" podUID="fd1d5ee3-383a-44db-8a7d-7711673c28a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 23:50:22.304019 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:22.303981    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:22.513642 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:22.513594    2581 patch_prober.go:28] interesting pod/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 23:50:22.513842 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:22.513689    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m" podUID="3c63353e-c8ce-4544-a38c-437fb8f5d266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 23:50:22.708004 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:22.707901    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:22.754610 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:22.754563    2581 patch_prober.go:28] interesting pod/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 23:50:22.754799 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:22.754625    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b" podUID="fd1d5ee3-383a-44db-8a7d-7711673c28a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 23:50:22.978250 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:22.978163    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"]
Sep 10 23:50:23.005695 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.000752    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"]
Sep 10 23:50:23.005695 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.000875    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.005695 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.005396    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-13374d-openshift-default-dockercfg-fb8b7\""
Sep 10 23:50:23.016201 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.016172    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:23.113695 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.113150    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-credential-socket\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.113695 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.113231    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21cb341a-dbb5-460c-ba47-1b56f6526917-istiod-ca-cert\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.113695 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.113318    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-workload-certs\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.113695 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.113353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzb76\" (UniqueName: \"kubernetes.io/projected/21cb341a-dbb5-460c-ba47-1b56f6526917-kube-api-access-pzb76\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.113695 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.113391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-envoy\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.113695 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.113453    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-workload-socket\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.113695 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.113478    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-data\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.113695 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.113503    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-podinfo\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.113695 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.113526    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-token\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.214379 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.214333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzb76\" (UniqueName: \"kubernetes.io/projected/21cb341a-dbb5-460c-ba47-1b56f6526917-kube-api-access-pzb76\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.214588 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.214398    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-envoy\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.214588 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.214468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-workload-socket\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.214588 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.214490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-data\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.214588 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.214514    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-podinfo\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.214588 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.214535    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-token\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.214588 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.214576    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-credential-socket\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.214927 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.214621    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21cb341a-dbb5-460c-ba47-1b56f6526917-istiod-ca-cert\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.214927 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.214732    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-workload-certs\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.215200 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.215177    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-workload-certs\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.216308 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.216282    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-workload-socket\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.216860 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.216793    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21cb341a-dbb5-460c-ba47-1b56f6526917-istiod-ca-cert\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.217313 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.217270    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-data\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.217607 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.217589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-credential-socket\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.227689 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.219110    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-envoy\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.227689 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.219561    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-podinfo\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.233440 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.231333    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzb76\" (UniqueName: \"kubernetes.io/projected/21cb341a-dbb5-460c-ba47-1b56f6526917-kube-api-access-pzb76\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.233440 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.232110    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-token\") pod \"e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") " pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.320088 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.320043    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:23.509653 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.505213    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:23.519695 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.515031    2581 patch_prober.go:28] interesting pod/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 23:50:23.519695 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.515091    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m" podUID="3c63353e-c8ce-4544-a38c-437fb8f5d266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 23:50:23.700909 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.699556    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"]
Sep 10 23:50:23.717311 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:50:23.717257    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cb341a_dbb5_460c_ba47_1b56f6526917.slice/crio-86ac6fed00cd5ad1c350f99b548ac204c2c5c7e1350101fb0173aa644c951fc4 WatchSource:0}: Error finding container 86ac6fed00cd5ad1c350f99b548ac204c2c5c7e1350101fb0173aa644c951fc4: Status 404 returned error can't find the container with id 86ac6fed00cd5ad1c350f99b548ac204c2c5c7e1350101fb0173aa644c951fc4
Sep 10 23:50:23.721876 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.720482    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:23.721876 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.720568    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:23.721876 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.720614    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:23.754820 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.754793    2581 patch_prober.go:28] interesting pod/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 23:50:23.754946 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.754849    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b" podUID="fd1d5ee3-383a-44db-8a7d-7711673c28a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 23:50:23.826808 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.826726    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm" event={"ID":"21cb341a-dbb5-460c-ba47-1b56f6526917","Type":"ContainerStarted","Data":"86ac6fed00cd5ad1c350f99b548ac204c2c5c7e1350101fb0173aa644c951fc4"}
Sep 10 23:50:23.884377 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:23.884340    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:24.513182 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:24.512726    2581 patch_prober.go:28] interesting pod/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 23:50:24.513182 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:24.512788    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m" podUID="3c63353e-c8ce-4544-a38c-437fb8f5d266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 23:50:24.754763 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:24.754726    2581 patch_prober.go:28] interesting pod/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 23:50:24.754923 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:24.754794    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b" podUID="fd1d5ee3-383a-44db-8a7d-7711673c28a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 23:50:24.835084 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:24.835000    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm" event={"ID":"21cb341a-dbb5-460c-ba47-1b56f6526917","Type":"ContainerStarted","Data":"f9e3b178bb5bff127f355fac3b862d0ae44797d8a46e57543023a5084a111386"}
Sep 10 23:50:24.862312 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:24.862248    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm" podStartSLOduration=2.86223452 podStartE2EDuration="2.86223452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:50:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:50:24.859794395 +0000 UTC m=+824.900663701" watchObservedRunningTime="2026-09-10 23:50:24.86223452 +0000 UTC m=+824.903103825"
Sep 10 23:50:25.320791 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:25.320750    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:25.325932 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:25.325908    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:25.513166 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:25.513121    2581 patch_prober.go:28] interesting pod/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 23:50:25.513384 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:25.513204    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m" podUID="3c63353e-c8ce-4544-a38c-437fb8f5d266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 23:50:25.754844 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:25.754806    2581 patch_prober.go:28] interesting pod/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 23:50:25.755020 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:25.754866    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b" podUID="fd1d5ee3-383a-44db-8a7d-7711673c28a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 23:50:25.841597 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:25.841563    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:25.842599 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:25.842580    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:26.513284 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:26.513242    2581 patch_prober.go:28] interesting pod/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 23:50:26.513515 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:26.513316    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m" podUID="3c63353e-c8ce-4544-a38c-437fb8f5d266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 23:50:26.530600 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:26.530559    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:26.758330 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:26.758297    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:26.758723 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:26.758702    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:26.759445 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:26.759415    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:50:26.829232 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:26.829136    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:26.923749 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:26.923718    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:27.432777 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:27.432740    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:27.432992 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:27.432794    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:27.445280 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:27.445253    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:27.517537 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:27.517506    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:50:27.518002 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:27.517891    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:50:27.518523 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:27.518506    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:50:27.865701 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:27.865656    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:50:28.306355 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:28.306320    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:28.406568 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:28.406536    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:28.541957 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:28.541914    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:28.644453 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:28.644366    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:28.785433 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:28.785400    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:28.886458 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:28.886425    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:29.283198 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:29.283160    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:29.383639 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:29.383603    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:32.727027 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:32.726990    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:50:40.499948 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:40.499918    2581 scope.go:117] "RemoveContainer" containerID="0cd4322e4358b74bdda89f1109b5ede572d055d2f54785237c4329aff1e6e34d"
Sep 10 23:50:41.882780 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:41.882748    2581 patch_prober.go:28] interesting pod/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 23:50:41.883169 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:41.882806    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm" podUID="21cb341a-dbb5-460c-ba47-1b56f6526917" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 23:50:42.138154 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:42.138071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:43.047099 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:43.047068    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:43.182190 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:43.182107    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:43.335991 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:43.335914    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:43.442227 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:43.442198    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:43.519608 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:43.519577    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:43.619288 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:43.619206    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"]
Sep 10 23:50:43.619477 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:43.619440    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m" podUID="3c63353e-c8ce-4544-a38c-437fb8f5d266" containerName="istio-proxy" containerID="cri-o://e89bdbafa7865ba128674bfdd78b8c9275c38675e33a3964e26a45bcf6708ada" gracePeriod=30
Sep 10 23:50:43.644931 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:43.644887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:43.955899 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:43.955869    2581 generic.go:356] "Generic (PLEG): container finished" podID="21cb341a-dbb5-460c-ba47-1b56f6526917" containerID="f9e3b178bb5bff127f355fac3b862d0ae44797d8a46e57543023a5084a111386" exitCode=0
Sep 10 23:50:43.956073 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:43.955910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm" event={"ID":"21cb341a-dbb5-460c-ba47-1b56f6526917","Type":"ContainerDied","Data":"f9e3b178bb5bff127f355fac3b862d0ae44797d8a46e57543023a5084a111386"}
Sep 10 23:50:43.956323 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:43.956308    2581 scope.go:117] "RemoveContainer" containerID="f9e3b178bb5bff127f355fac3b862d0ae44797d8a46e57543023a5084a111386"
Sep 10 23:50:43.957354 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:43.957323    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:43.957468 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:43.957407    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:43.957468 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:43.957453    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:44.133843 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.133781    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:44.231438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.231340    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:44.360838 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.360801    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:44.650803 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.650729    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"]
Sep 10 23:50:44.654322 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.654305    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.657311 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.657290    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-58451477-gw-openshift-default-dockercfg-lhtkk\""
Sep 10 23:50:44.731130 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.731098    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:44.759610 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.759574    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-workload-certs\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.759610 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.759610    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-envoy\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.759805 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.759643    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-workload-socket\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.759805 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.759711    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istiod-ca-cert\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.759805 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.759764    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-podinfo\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.759900 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.759834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc485\" (UniqueName: \"kubernetes.io/projected/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-kube-api-access-zc485\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.759900 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.759869    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-token\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.759968 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.759910    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-data\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.760002 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.759968    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-credential-socket\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.766768 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.766733    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"]
Sep 10 23:50:44.843850 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.843815    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:44.861393 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.861352    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-podinfo\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.861583 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.861432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc485\" (UniqueName: \"kubernetes.io/projected/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-kube-api-access-zc485\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.861583 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.861461    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-token\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.861583 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.861510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-data\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.861793 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.861586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-credential-socket\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.861793 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.861646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-workload-certs\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.861793 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.861705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-envoy\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.861793 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.861740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-workload-socket\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.861993 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.861810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istiod-ca-cert\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.862236 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.862214    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-credential-socket\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.862557 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.862536    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-data\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.862928 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.862895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-workload-socket\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.863204 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.863181    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-workload-certs\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.863863 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.863809    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istiod-ca-cert\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.868689 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.865618    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-envoy\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.868689 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.866121    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-podinfo\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.880053 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.880017    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc485\" (UniqueName: \"kubernetes.io/projected/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-kube-api-access-zc485\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.885463 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.881928    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-token\") pod \"e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") " pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:44.963853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.963815    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm" event={"ID":"21cb341a-dbb5-460c-ba47-1b56f6526917","Type":"ContainerStarted","Data":"91b7a20a22c29fec3e9ea111885b9f8c14d4b1ff8ce3dde061f3a746ea2ba0f0"}
Sep 10 23:50:44.966047 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:44.966016    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:45.263270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:45.263246    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"]
Sep 10 23:50:45.273575 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:45.272946    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:45.273575 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:45.273034    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:45.273575 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:45.273117    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:50:45.321458 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:45.321434    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:45.321752 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:45.321732    2581 patch_prober.go:28] interesting pod/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 23:50:45.321811 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:45.321779    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm" podUID="21cb341a-dbb5-460c-ba47-1b56f6526917" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 23:50:45.978944 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:45.978910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs" event={"ID":"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93","Type":"ContainerStarted","Data":"dd692e5d434e3ca1982a6a56e1e8ad0a5b5167c454741dcc4012788fc91cdab5"}
Sep 10 23:50:45.979314 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:45.979289    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs" event={"ID":"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93","Type":"ContainerStarted","Data":"0662331376fdb34812195c1e573463966c7c88c4a0606f14de35ee41120a38cb"}
Sep 10 23:50:46.000271 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:46.000215    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs" podStartSLOduration=2.000197444 podStartE2EDuration="2.000197444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:50:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:50:45.99960681 +0000 UTC m=+846.040476117" watchObservedRunningTime="2026-09-10 23:50:46.000197444 +0000 UTC m=+846.041066762"
Sep 10 23:50:46.321186 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:46.321091    2581 patch_prober.go:28] interesting pod/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 23:50:46.321186 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:46.321155    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm" podUID="21cb341a-dbb5-460c-ba47-1b56f6526917" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 23:50:46.968875 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:46.967367    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:46.975456 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:46.975205    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:46.986922 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:46.986846    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:46.988857 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:46.988809    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:50:47.321012 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:47.320932    2581 patch_prober.go:28] interesting pod/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 23:50:47.321012 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:47.320990    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm" podUID="21cb341a-dbb5-460c-ba47-1b56f6526917" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 23:50:47.557151 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:47.557096    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:47.658224 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:47.658128    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:47.800962 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:47.800917    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:47.915529 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:47.915418    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:48.037679 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:48.037642    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:48.321701 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:48.321633    2581 patch_prober.go:28] interesting pod/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 23:50:48.321895 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:48.321719    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm" podUID="21cb341a-dbb5-460c-ba47-1b56f6526917" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 23:50:48.378823 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:48.378792    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:48.486483 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:48.486448    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:48.922354 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:48.922329    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:50:49.003406 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.003373    2581 generic.go:356] "Generic (PLEG): container finished" podID="3c63353e-c8ce-4544-a38c-437fb8f5d266" containerID="e89bdbafa7865ba128674bfdd78b8c9275c38675e33a3964e26a45bcf6708ada" exitCode=0
Sep 10 23:50:49.003579 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.003423    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"
Sep 10 23:50:49.003579 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.003457    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m" event={"ID":"3c63353e-c8ce-4544-a38c-437fb8f5d266","Type":"ContainerDied","Data":"e89bdbafa7865ba128674bfdd78b8c9275c38675e33a3964e26a45bcf6708ada"}
Sep 10 23:50:49.003579 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.003502    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m" event={"ID":"3c63353e-c8ce-4544-a38c-437fb8f5d266","Type":"ContainerDied","Data":"baf05567de27688bd9b7bf3bd799969de1145138f8455f34c59c0e7ad0d04acb"}
Sep 10 23:50:49.003579 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.003517    2581 scope.go:117] "RemoveContainer" containerID="e89bdbafa7865ba128674bfdd78b8c9275c38675e33a3964e26a45bcf6708ada"
Sep 10 23:50:49.012842 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.012827    2581 scope.go:117] "RemoveContainer" containerID="1be375a552b19fc3bd15435523c26494a24f2a180e32e2a826fa8b72461f82c1"
Sep 10 23:50:49.014925 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.014905    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-credential-socket\") pod \"3c63353e-c8ce-4544-a38c-437fb8f5d266\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") "
Sep 10 23:50:49.015010 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.014948    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-workload-certs\") pod \"3c63353e-c8ce-4544-a38c-437fb8f5d266\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") "
Sep 10 23:50:49.015010 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.014970    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c63353e-c8ce-4544-a38c-437fb8f5d266-istiod-ca-cert\") pod \"3c63353e-c8ce-4544-a38c-437fb8f5d266\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") "
Sep 10 23:50:49.015010 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.014998    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-podinfo\") pod \"3c63353e-c8ce-4544-a38c-437fb8f5d266\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") "
Sep 10 23:50:49.015133 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.015048    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-envoy\") pod \"3c63353e-c8ce-4544-a38c-437fb8f5d266\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") "
Sep 10 23:50:49.015133 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.015079    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75wcn\" (UniqueName: \"kubernetes.io/projected/3c63353e-c8ce-4544-a38c-437fb8f5d266-kube-api-access-75wcn\") pod \"3c63353e-c8ce-4544-a38c-437fb8f5d266\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") "
Sep 10 23:50:49.015133 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.015123    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-data\") pod \"3c63353e-c8ce-4544-a38c-437fb8f5d266\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") "
Sep 10 23:50:49.015262 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.015180    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-workload-socket\") pod \"3c63353e-c8ce-4544-a38c-437fb8f5d266\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") "
Sep 10 23:50:49.015262 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.015188    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3c63353e-c8ce-4544-a38c-437fb8f5d266" (UID: "3c63353e-c8ce-4544-a38c-437fb8f5d266"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:49.015262 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.015207    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-token\") pod \"3c63353e-c8ce-4544-a38c-437fb8f5d266\" (UID: \"3c63353e-c8ce-4544-a38c-437fb8f5d266\") "
Sep 10 23:50:49.015262 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.015212    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3c63353e-c8ce-4544-a38c-437fb8f5d266" (UID: "3c63353e-c8ce-4544-a38c-437fb8f5d266"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:49.015463 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.015433    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c63353e-c8ce-4544-a38c-437fb8f5d266-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3c63353e-c8ce-4544-a38c-437fb8f5d266" (UID: "3c63353e-c8ce-4544-a38c-437fb8f5d266"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:50:49.015463 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.015419    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-data" (OuterVolumeSpecName: "istio-data") pod "3c63353e-c8ce-4544-a38c-437fb8f5d266" (UID: "3c63353e-c8ce-4544-a38c-437fb8f5d266"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:49.015580 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.015467    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3c63353e-c8ce-4544-a38c-437fb8f5d266" (UID: "3c63353e-c8ce-4544-a38c-437fb8f5d266"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:49.015636 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.015595    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-data\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:50:49.015636 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.015610    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-workload-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:50:49.015636 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.015618    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-credential-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:50:49.015636 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.015629    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-workload-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:50:49.015636 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.015637    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c63353e-c8ce-4544-a38c-437fb8f5d266-istiod-ca-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:50:49.017660 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.017628    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3c63353e-c8ce-4544-a38c-437fb8f5d266" (UID: "3c63353e-c8ce-4544-a38c-437fb8f5d266"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:50:49.017660 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.017640    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c63353e-c8ce-4544-a38c-437fb8f5d266-kube-api-access-75wcn" (OuterVolumeSpecName: "kube-api-access-75wcn") pod "3c63353e-c8ce-4544-a38c-437fb8f5d266" (UID: "3c63353e-c8ce-4544-a38c-437fb8f5d266"). InnerVolumeSpecName "kube-api-access-75wcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:50:49.017853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.017757    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-token" (OuterVolumeSpecName: "istio-token") pod "3c63353e-c8ce-4544-a38c-437fb8f5d266" (UID: "3c63353e-c8ce-4544-a38c-437fb8f5d266"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:50:49.017853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.017791    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3c63353e-c8ce-4544-a38c-437fb8f5d266" (UID: "3c63353e-c8ce-4544-a38c-437fb8f5d266"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:50:49.036099 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.036078    2581 scope.go:117] "RemoveContainer" containerID="e89bdbafa7865ba128674bfdd78b8c9275c38675e33a3964e26a45bcf6708ada"
Sep 10 23:50:49.036386 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:50:49.036365    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e89bdbafa7865ba128674bfdd78b8c9275c38675e33a3964e26a45bcf6708ada\": container with ID starting with e89bdbafa7865ba128674bfdd78b8c9275c38675e33a3964e26a45bcf6708ada not found: ID does not exist" containerID="e89bdbafa7865ba128674bfdd78b8c9275c38675e33a3964e26a45bcf6708ada"
Sep 10 23:50:49.036468 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.036398    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e89bdbafa7865ba128674bfdd78b8c9275c38675e33a3964e26a45bcf6708ada"} err="failed to get container status \"e89bdbafa7865ba128674bfdd78b8c9275c38675e33a3964e26a45bcf6708ada\": rpc error: code = NotFound desc = could not find container \"e89bdbafa7865ba128674bfdd78b8c9275c38675e33a3964e26a45bcf6708ada\": container with ID starting with e89bdbafa7865ba128674bfdd78b8c9275c38675e33a3964e26a45bcf6708ada not found: ID does not exist"
Sep 10 23:50:49.036468 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.036422    2581 scope.go:117] "RemoveContainer" containerID="1be375a552b19fc3bd15435523c26494a24f2a180e32e2a826fa8b72461f82c1"
Sep 10 23:50:49.036733 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:50:49.036711    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1be375a552b19fc3bd15435523c26494a24f2a180e32e2a826fa8b72461f82c1\": container with ID starting with 1be375a552b19fc3bd15435523c26494a24f2a180e32e2a826fa8b72461f82c1 not found: ID does not exist" containerID="1be375a552b19fc3bd15435523c26494a24f2a180e32e2a826fa8b72461f82c1"
Sep 10 23:50:49.036784 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.036741    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be375a552b19fc3bd15435523c26494a24f2a180e32e2a826fa8b72461f82c1"} err="failed to get container status \"1be375a552b19fc3bd15435523c26494a24f2a180e32e2a826fa8b72461f82c1\": rpc error: code = NotFound desc = could not find container \"1be375a552b19fc3bd15435523c26494a24f2a180e32e2a826fa8b72461f82c1\": container with ID starting with 1be375a552b19fc3bd15435523c26494a24f2a180e32e2a826fa8b72461f82c1 not found: ID does not exist"
Sep 10 23:50:49.116356 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.116322    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-podinfo\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:50:49.116356 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.116355    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-envoy\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:50:49.116629 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.116372    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75wcn\" (UniqueName: \"kubernetes.io/projected/3c63353e-c8ce-4544-a38c-437fb8f5d266-kube-api-access-75wcn\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:50:49.116629 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.116384    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c63353e-c8ce-4544-a38c-437fb8f5d266-istio-token\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:50:49.320627 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.320591    2581 patch_prober.go:28] interesting pod/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 23:50:49.320792 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.320657    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm" podUID="21cb341a-dbb5-460c-ba47-1b56f6526917" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 23:50:49.326303 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:50:49.326272    2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c63353e_c8ce_4544_a38c_437fb8f5d266.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c63353e_c8ce_4544_a38c_437fb8f5d266.slice/crio-baf05567de27688bd9b7bf3bd799969de1145138f8455f34c59c0e7ad0d04acb\": RecentStats: unable to find data in memory cache]"
Sep 10 23:50:49.328112 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.328065    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"]
Sep 10 23:50:49.330438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.330420    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m"]
Sep 10 23:50:49.739120 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:49.739085    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:50.324381 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:50.324354    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:50.324818 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:50.324624    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:50.325381 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:50.325365    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:50:50.486477 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:50.486436    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c63353e-c8ce-4544-a38c-437fb8f5d266" path="/var/lib/kubelet/pods/3c63353e-c8ce-4544-a38c-437fb8f5d266/volumes"
Sep 10 23:50:51.830278 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:51.830246    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:50:54.830934 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:50:54.830905    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:51:07.127783 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:07.127749    2581 generic.go:356] "Generic (PLEG): container finished" podID="c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" containerID="dd692e5d434e3ca1982a6a56e1e8ad0a5b5167c454741dcc4012788fc91cdab5" exitCode=0
Sep 10 23:51:07.128236 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:07.127795    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs" event={"ID":"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93","Type":"ContainerDied","Data":"dd692e5d434e3ca1982a6a56e1e8ad0a5b5167c454741dcc4012788fc91cdab5"}
Sep 10 23:51:07.128236 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:07.128167    2581 scope.go:117] "RemoveContainer" containerID="dd692e5d434e3ca1982a6a56e1e8ad0a5b5167c454741dcc4012788fc91cdab5"
Sep 10 23:51:07.129256 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:07.129222    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:51:07.129349 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:07.129306    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:51:07.129388 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:07.129350    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:51:08.135290 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:08.135254    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs" event={"ID":"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93","Type":"ContainerStarted","Data":"56a01fd90e8742cb5b5b3d4b247de14a8d62daa533c52537e0a0b9e2c4732ff0"}
Sep 10 23:51:08.967158 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:08.967121    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:51:08.967466 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:08.967154    2581 patch_prober.go:28] interesting pod/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 10 23:51:08.967638 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:08.967612    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs" podUID="c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 10 23:51:08.979376 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:08.979336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:09.967228 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:09.967181    2581 patch_prober.go:28] interesting pod/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 10 23:51:09.967762 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:09.967278    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs" podUID="c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 10 23:51:10.967776 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:10.967734    2581 patch_prober.go:28] interesting pod/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 10 23:51:10.968258 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:10.967807    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs" podUID="c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 10 23:51:11.967064 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:11.967019    2581 patch_prober.go:28] interesting pod/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 10 23:51:11.967288 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:11.967103    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs" podUID="c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 10 23:51:12.477544 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:12.477499    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-58451477-8cd7n"]
Sep 10 23:51:12.478119 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:12.478095    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c63353e-c8ce-4544-a38c-437fb8f5d266" containerName="istio-proxy"
Sep 10 23:51:12.478215 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:12.478122    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c63353e-c8ce-4544-a38c-437fb8f5d266" containerName="istio-proxy"
Sep 10 23:51:12.478277 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:12.478238    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c63353e-c8ce-4544-a38c-437fb8f5d266" containerName="istio-proxy"
Sep 10 23:51:12.478277 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:12.478253    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c63353e-c8ce-4544-a38c-437fb8f5d266" containerName="istio-proxy"
Sep 10 23:51:12.485429 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:12.485405    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-58451477-8cd7n"
Sep 10 23:51:12.490795 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:12.490764    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22lrj\""
Sep 10 23:51:12.492272 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:12.492106    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:51:12.494811 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:12.494700    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-58451477-8cd7n"]
Sep 10 23:51:12.641889 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:12.641851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fade70ea-5db6-4bde-af81-ec2d9436eb70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-58451477-8cd7n\" (UID: \"fade70ea-5db6-4bde-af81-ec2d9436eb70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-58451477-8cd7n"
Sep 10 23:51:12.743223 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:12.743143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fade70ea-5db6-4bde-af81-ec2d9436eb70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-58451477-8cd7n\" (UID: \"fade70ea-5db6-4bde-af81-ec2d9436eb70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-58451477-8cd7n"
Sep 10 23:51:12.743764 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:12.743745    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fade70ea-5db6-4bde-af81-ec2d9436eb70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-58451477-8cd7n\" (UID: \"fade70ea-5db6-4bde-af81-ec2d9436eb70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-58451477-8cd7n"
Sep 10 23:51:12.804892 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:12.804856    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-58451477-8cd7n"
Sep 10 23:51:12.977603 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:12.977094    2581 patch_prober.go:28] interesting pod/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 10 23:51:12.977603 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:12.977172    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs" podUID="c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 10 23:51:13.085651 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:13.085503    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-58451477-8cd7n"]
Sep 10 23:51:13.098287 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:51:13.098258    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfade70ea_5db6_4bde_af81_ec2d9436eb70.slice/crio-d3fcd2fcbb7942151368a7d206673e96968f6ad38202b93b0c1ef344973df59e WatchSource:0}: Error finding container d3fcd2fcbb7942151368a7d206673e96968f6ad38202b93b0c1ef344973df59e: Status 404 returned error can't find the container with id d3fcd2fcbb7942151368a7d206673e96968f6ad38202b93b0c1ef344973df59e
Sep 10 23:51:13.176911 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:13.176874    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-58451477-8cd7n" event={"ID":"fade70ea-5db6-4bde-af81-ec2d9436eb70","Type":"ContainerStarted","Data":"d3fcd2fcbb7942151368a7d206673e96968f6ad38202b93b0c1ef344973df59e"}
Sep 10 23:51:13.970795 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:13.970764    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:51:13.971278 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:13.971126    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:51:13.971916 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:13.971900    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:51:18.135634 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:18.135602    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:51:21.534260 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:21.534229    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:23.840437 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:23.840403    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"]
Sep 10 23:51:23.840875 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:23.840861    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c63353e-c8ce-4544-a38c-437fb8f5d266" containerName="istio-proxy"
Sep 10 23:51:23.840918 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:23.840877    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c63353e-c8ce-4544-a38c-437fb8f5d266" containerName="istio-proxy"
Sep 10 23:51:23.845247 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:23.845231    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:23.848079 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:23.848059    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-d43a0552-kserve-self-signed-certs\""
Sep 10 23:51:23.858031 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:23.858005    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"]
Sep 10 23:51:23.880820 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:23.880774    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:23.953105 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:23.953061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-tls-certs\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:23.953414 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:23.953382    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6286m\" (UniqueName: \"kubernetes.io/projected/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-kube-api-access-6286m\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:23.953553 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:23.953471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-model-cache\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:23.953553 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:23.953523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-dshm\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:23.953553 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:23.953541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-tmp-dir\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:23.953815 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:23.953609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-home\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:24.054395 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:24.054346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-tls-certs\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:24.054615 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:24.054415    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6286m\" (UniqueName: \"kubernetes.io/projected/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-kube-api-access-6286m\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:24.054615 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:24.054456    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-model-cache\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:24.054615 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:24.054478    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-dshm\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:24.054842 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:24.054612    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-tmp-dir\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:24.054842 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:24.054738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-home\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:24.054981 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:24.054960    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-model-cache\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:24.055033 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:24.054976    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-tmp-dir\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:24.055090 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:24.055070    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-home\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:24.056840 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:24.056817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-dshm\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:24.057163 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:24.057146    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-tls-certs\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:24.065258 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:24.065234    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6286m\" (UniqueName: \"kubernetes.io/projected/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-kube-api-access-6286m\") pod \"e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") " pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:24.155392 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:24.155303    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:24.437883 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:24.437852    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"]
Sep 10 23:51:24.439027 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:51:24.439001    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf1bd645_6d4f_4ac1_b9e7_d9c1ca8834de.slice/crio-972312fb1d3a360d630bc5cfbd38080bed6ad53f9c5dd24396946c71dd60079b WatchSource:0}: Error finding container 972312fb1d3a360d630bc5cfbd38080bed6ad53f9c5dd24396946c71dd60079b: Status 404 returned error can't find the container with id 972312fb1d3a360d630bc5cfbd38080bed6ad53f9c5dd24396946c71dd60079b
Sep 10 23:51:25.260824 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:25.260780    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz" event={"ID":"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de","Type":"ContainerStarted","Data":"00091f0f0918100f1ec8a2075ed37b6803c46c1a25a7a89019f9c7a71b993378"}
Sep 10 23:51:25.261266 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:25.260834    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz" event={"ID":"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de","Type":"ContainerStarted","Data":"972312fb1d3a360d630bc5cfbd38080bed6ad53f9c5dd24396946c71dd60079b"}
Sep 10 23:51:25.279156 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:25.279104    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz" podStartSLOduration=2.279086552 podStartE2EDuration="2.279086552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:51:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:51:25.277511382 +0000 UTC m=+885.318380689" watchObservedRunningTime="2026-09-10 23:51:25.279086552 +0000 UTC m=+885.319955894"
Sep 10 23:51:27.276834 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:27.276738    2581 generic.go:356] "Generic (PLEG): container finished" podID="fade70ea-5db6-4bde-af81-ec2d9436eb70" containerID="d7b9b851c185d1d32dc0c203f4d6a274aa4debdf8f8e28938383abe0bcf701e2" exitCode=0
Sep 10 23:51:27.276834 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:27.276821    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-58451477-8cd7n" event={"ID":"fade70ea-5db6-4bde-af81-ec2d9436eb70","Type":"ContainerDied","Data":"d7b9b851c185d1d32dc0c203f4d6a274aa4debdf8f8e28938383abe0bcf701e2"}
Sep 10 23:51:28.421832 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:28.421809    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-58451477-8cd7n"
Sep 10 23:51:28.598470 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:28.598391    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fade70ea-5db6-4bde-af81-ec2d9436eb70-maas-api-service-ca\") pod \"fade70ea-5db6-4bde-af81-ec2d9436eb70\" (UID: \"fade70ea-5db6-4bde-af81-ec2d9436eb70\") "
Sep 10 23:51:28.598739 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:28.598717    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fade70ea-5db6-4bde-af81-ec2d9436eb70-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fade70ea-5db6-4bde-af81-ec2d9436eb70" (UID: "fade70ea-5db6-4bde-af81-ec2d9436eb70"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:51:28.699200 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:28.699167    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fade70ea-5db6-4bde-af81-ec2d9436eb70-maas-api-service-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:51:29.290449 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.290417    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-58451477-8cd7n"
Sep 10 23:51:29.290449 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.290428    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-58451477-8cd7n" event={"ID":"fade70ea-5db6-4bde-af81-ec2d9436eb70","Type":"ContainerDied","Data":"d3fcd2fcbb7942151368a7d206673e96968f6ad38202b93b0c1ef344973df59e"}
Sep 10 23:51:29.290700 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.290476    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3fcd2fcbb7942151368a7d206673e96968f6ad38202b93b0c1ef344973df59e"
Sep 10 23:51:29.734733 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.734703    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"]
Sep 10 23:51:29.735228 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.735210    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fade70ea-5db6-4bde-af81-ec2d9436eb70" containerName="revoke-keys"
Sep 10 23:51:29.735353 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.735230    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fade70ea-5db6-4bde-af81-ec2d9436eb70" containerName="revoke-keys"
Sep 10 23:51:29.735353 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.735303    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fade70ea-5db6-4bde-af81-ec2d9436eb70" containerName="revoke-keys"
Sep 10 23:51:29.738611 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.738591    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:29.741452 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.741425    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-66836f\"/\"default-dockercfg-86wk8\""
Sep 10 23:51:29.741603 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.741427    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-66836f\"/\"kube-root-ca.crt\""
Sep 10 23:51:29.742621 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.742593    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-66836f\"/\"openshift-service-ca.crt\""
Sep 10 23:51:29.742788 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.742645    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-66836f\"/\"autores-model-66836f-kserve-self-signed-certs\""
Sep 10 23:51:29.750273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.750226    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"]
Sep 10 23:51:29.766479 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.766445    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:29.910784 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.910746    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-dshm\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:29.910979 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.910811    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-home\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:29.910979 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.910867    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bntbw\" (UniqueName: \"kubernetes.io/projected/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-kube-api-access-bntbw\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:29.910979 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.910926    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-model-cache\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:29.910979 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.910965    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-tls-certs\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:29.911147 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:29.910995    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-tmp-dir\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:30.012149 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:30.012063    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bntbw\" (UniqueName: \"kubernetes.io/projected/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-kube-api-access-bntbw\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:30.012149 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:30.012106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-model-cache\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:30.012149 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:30.012144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-tls-certs\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:30.012376 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:30.012180    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-tmp-dir\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:30.012376 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:30.012273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-dshm\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:30.012376 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:30.012330    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-home\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:30.012537 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:30.012517    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-model-cache\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:30.012577 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:30.012557    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-tmp-dir\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:30.012619 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:30.012582    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-home\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:30.014606 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:30.014581    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-dshm\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:30.014835 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:30.014820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-tls-certs\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:30.020397 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:30.020374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bntbw\" (UniqueName: \"kubernetes.io/projected/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-kube-api-access-bntbw\") pod \"autores-model-66836f-kserve-c58954987-crbc5\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") " pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:30.052044 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:30.052018    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:30.328272 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:30.328248    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"]
Sep 10 23:51:30.330002 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:51:30.329979    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3eb1a6d_0fc2_4259_a978_4d25f2f94718.slice/crio-274d9508bbc9cc46d4d6eb506c2902b18006342940731e873be3a0af26f52ed0 WatchSource:0}: Error finding container 274d9508bbc9cc46d4d6eb506c2902b18006342940731e873be3a0af26f52ed0: Status 404 returned error can't find the container with id 274d9508bbc9cc46d4d6eb506c2902b18006342940731e873be3a0af26f52ed0
Sep 10 23:51:31.304167 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:31.304131    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5" event={"ID":"d3eb1a6d-0fc2-4259-a978-4d25f2f94718","Type":"ContainerStarted","Data":"e647b314f44500f4741df3cba04ef3f64e48ba208694a8318fc6b6109c1d694f"}
Sep 10 23:51:31.304167 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:31.304169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5" event={"ID":"d3eb1a6d-0fc2-4259-a978-4d25f2f94718","Type":"ContainerStarted","Data":"274d9508bbc9cc46d4d6eb506c2902b18006342940731e873be3a0af26f52ed0"}
Sep 10 23:51:31.329694 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:31.329418    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5" podStartSLOduration=2.329397569 podStartE2EDuration="2.329397569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:51:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:51:31.326540544 +0000 UTC m=+891.367409850" watchObservedRunningTime="2026-09-10 23:51:31.329397569 +0000 UTC m=+891.370266875"
Sep 10 23:51:34.155562 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:34.155530    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:34.155965 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:34.155580    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:34.171110 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:34.171081    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:34.332333 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:34.332296    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:51:34.635809 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:34.635774    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:51:38.931802 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:38.931761    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:39.617739 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.617701    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"]
Sep 10 23:51:39.621179 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.621163    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.624556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.624531    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ce1dd5\"/\"kube-root-ca.crt\""
Sep 10 23:51:39.624556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.624546    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ce1dd5\"/\"test-model-ce1dd5-kserve-self-signed-certs\""
Sep 10 23:51:39.624766 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.624532    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ce1dd5\"/\"openshift-service-ca.crt\""
Sep 10 23:51:39.624766 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.624546    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ce1dd5\"/\"default-dockercfg-8f8pj\""
Sep 10 23:51:39.630970 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.630947    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"]
Sep 10 23:51:39.692734 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.692700    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:39.703992 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.703960    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d872730-6f79-4e83-9a57-a67660dd9bd3-tls-certs\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.704119 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.704017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-home\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.704119 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.704086    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-766vf\" (UniqueName: \"kubernetes.io/projected/0d872730-6f79-4e83-9a57-a67660dd9bd3-kube-api-access-766vf\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.704210 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.704123    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-model-cache\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.704210 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.704173    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-tmp-dir\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.704310 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.704289    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-dshm\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.761892 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.761860    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:39.805060 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.805027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-model-cache\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.805243 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.805091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-tmp-dir\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.805243 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.805157    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-dshm\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.805243 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.805199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d872730-6f79-4e83-9a57-a67660dd9bd3-tls-certs\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.805243 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.805238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-home\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.805477 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.805269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-766vf\" (UniqueName: \"kubernetes.io/projected/0d872730-6f79-4e83-9a57-a67660dd9bd3-kube-api-access-766vf\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.805477 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.805464    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-model-cache\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.805633 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.805616    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-tmp-dir\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.805885 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.805863    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-home\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.807555 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.807525    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-dshm\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.807958 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.807942    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d872730-6f79-4e83-9a57-a67660dd9bd3-tls-certs\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.812900 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.812880    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-766vf\" (UniqueName: \"kubernetes.io/projected/0d872730-6f79-4e83-9a57-a67660dd9bd3-kube-api-access-766vf\") pod \"test-model-ce1dd5-kserve-9bfbb4665-9jxwz\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") " pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.821628 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.821604    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:39.901961 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.901885    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-58451477-8cd7n"]
Sep 10 23:51:39.904437 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.904420    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-58451477-8cd7n"]
Sep 10 23:51:39.917656 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.917634    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:39.931656 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.931624    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:39.986551 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:39.986520    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:40.025838 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:40.025807    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"]
Sep 10 23:51:40.026618 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:40.026586    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs" podUID="c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" containerName="istio-proxy" containerID="cri-o://56a01fd90e8742cb5b5b3d4b247de14a8d62daa533c52537e0a0b9e2c4732ff0" gracePeriod=30
Sep 10 23:51:40.052594 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:40.052564    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:40.052964 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:40.052611    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:40.058288 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:40.058248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:40.066810 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:40.066779    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:40.214153 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:40.214114    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"]
Sep 10 23:51:40.215309 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:51:40.215272    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d872730_6f79_4e83_9a57_a67660dd9bd3.slice/crio-ec536b8990dd305b2cfd0c6284813873cf22350ee07e5184080fcbb669837ef6 WatchSource:0}: Error finding container ec536b8990dd305b2cfd0c6284813873cf22350ee07e5184080fcbb669837ef6: Status 404 returned error can't find the container with id ec536b8990dd305b2cfd0c6284813873cf22350ee07e5184080fcbb669837ef6
Sep 10 23:51:40.357693 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:40.357633    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz" event={"ID":"0d872730-6f79-4e83-9a57-a67660dd9bd3","Type":"ContainerStarted","Data":"970f7c9bdca1f95d438c14207704b18fdefe1dc5109698e72bc75bdfe961b773"}
Sep 10 23:51:40.357693 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:40.357694    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz" event={"ID":"0d872730-6f79-4e83-9a57-a67660dd9bd3","Type":"ContainerStarted","Data":"ec536b8990dd305b2cfd0c6284813873cf22350ee07e5184080fcbb669837ef6"}
Sep 10 23:51:40.369473 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:40.369449    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:51:40.375663 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:40.375622    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz" podStartSLOduration=1.3756085 podStartE2EDuration="1.3756085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:51:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:51:40.374819146 +0000 UTC m=+900.415688451" watchObservedRunningTime="2026-09-10 23:51:40.3756085 +0000 UTC m=+900.416477805"
Sep 10 23:51:40.461657 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:40.461611    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:40.485717 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:40.485597    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fade70ea-5db6-4bde-af81-ec2d9436eb70" path="/var/lib/kubelet/pods/fade70ea-5db6-4bde-af81-ec2d9436eb70/volumes"
Sep 10 23:51:40.789499 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:40.789429    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:41.209780 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:41.209749    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:43.328924 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:43.328892    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:43.413635 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:43.413602    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:43.973197 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:43.973163    2581 patch_prober.go:28] interesting pod/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 23:51:43.973364 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:43.973251    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs" podUID="c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 23:51:44.689995 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:44.689957    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:44.786393 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:44.786361    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:44.886799 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:44.886768    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:45.239241 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.239212    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:45.300541 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.300485    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:51:45.339447 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.339413    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:45.357632 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.357604    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-envoy\") pod \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") "
Sep 10 23:51:45.357814 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.357638    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-token\") pod \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") "
Sep 10 23:51:45.357814 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.357693    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-credential-socket\") pod \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") "
Sep 10 23:51:45.357814 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.357721    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-podinfo\") pod \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") "
Sep 10 23:51:45.357814 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.357739    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-data\") pod \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") "
Sep 10 23:51:45.357814 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.357811    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc485\" (UniqueName: \"kubernetes.io/projected/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-kube-api-access-zc485\") pod \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") "
Sep 10 23:51:45.358092 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.357850    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-workload-certs\") pod \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") "
Sep 10 23:51:45.358092 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.357883    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-workload-socket\") pod \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") "
Sep 10 23:51:45.358092 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.357916    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istiod-ca-cert\") pod \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\" (UID: \"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93\") "
Sep 10 23:51:45.358092 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.358006    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" (UID: "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:51:45.358092 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.358067    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-data" (OuterVolumeSpecName: "istio-data") pod "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" (UID: "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:51:45.358364 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.358270    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" (UID: "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:51:45.358364 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.358347    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-data\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:51:45.358630 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.358366    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-credential-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:51:45.358630 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.358412    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" (UID: "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:51:45.358630 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.358531    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" (UID: "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:51:45.360015 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.359990    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" (UID: "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:51:45.360127 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.360041    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-token" (OuterVolumeSpecName: "istio-token") pod "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" (UID: "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:51:45.360127 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.360105    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" (UID: "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:51:45.360298 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.360241    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-kube-api-access-zc485" (OuterVolumeSpecName: "kube-api-access-zc485") pod "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" (UID: "c9dbc86a-bae9-4b0d-bdb5-cc2669231e93"). InnerVolumeSpecName "kube-api-access-zc485". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:51:45.393007 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.392976    2581 generic.go:356] "Generic (PLEG): container finished" podID="c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" containerID="56a01fd90e8742cb5b5b3d4b247de14a8d62daa533c52537e0a0b9e2c4732ff0" exitCode=0
Sep 10 23:51:45.393151 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.393012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs" event={"ID":"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93","Type":"ContainerDied","Data":"56a01fd90e8742cb5b5b3d4b247de14a8d62daa533c52537e0a0b9e2c4732ff0"}
Sep 10 23:51:45.393151 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.393069    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs" event={"ID":"c9dbc86a-bae9-4b0d-bdb5-cc2669231e93","Type":"ContainerDied","Data":"0662331376fdb34812195c1e573463966c7c88c4a0606f14de35ee41120a38cb"}
Sep 10 23:51:45.393151 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.393103    2581 scope.go:117] "RemoveContainer" containerID="56a01fd90e8742cb5b5b3d4b247de14a8d62daa533c52537e0a0b9e2c4732ff0"
Sep 10 23:51:45.393270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.393022    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"
Sep 10 23:51:45.403328 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.403310    2581 scope.go:117] "RemoveContainer" containerID="dd692e5d434e3ca1982a6a56e1e8ad0a5b5167c454741dcc4012788fc91cdab5"
Sep 10 23:51:45.412020 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.412002    2581 scope.go:117] "RemoveContainer" containerID="56a01fd90e8742cb5b5b3d4b247de14a8d62daa533c52537e0a0b9e2c4732ff0"
Sep 10 23:51:45.412277 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:51:45.412259    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56a01fd90e8742cb5b5b3d4b247de14a8d62daa533c52537e0a0b9e2c4732ff0\": container with ID starting with 56a01fd90e8742cb5b5b3d4b247de14a8d62daa533c52537e0a0b9e2c4732ff0 not found: ID does not exist" containerID="56a01fd90e8742cb5b5b3d4b247de14a8d62daa533c52537e0a0b9e2c4732ff0"
Sep 10 23:51:45.412348 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.412284    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a01fd90e8742cb5b5b3d4b247de14a8d62daa533c52537e0a0b9e2c4732ff0"} err="failed to get container status \"56a01fd90e8742cb5b5b3d4b247de14a8d62daa533c52537e0a0b9e2c4732ff0\": rpc error: code = NotFound desc = could not find container \"56a01fd90e8742cb5b5b3d4b247de14a8d62daa533c52537e0a0b9e2c4732ff0\": container with ID starting with 56a01fd90e8742cb5b5b3d4b247de14a8d62daa533c52537e0a0b9e2c4732ff0 not found: ID does not exist"
Sep 10 23:51:45.412348 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.412301    2581 scope.go:117] "RemoveContainer" containerID="dd692e5d434e3ca1982a6a56e1e8ad0a5b5167c454741dcc4012788fc91cdab5"
Sep 10 23:51:45.412548 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:51:45.412530    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd692e5d434e3ca1982a6a56e1e8ad0a5b5167c454741dcc4012788fc91cdab5\": container with ID starting with dd692e5d434e3ca1982a6a56e1e8ad0a5b5167c454741dcc4012788fc91cdab5 not found: ID does not exist" containerID="dd692e5d434e3ca1982a6a56e1e8ad0a5b5167c454741dcc4012788fc91cdab5"
Sep 10 23:51:45.412622 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.412551    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd692e5d434e3ca1982a6a56e1e8ad0a5b5167c454741dcc4012788fc91cdab5"} err="failed to get container status \"dd692e5d434e3ca1982a6a56e1e8ad0a5b5167c454741dcc4012788fc91cdab5\": rpc error: code = NotFound desc = could not find container \"dd692e5d434e3ca1982a6a56e1e8ad0a5b5167c454741dcc4012788fc91cdab5\": container with ID starting with dd692e5d434e3ca1982a6a56e1e8ad0a5b5167c454741dcc4012788fc91cdab5 not found: ID does not exist"
Sep 10 23:51:45.426266 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.426241    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"]
Sep 10 23:51:45.429592 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.429567    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs"]
Sep 10 23:51:45.459347 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.459316    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc485\" (UniqueName: \"kubernetes.io/projected/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-kube-api-access-zc485\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:51:45.459347 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.459338    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-workload-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:51:45.459347 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.459348    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-workload-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:51:45.459600 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.459357    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istiod-ca-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:51:45.459600 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.459365    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-envoy\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:51:45.459600 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.459373    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-token\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:51:45.459600 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:45.459380    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93-istio-podinfo\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:51:46.484040 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:46.484008    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" path="/var/lib/kubelet/pods/c9dbc86a-bae9-4b0d-bdb5-cc2669231e93/volumes"
Sep 10 23:51:49.916118 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:49.916078    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"]
Sep 10 23:51:49.931267 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:49.931239    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:49.932055 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:49.932035    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:49.932153 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:49.932077    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:49.945002 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:49.944977    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:50.440427 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:50.440400    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:51:55.227843 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.227810    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"]
Sep 10 23:51:55.258211 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.258185    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:55.324342 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.324309    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2"]
Sep 10 23:51:55.324866 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.324845    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" containerName="istio-proxy"
Sep 10 23:51:55.324866 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.324866    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" containerName="istio-proxy"
Sep 10 23:51:55.325053 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.324995    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" containerName="istio-proxy"
Sep 10 23:51:55.325053 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.325006    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" containerName="istio-proxy"
Sep 10 23:51:55.330044 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.330023    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2"
Sep 10 23:51:55.333660 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.333634    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:51:55.333789 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.333735    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22lrj\""
Sep 10 23:51:55.340622 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.340594    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2"]
Sep 10 23:51:55.447832 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.447794    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:51:55.456763 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.456730    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62452568-a021-4e3f-bda0-be76af8bc8a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-66836f-g2tp2\" (UID: \"62452568-a021-4e3f-bda0-be76af8bc8a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2"
Sep 10 23:51:55.557905 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.557820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62452568-a021-4e3f-bda0-be76af8bc8a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-66836f-g2tp2\" (UID: \"62452568-a021-4e3f-bda0-be76af8bc8a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2"
Sep 10 23:51:55.558425 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.558406    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62452568-a021-4e3f-bda0-be76af8bc8a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-66836f-g2tp2\" (UID: \"62452568-a021-4e3f-bda0-be76af8bc8a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2"
Sep 10 23:51:55.642161 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.642128    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2"
Sep 10 23:51:55.917842 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:55.917816    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2"]
Sep 10 23:51:55.920615 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:51:55.920576    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62452568_a021_4e3f_bda0_be76af8bc8a4.slice/crio-0af15f706c478a8e9c065a7aa44586744ff601722a6cf175b025f47d36991543 WatchSource:0}: Error finding container 0af15f706c478a8e9c065a7aa44586744ff601722a6cf175b025f47d36991543: Status 404 returned error can't find the container with id 0af15f706c478a8e9c065a7aa44586744ff601722a6cf175b025f47d36991543
Sep 10 23:51:56.466055 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:56.466015    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2" event={"ID":"62452568-a021-4e3f-bda0-be76af8bc8a4","Type":"ContainerStarted","Data":"7554e11386c4d3bc4954731dc919213c2b032efbd95a2359b80c9d344994b0d3"}
Sep 10 23:51:56.466523 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:56.466082    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2" event={"ID":"62452568-a021-4e3f-bda0-be76af8bc8a4","Type":"ContainerStarted","Data":"0af15f706c478a8e9c065a7aa44586744ff601722a6cf175b025f47d36991543"}
Sep 10 23:51:56.483482 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:56.483434    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2" podStartSLOduration=1.483419474 podStartE2EDuration="1.483419474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:51:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:51:56.481879406 +0000 UTC m=+916.522748713" watchObservedRunningTime="2026-09-10 23:51:56.483419474 +0000 UTC m=+916.524288779"
Sep 10 23:51:57.475036 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:57.475000    2581 generic.go:356] "Generic (PLEG): container finished" podID="62452568-a021-4e3f-bda0-be76af8bc8a4" containerID="7554e11386c4d3bc4954731dc919213c2b032efbd95a2359b80c9d344994b0d3" exitCode=0
Sep 10 23:51:57.475451 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:57.475044    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2" event={"ID":"62452568-a021-4e3f-bda0-be76af8bc8a4","Type":"ContainerDied","Data":"7554e11386c4d3bc4954731dc919213c2b032efbd95a2359b80c9d344994b0d3"}
Sep 10 23:51:58.619420 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:58.619398    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2"
Sep 10 23:51:58.685154 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:58.685125    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62452568-a021-4e3f-bda0-be76af8bc8a4-maas-api-service-ca\") pod \"62452568-a021-4e3f-bda0-be76af8bc8a4\" (UID: \"62452568-a021-4e3f-bda0-be76af8bc8a4\") "
Sep 10 23:51:58.685480 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:58.685453    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62452568-a021-4e3f-bda0-be76af8bc8a4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "62452568-a021-4e3f-bda0-be76af8bc8a4" (UID: "62452568-a021-4e3f-bda0-be76af8bc8a4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:51:58.786400 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:58.786325    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62452568-a021-4e3f-bda0-be76af8bc8a4-maas-api-service-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:51:59.487160 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:59.487122    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2" event={"ID":"62452568-a021-4e3f-bda0-be76af8bc8a4","Type":"ContainerDied","Data":"0af15f706c478a8e9c065a7aa44586744ff601722a6cf175b025f47d36991543"}
Sep 10 23:51:59.487455 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:59.487178    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0af15f706c478a8e9c065a7aa44586744ff601722a6cf175b025f47d36991543"
Sep 10 23:51:59.487455 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:51:59.487137    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2"
Sep 10 23:52:00.219906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:00.219873    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:52:04.939745 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:04.939701    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz" podUID="df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de" containerName="main" containerID="cri-o://00091f0f0918100f1ec8a2075ed37b6803c46c1a25a7a89019f9c7a71b993378" gracePeriod=45
Sep 10 23:52:05.199059 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.199002    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:52:05.349723 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.349691    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6286m\" (UniqueName: \"kubernetes.io/projected/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-kube-api-access-6286m\") pod \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") "
Sep 10 23:52:05.349909 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.349732    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-tls-certs\") pod \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") "
Sep 10 23:52:05.349909 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.349768    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-home\") pod \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") "
Sep 10 23:52:05.349909 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.349879    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-tmp-dir\") pod \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") "
Sep 10 23:52:05.350161 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.349935    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-model-cache\") pod \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") "
Sep 10 23:52:05.350161 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.349967    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-dshm\") pod \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\" (UID: \"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de\") "
Sep 10 23:52:05.350161 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.349990    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-home" (OuterVolumeSpecName: "home") pod "df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de" (UID: "df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:05.350161 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.350091    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de" (UID: "df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:05.350361 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.350228    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-model-cache" (OuterVolumeSpecName: "model-cache") pod "df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de" (UID: "df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:05.350361 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.350349    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-model-cache\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:05.350425 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.350370    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-home\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:05.350471 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.350425    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-tmp-dir\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:05.352165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.352143    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-kube-api-access-6286m" (OuterVolumeSpecName: "kube-api-access-6286m") pod "df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de" (UID: "df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de"). InnerVolumeSpecName "kube-api-access-6286m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:52:05.352270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.352170    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de" (UID: "df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:52:05.352270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.352175    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-dshm" (OuterVolumeSpecName: "dshm") pod "df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de" (UID: "df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:05.451762 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.451735    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6286m\" (UniqueName: \"kubernetes.io/projected/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-kube-api-access-6286m\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:05.451762 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.451762    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-tls-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:05.451952 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.451770    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de-dshm\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:05.527349 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.527315    2581 generic.go:356] "Generic (PLEG): container finished" podID="df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de" containerID="00091f0f0918100f1ec8a2075ed37b6803c46c1a25a7a89019f9c7a71b993378" exitCode=0
Sep 10 23:52:05.527531 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.527374    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"
Sep 10 23:52:05.527531 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.527378    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz" event={"ID":"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de","Type":"ContainerDied","Data":"00091f0f0918100f1ec8a2075ed37b6803c46c1a25a7a89019f9c7a71b993378"}
Sep 10 23:52:05.527531 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.527473    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz" event={"ID":"df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de","Type":"ContainerDied","Data":"972312fb1d3a360d630bc5cfbd38080bed6ad53f9c5dd24396946c71dd60079b"}
Sep 10 23:52:05.527531 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.527489    2581 scope.go:117] "RemoveContainer" containerID="00091f0f0918100f1ec8a2075ed37b6803c46c1a25a7a89019f9c7a71b993378"
Sep 10 23:52:05.539518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.538789    2581 scope.go:117] "RemoveContainer" containerID="00091f0f0918100f1ec8a2075ed37b6803c46c1a25a7a89019f9c7a71b993378"
Sep 10 23:52:05.539518 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:52:05.539487    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00091f0f0918100f1ec8a2075ed37b6803c46c1a25a7a89019f9c7a71b993378\": container with ID starting with 00091f0f0918100f1ec8a2075ed37b6803c46c1a25a7a89019f9c7a71b993378 not found: ID does not exist" containerID="00091f0f0918100f1ec8a2075ed37b6803c46c1a25a7a89019f9c7a71b993378"
Sep 10 23:52:05.539622 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.539522    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00091f0f0918100f1ec8a2075ed37b6803c46c1a25a7a89019f9c7a71b993378"} err="failed to get container status \"00091f0f0918100f1ec8a2075ed37b6803c46c1a25a7a89019f9c7a71b993378\": rpc error: code = NotFound desc = could not find container \"00091f0f0918100f1ec8a2075ed37b6803c46c1a25a7a89019f9c7a71b993378\": container with ID starting with 00091f0f0918100f1ec8a2075ed37b6803c46c1a25a7a89019f9c7a71b993378 not found: ID does not exist"
Sep 10 23:52:05.551739 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.551709    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"]
Sep 10 23:52:05.555686 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:05.555649    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-d43a0552-kserve-775cd459f5-4brvz"]
Sep 10 23:52:06.045087 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:06.045046    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:06.484221 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:06.484185    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de" path="/var/lib/kubelet/pods/df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de/volumes"
Sep 10 23:52:06.652513 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:06.652482    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:06.750822 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:06.750750    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:06.850334 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:06.850288    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:06.873770 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:06.873742    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2"]
Sep 10 23:52:06.879144 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:06.879116    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-66836f-g2tp2"]
Sep 10 23:52:06.953031 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:06.953000    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:07.235362 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:07.235337    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:08.484339 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:08.484306    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62452568-a021-4e3f-bda0-be76af8bc8a4" path="/var/lib/kubelet/pods/62452568-a021-4e3f-bda0-be76af8bc8a4/volumes"
Sep 10 23:52:08.902412 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:08.902337    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq"]
Sep 10 23:52:08.902735 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:08.902722    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" containerName="istio-proxy"
Sep 10 23:52:08.902788 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:08.902737    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9dbc86a-bae9-4b0d-bdb5-cc2669231e93" containerName="istio-proxy"
Sep 10 23:52:08.902788 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:08.902751    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de" containerName="main"
Sep 10 23:52:08.902788 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:08.902756    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de" containerName="main"
Sep 10 23:52:08.902788 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:08.902769    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62452568-a021-4e3f-bda0-be76af8bc8a4" containerName="revoke-keys"
Sep 10 23:52:08.902788 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:08.902774    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="62452568-a021-4e3f-bda0-be76af8bc8a4" containerName="revoke-keys"
Sep 10 23:52:08.902947 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:08.902835    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="df1bd645-6d4f-4ac1-b9e7-d9c1ca8834de" containerName="main"
Sep 10 23:52:08.902947 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:08.902841    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="62452568-a021-4e3f-bda0-be76af8bc8a4" containerName="revoke-keys"
Sep 10 23:52:08.907061 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:08.907043    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq"
Sep 10 23:52:08.910628 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:08.910604    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22lrj\""
Sep 10 23:52:08.910796 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:08.910627    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:52:08.913607 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:08.913584    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq"]
Sep 10 23:52:09.087483 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:09.087445    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq\" (UID: \"dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq"
Sep 10 23:52:09.190046 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:09.189765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq\" (UID: \"dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq"
Sep 10 23:52:09.195042 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:09.190831    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq\" (UID: \"dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq"
Sep 10 23:52:09.218352 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:09.218325    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq"
Sep 10 23:52:09.493013 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:09.492987    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq"]
Sep 10 23:52:09.495817 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:52:09.495789    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcbcdc50_1b7a_49ce_bbef_b28a01bf92c8.slice/crio-2799bb74f2d35782d036e5493b61071397c2ced55972b5ece8f0ae4b4686ab14 WatchSource:0}: Error finding container 2799bb74f2d35782d036e5493b61071397c2ced55972b5ece8f0ae4b4686ab14: Status 404 returned error can't find the container with id 2799bb74f2d35782d036e5493b61071397c2ced55972b5ece8f0ae4b4686ab14
Sep 10 23:52:09.552827 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:09.552795    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq" event={"ID":"dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8","Type":"ContainerStarted","Data":"2799bb74f2d35782d036e5493b61071397c2ced55972b5ece8f0ae4b4686ab14"}
Sep 10 23:52:10.247181 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.247136    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5" podUID="d3eb1a6d-0fc2-4259-a978-4d25f2f94718" containerName="main" containerID="cri-o://e647b314f44500f4741df3cba04ef3f64e48ba208694a8318fc6b6109c1d694f" gracePeriod=45
Sep 10 23:52:10.358933 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.358856    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5" podUID="d3eb1a6d-0fc2-4259-a978-4d25f2f94718" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": dial tcp 10.133.0.61:8000: connect: connection refused"
Sep 10 23:52:10.504731 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.504706    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:52:10.561192 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.561146    2581 generic.go:356] "Generic (PLEG): container finished" podID="d3eb1a6d-0fc2-4259-a978-4d25f2f94718" containerID="e647b314f44500f4741df3cba04ef3f64e48ba208694a8318fc6b6109c1d694f" exitCode=0
Sep 10 23:52:10.561192 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.561194    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"
Sep 10 23:52:10.561437 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.561248    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5" event={"ID":"d3eb1a6d-0fc2-4259-a978-4d25f2f94718","Type":"ContainerDied","Data":"e647b314f44500f4741df3cba04ef3f64e48ba208694a8318fc6b6109c1d694f"}
Sep 10 23:52:10.561437 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.561291    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5" event={"ID":"d3eb1a6d-0fc2-4259-a978-4d25f2f94718","Type":"ContainerDied","Data":"274d9508bbc9cc46d4d6eb506c2902b18006342940731e873be3a0af26f52ed0"}
Sep 10 23:52:10.561437 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.561315    2581 scope.go:117] "RemoveContainer" containerID="e647b314f44500f4741df3cba04ef3f64e48ba208694a8318fc6b6109c1d694f"
Sep 10 23:52:10.563037 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.563015    2581 generic.go:356] "Generic (PLEG): container finished" podID="dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8" containerID="cc7c507e0dbdc68379190fb3cec64143cdb4a0dcfd638b7f49c4baa0bce252eb" exitCode=0
Sep 10 23:52:10.563168 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.563101    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq" event={"ID":"dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8","Type":"ContainerDied","Data":"cc7c507e0dbdc68379190fb3cec64143cdb4a0dcfd638b7f49c4baa0bce252eb"}
Sep 10 23:52:10.573859 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.573835    2581 scope.go:117] "RemoveContainer" containerID="e647b314f44500f4741df3cba04ef3f64e48ba208694a8318fc6b6109c1d694f"
Sep 10 23:52:10.574236 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:52:10.574212    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e647b314f44500f4741df3cba04ef3f64e48ba208694a8318fc6b6109c1d694f\": container with ID starting with e647b314f44500f4741df3cba04ef3f64e48ba208694a8318fc6b6109c1d694f not found: ID does not exist" containerID="e647b314f44500f4741df3cba04ef3f64e48ba208694a8318fc6b6109c1d694f"
Sep 10 23:52:10.574339 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.574262    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e647b314f44500f4741df3cba04ef3f64e48ba208694a8318fc6b6109c1d694f"} err="failed to get container status \"e647b314f44500f4741df3cba04ef3f64e48ba208694a8318fc6b6109c1d694f\": rpc error: code = NotFound desc = could not find container \"e647b314f44500f4741df3cba04ef3f64e48ba208694a8318fc6b6109c1d694f\": container with ID starting with e647b314f44500f4741df3cba04ef3f64e48ba208694a8318fc6b6109c1d694f not found: ID does not exist"
Sep 10 23:52:10.603150 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.603126    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bntbw\" (UniqueName: \"kubernetes.io/projected/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-kube-api-access-bntbw\") pod \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") "
Sep 10 23:52:10.603289 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.603168    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-dshm\") pod \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") "
Sep 10 23:52:10.603289 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.603216    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-home\") pod \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") "
Sep 10 23:52:10.603289 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.603232    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-tls-certs\") pod \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") "
Sep 10 23:52:10.603289 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.603250    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-tmp-dir\") pod \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") "
Sep 10 23:52:10.603289 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.603281    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-model-cache\") pod \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\" (UID: \"d3eb1a6d-0fc2-4259-a978-4d25f2f94718\") "
Sep 10 23:52:10.603571 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.603475    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-home" (OuterVolumeSpecName: "home") pod "d3eb1a6d-0fc2-4259-a978-4d25f2f94718" (UID: "d3eb1a6d-0fc2-4259-a978-4d25f2f94718"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:10.603650 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.603565    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d3eb1a6d-0fc2-4259-a978-4d25f2f94718" (UID: "d3eb1a6d-0fc2-4259-a978-4d25f2f94718"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:10.603650 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.603576    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-model-cache" (OuterVolumeSpecName: "model-cache") pod "d3eb1a6d-0fc2-4259-a978-4d25f2f94718" (UID: "d3eb1a6d-0fc2-4259-a978-4d25f2f94718"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:10.603784 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.603647    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-home\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:10.605704 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.605653    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-kube-api-access-bntbw" (OuterVolumeSpecName: "kube-api-access-bntbw") pod "d3eb1a6d-0fc2-4259-a978-4d25f2f94718" (UID: "d3eb1a6d-0fc2-4259-a978-4d25f2f94718"). InnerVolumeSpecName "kube-api-access-bntbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:52:10.605818 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.605702    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d3eb1a6d-0fc2-4259-a978-4d25f2f94718" (UID: "d3eb1a6d-0fc2-4259-a978-4d25f2f94718"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:52:10.605818 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.605714    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-dshm" (OuterVolumeSpecName: "dshm") pod "d3eb1a6d-0fc2-4259-a978-4d25f2f94718" (UID: "d3eb1a6d-0fc2-4259-a978-4d25f2f94718"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:10.704454 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.704421    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-dshm\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:10.704454 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.704449    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-tls-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:10.704454 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.704462    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-tmp-dir\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:10.704715 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.704473    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-model-cache\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:10.704715 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.704484    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bntbw\" (UniqueName: \"kubernetes.io/projected/d3eb1a6d-0fc2-4259-a978-4d25f2f94718-kube-api-access-bntbw\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:10.885605 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.885573    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"]
Sep 10 23:52:10.890032 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:10.890000    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-66836f/autores-model-66836f-kserve-c58954987-crbc5"]
Sep 10 23:52:11.729592 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:11.729559    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq"
Sep 10 23:52:11.916792 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:11.916703    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8-maas-api-service-ca\") pod \"dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8\" (UID: \"dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8\") "
Sep 10 23:52:11.917121 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:11.917084    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8" (UID: "dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:52:12.018061 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:12.018025    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8-maas-api-service-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:12.484051 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:12.484019    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3eb1a6d-0fc2-4259-a978-4d25f2f94718" path="/var/lib/kubelet/pods/d3eb1a6d-0fc2-4259-a978-4d25f2f94718/volumes"
Sep 10 23:52:12.579729 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:12.579697    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq" event={"ID":"dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8","Type":"ContainerDied","Data":"2799bb74f2d35782d036e5493b61071397c2ced55972b5ece8f0ae4b4686ab14"}
Sep 10 23:52:12.579729 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:12.579725    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq"
Sep 10 23:52:12.579943 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:12.579748    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2799bb74f2d35782d036e5493b61071397c2ced55972b5ece8f0ae4b4686ab14"
Sep 10 23:52:13.124318 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:13.124285    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:13.374823 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:13.374736    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"]
Sep 10 23:52:13.375050 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:13.375019    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b" podUID="fd1d5ee3-383a-44db-8a7d-7711673c28a6" containerName="istio-proxy" containerID="cri-o://df16f7e460631dd324b10bc3569919b33b5d8b9f1bdde9f2c7cb85ced5e2c2e2" gracePeriod=30
Sep 10 23:52:14.064129 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.064093    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"]
Sep 10 23:52:14.064644 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.064627    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8" containerName="revoke-keys"
Sep 10 23:52:14.064644 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.064645    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8" containerName="revoke-keys"
Sep 10 23:52:14.064846 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.064730    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3eb1a6d-0fc2-4259-a978-4d25f2f94718" containerName="main"
Sep 10 23:52:14.064846 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.064740    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3eb1a6d-0fc2-4259-a978-4d25f2f94718" containerName="main"
Sep 10 23:52:14.064846 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.064822    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3eb1a6d-0fc2-4259-a978-4d25f2f94718" containerName="main"
Sep 10 23:52:14.064846 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.064836    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8" containerName="revoke-keys"
Sep 10 23:52:14.068601 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.068579    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.072517 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.072480    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-677d3c-openshift-default-dockercfg-djrrx\""
Sep 10 23:52:14.080065 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.080040    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"]
Sep 10 23:52:14.134429 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.134399    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73a79f30-fb58-46b4-9a8a-e57e730ff703-istiod-ca-cert\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.134429 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.134432    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-podinfo\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.134890 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.134457    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-credential-socket\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.134890 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.134478    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-data\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.134890 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.134540    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-workload-certs\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.134890 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.134577    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-token\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.134890 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.134597    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-envoy\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.134890 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.134647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfqwp\" (UniqueName: \"kubernetes.io/projected/73a79f30-fb58-46b4-9a8a-e57e730ff703-kube-api-access-dfqwp\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.134890 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.134725    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-workload-socket\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.236035 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.235991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-workload-socket\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.236226 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.236060    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73a79f30-fb58-46b4-9a8a-e57e730ff703-istiod-ca-cert\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.236226 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.236079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-podinfo\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.236226 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.236102    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-credential-socket\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.236226 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.236121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-data\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.236226 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.236148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-workload-certs\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.236518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.236313    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-token\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.236518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.236346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-envoy\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.236518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.236388    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfqwp\" (UniqueName: \"kubernetes.io/projected/73a79f30-fb58-46b4-9a8a-e57e730ff703-kube-api-access-dfqwp\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.236518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.236460    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-workload-socket\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.236766 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.236636    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-workload-certs\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.236766 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.236715    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-credential-socket\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.236877 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.236787    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-data\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.237045 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.237026    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73a79f30-fb58-46b4-9a8a-e57e730ff703-istiod-ca-cert\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.238630 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.238605    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-envoy\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.238761 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.238745    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-podinfo\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.244754 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.244731    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-token\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.245630 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.245609    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfqwp\" (UniqueName: \"kubernetes.io/projected/73a79f30-fb58-46b4-9a8a-e57e730ff703-kube-api-access-dfqwp\") pod \"e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") " pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.380969 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.380877    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:14.580031 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.579997    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:14.660313 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.660289    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"]
Sep 10 23:52:14.661758 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:52:14.661727    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a79f30_fb58_46b4_9a8a_e57e730ff703.slice/crio-c937e9fa8beee0208c86046c4d6a1419b551b3101a3cd860b2896f8da0c19a35 WatchSource:0}: Error finding container c937e9fa8beee0208c86046c4d6a1419b551b3101a3cd860b2896f8da0c19a35: Status 404 returned error can't find the container with id c937e9fa8beee0208c86046c4d6a1419b551b3101a3cd860b2896f8da0c19a35
Sep 10 23:52:14.662050 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.662026    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:14.664306 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.664271    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:52:14.664436 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.664352    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:52:14.664436 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.664388    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:52:14.987016 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:14.986980    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:15.085973 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:15.085938    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:15.190273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:15.190234    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:15.191536 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:15.191501    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq"]
Sep 10 23:52:15.194533 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:15.194513    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f9a25dcc-scvxq"]
Sep 10 23:52:15.285927 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:15.285851    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:15.600103 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:15.600012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7" event={"ID":"73a79f30-fb58-46b4-9a8a-e57e730ff703","Type":"ContainerStarted","Data":"30b7be72cbc7f13bc1ade5e959e8da4929643423b973ece589fcdc289d9673ac"}
Sep 10 23:52:15.600103 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:15.600088    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7" event={"ID":"73a79f30-fb58-46b4-9a8a-e57e730ff703","Type":"ContainerStarted","Data":"c937e9fa8beee0208c86046c4d6a1419b551b3101a3cd860b2896f8da0c19a35"}
Sep 10 23:52:15.628746 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:15.628688    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7" podStartSLOduration=1.628644336 podStartE2EDuration="1.628644336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:52:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:52:15.627700364 +0000 UTC m=+935.668569663" watchObservedRunningTime="2026-09-10 23:52:15.628644336 +0000 UTC m=+935.669513639"
Sep 10 23:52:16.306948 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:16.306919    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:16.381657 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:16.381614    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:16.416584 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:16.416552    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:16.484655 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:16.484618    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8" path="/var/lib/kubelet/pods/dcbcdc50-1b7a-49ce-bbef-b28a01bf92c8/volumes"
Sep 10 23:52:16.605808 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:16.605719    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:16.606779 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:16.606756    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:16.720852 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:16.720814    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:16.993764 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:16.993720    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"]
Sep 10 23:52:16.997913 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:16.997891    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.000394 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.000371    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-15a3a094-openshift-default-dockercfg-dt4mp\""
Sep 10 23:52:17.013166 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.013140    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"]
Sep 10 23:52:17.031484 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.031455    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:17.070861 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.070832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f93ba844-56b5-4e45-8c96-34b8a434e362-istiod-ca-cert\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.071005 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.070876    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-envoy\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.071005 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.070923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-workload-certs\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.071005 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.070976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-data\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.071133 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.071019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-token\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.071133 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.071039    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-credential-socket\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.071133 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.071097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-workload-socket\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.071133 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.071128    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz89b\" (UniqueName: \"kubernetes.io/projected/f93ba844-56b5-4e45-8c96-34b8a434e362-kube-api-access-cz89b\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.071285 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.071164    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-podinfo\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.114224 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.114198    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:17.172361 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.172324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-token\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.172546 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.172379    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-credential-socket\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.172546 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.172418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-workload-socket\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.172546 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.172448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz89b\" (UniqueName: \"kubernetes.io/projected/f93ba844-56b5-4e45-8c96-34b8a434e362-kube-api-access-cz89b\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.172546 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.172499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-podinfo\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.172813 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.172550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f93ba844-56b5-4e45-8c96-34b8a434e362-istiod-ca-cert\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.172813 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.172592    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-envoy\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.172813 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.172619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-workload-certs\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.172813 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.172749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-data\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.173018 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.172890    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-workload-socket\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.173175 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.173072    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-data\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.173272 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.173255    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-credential-socket\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.173696 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.173657    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-workload-certs\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.173961 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.173937    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f93ba844-56b5-4e45-8c96-34b8a434e362-istiod-ca-cert\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.176081 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.176055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-podinfo\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.176954 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.176931    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-envoy\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.183789 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.183743    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-token\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.185956 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.185929    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz89b\" (UniqueName: \"kubernetes.io/projected/f93ba844-56b5-4e45-8c96-34b8a434e362-kube-api-access-cz89b\") pod \"e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") " pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.308932 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.308847    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:17.581893 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.581815    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:17.611197 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.611165    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"]
Sep 10 23:52:17.612602 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:52:17.612574    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93ba844_56b5_4e45_8c96_34b8a434e362.slice/crio-3f7fe298387dc004eb6c2e34dd802a92a7488e058c7bef9b14c3ab8e17a71006 WatchSource:0}: Error finding container 3f7fe298387dc004eb6c2e34dd802a92a7488e058c7bef9b14c3ab8e17a71006: Status 404 returned error can't find the container with id 3f7fe298387dc004eb6c2e34dd802a92a7488e058c7bef9b14c3ab8e17a71006
Sep 10 23:52:17.614893 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.614863    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:52:17.614963 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.614929    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:52:17.615008 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.614966    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:52:17.691967 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:17.691930    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:18.621646 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.621614    2581 generic.go:356] "Generic (PLEG): container finished" podID="fd1d5ee3-383a-44db-8a7d-7711673c28a6" containerID="df16f7e460631dd324b10bc3569919b33b5d8b9f1bdde9f2c7cb85ced5e2c2e2" exitCode=0
Sep 10 23:52:18.622146 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.621711    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b" event={"ID":"fd1d5ee3-383a-44db-8a7d-7711673c28a6","Type":"ContainerDied","Data":"df16f7e460631dd324b10bc3569919b33b5d8b9f1bdde9f2c7cb85ced5e2c2e2"}
Sep 10 23:52:18.622146 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.621800    2581 scope.go:117] "RemoveContainer" containerID="04bb5e5cf0b90bc16afb8620b8a6683adf6b5a220fd7dfff7ec8328a2da446b9"
Sep 10 23:52:18.623725 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.623703    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d" event={"ID":"f93ba844-56b5-4e45-8c96-34b8a434e362","Type":"ContainerStarted","Data":"6d08cbc38a2a2546e9843b7eb21333cfd069d776821c0b7e32652a128d2ca155"}
Sep 10 23:52:18.623824 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.623751    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d" event={"ID":"f93ba844-56b5-4e45-8c96-34b8a434e362","Type":"ContainerStarted","Data":"3f7fe298387dc004eb6c2e34dd802a92a7488e058c7bef9b14c3ab8e17a71006"}
Sep 10 23:52:18.639886 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.639831    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:52:18.646542 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.646500    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d" podStartSLOduration=2.646484322 podStartE2EDuration="2.646484322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:52:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:52:18.644901515 +0000 UTC m=+938.685770819" watchObservedRunningTime="2026-09-10 23:52:18.646484322 +0000 UTC m=+938.687353626"
Sep 10 23:52:18.690818 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.690778    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-data\") pod \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") "
Sep 10 23:52:18.690818 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.690812    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-workload-socket\") pod \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") "
Sep 10 23:52:18.691167 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.690842    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-podinfo\") pod \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") "
Sep 10 23:52:18.691167 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.690869    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-envoy\") pod \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") "
Sep 10 23:52:18.691167 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.690964    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-credential-socket\") pod \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") "
Sep 10 23:52:18.691167 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.691061    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzp66\" (UniqueName: \"kubernetes.io/projected/fd1d5ee3-383a-44db-8a7d-7711673c28a6-kube-api-access-xzp66\") pod \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") "
Sep 10 23:52:18.691167 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.691121    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-workload-certs\") pod \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") "
Sep 10 23:52:18.691430 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.691177    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istiod-ca-cert\") pod \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") "
Sep 10 23:52:18.691430 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.691236    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-token\") pod \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\" (UID: \"fd1d5ee3-383a-44db-8a7d-7711673c28a6\") "
Sep 10 23:52:18.691749 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.691722    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "fd1d5ee3-383a-44db-8a7d-7711673c28a6" (UID: "fd1d5ee3-383a-44db-8a7d-7711673c28a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:18.692805 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.692777    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fd1d5ee3-383a-44db-8a7d-7711673c28a6" (UID: "fd1d5ee3-383a-44db-8a7d-7711673c28a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:18.693059 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.693036    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fd1d5ee3-383a-44db-8a7d-7711673c28a6" (UID: "fd1d5ee3-383a-44db-8a7d-7711673c28a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:18.693166 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.693124    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fd1d5ee3-383a-44db-8a7d-7711673c28a6" (UID: "fd1d5ee3-383a-44db-8a7d-7711673c28a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:52:18.693639 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.693579    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fd1d5ee3-383a-44db-8a7d-7711673c28a6" (UID: "fd1d5ee3-383a-44db-8a7d-7711673c28a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:18.694795 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.694773    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fd1d5ee3-383a-44db-8a7d-7711673c28a6" (UID: "fd1d5ee3-383a-44db-8a7d-7711673c28a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:52:18.695311 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.695282    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fd1d5ee3-383a-44db-8a7d-7711673c28a6" (UID: "fd1d5ee3-383a-44db-8a7d-7711673c28a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:18.695403 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.695338    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "fd1d5ee3-383a-44db-8a7d-7711673c28a6" (UID: "fd1d5ee3-383a-44db-8a7d-7711673c28a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:52:18.695473 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.695427    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd1d5ee3-383a-44db-8a7d-7711673c28a6-kube-api-access-xzp66" (OuterVolumeSpecName: "kube-api-access-xzp66") pod "fd1d5ee3-383a-44db-8a7d-7711673c28a6" (UID: "fd1d5ee3-383a-44db-8a7d-7711673c28a6"). InnerVolumeSpecName "kube-api-access-xzp66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:52:18.725152 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.725126    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:18.791601 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.791571    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:18.792786 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.792771    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-credential-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:18.792865 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.792788    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzp66\" (UniqueName: \"kubernetes.io/projected/fd1d5ee3-383a-44db-8a7d-7711673c28a6-kube-api-access-xzp66\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:18.792865 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.792800    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-workload-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:18.792865 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.792811    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istiod-ca-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:18.792865 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.792818    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-token\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:18.792865 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.792825    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-data\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:18.792865 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.792832    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-workload-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:18.792865 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.792843    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-podinfo\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:18.792865 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.792851    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd1d5ee3-383a-44db-8a7d-7711673c28a6-istio-envoy\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:18.987415 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:18.987386    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:19.236439 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:19.236405    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:19.309965 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:19.309874    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:19.315066 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:19.315040    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:19.348614 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:19.348587    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:19.630712 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:19.630604    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"
Sep 10 23:52:19.630712 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:19.630636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b" event={"ID":"fd1d5ee3-383a-44db-8a7d-7711673c28a6","Type":"ContainerDied","Data":"9cbe0ae4b0bcfe8322f5c791624c11eb33394b4e4fca898c4217a01fa37ad63d"}
Sep 10 23:52:19.631202 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:19.630738    2581 scope.go:117] "RemoveContainer" containerID="df16f7e460631dd324b10bc3569919b33b5d8b9f1bdde9f2c7cb85ced5e2c2e2"
Sep 10 23:52:19.631202 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:19.631024    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:19.632339 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:19.632148    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:19.685903 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:19.685870    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"]
Sep 10 23:52:19.689149 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:19.689118    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b"]
Sep 10 23:52:20.182879 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:20.182845    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:20.402277 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:20.402247    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:20.484286 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:20.484255    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd1d5ee3-383a-44db-8a7d-7711673c28a6" path="/var/lib/kubelet/pods/fd1d5ee3-383a-44db-8a7d-7711673c28a6/volumes"
Sep 10 23:52:21.449520 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:21.449487    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:52:21.468264 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:21.468226    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:21.566849 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:21.566811    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:21.666769 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:21.666730    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:22.086322 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:22.086294    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:22.185827 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:22.185792    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:39.636214 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:39.636176    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:39.749829 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:39.749798    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:52:40.776192 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:40.776143    2581 generic.go:356] "Generic (PLEG): container finished" podID="73a79f30-fb58-46b4-9a8a-e57e730ff703" containerID="30b7be72cbc7f13bc1ade5e959e8da4929643423b973ece589fcdc289d9673ac" exitCode=0
Sep 10 23:52:40.777645 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:40.776355    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7" event={"ID":"73a79f30-fb58-46b4-9a8a-e57e730ff703","Type":"ContainerDied","Data":"30b7be72cbc7f13bc1ade5e959e8da4929643423b973ece589fcdc289d9673ac"}
Sep 10 23:52:40.777645 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:40.776954    2581 scope.go:117] "RemoveContainer" containerID="30b7be72cbc7f13bc1ade5e959e8da4929643423b973ece589fcdc289d9673ac"
Sep 10 23:52:40.778511 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:40.778479    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:52:40.778616 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:40.778559    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:52:40.778616 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:40.778594    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:52:41.788605 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:41.788559    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7" event={"ID":"73a79f30-fb58-46b4-9a8a-e57e730ff703","Type":"ContainerStarted","Data":"729e10e624995a2beb9b58345c0fbcbb639e904fc7279f99bebe7d7cd1b53f55"}
Sep 10 23:52:41.794571 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:41.794535    2581 generic.go:356] "Generic (PLEG): container finished" podID="f93ba844-56b5-4e45-8c96-34b8a434e362" containerID="6d08cbc38a2a2546e9843b7eb21333cfd069d776821c0b7e32652a128d2ca155" exitCode=0
Sep 10 23:52:41.794924 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:41.794746    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d" event={"ID":"f93ba844-56b5-4e45-8c96-34b8a434e362","Type":"ContainerDied","Data":"6d08cbc38a2a2546e9843b7eb21333cfd069d776821c0b7e32652a128d2ca155"}
Sep 10 23:52:41.795405 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:41.795384    2581 scope.go:117] "RemoveContainer" containerID="6d08cbc38a2a2546e9843b7eb21333cfd069d776821c0b7e32652a128d2ca155"
Sep 10 23:52:41.796601 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:41.796577    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:52:41.796691 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:41.796640    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:52:41.796736 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:41.796691    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:52:42.383466 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:42.383423    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:42.383708 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:42.383567    2581 patch_prober.go:28] interesting pod/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 10 23:52:42.383708 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:42.383614    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7" podUID="73a79f30-fb58-46b4-9a8a-e57e730ff703" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 10 23:52:42.501284 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:42.501253    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:42.661770 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:42.661683    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:42.809115 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:42.809064    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d" event={"ID":"f93ba844-56b5-4e45-8c96-34b8a434e362","Type":"ContainerStarted","Data":"cfe32f6efdccd0eaa3b955d00d6b190f724437c7f14c23f867c46b1a252eb54c"}
Sep 10 23:52:43.309982 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:43.309937    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:43.310224 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:43.310076    2581 patch_prober.go:28] interesting pod/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 23:52:43.310224 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:43.310173    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d" podUID="f93ba844-56b5-4e45-8c96-34b8a434e362" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 23:52:43.382355 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:43.382306    2581 patch_prober.go:28] interesting pod/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 10 23:52:43.382540 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:43.382380    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7" podUID="73a79f30-fb58-46b4-9a8a-e57e730ff703" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 10 23:52:44.310217 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:44.310167    2581 patch_prober.go:28] interesting pod/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 23:52:44.310764 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:44.310257    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d" podUID="f93ba844-56b5-4e45-8c96-34b8a434e362" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 23:52:44.382304 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:44.382254    2581 patch_prober.go:28] interesting pod/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 10 23:52:44.382484 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:44.382328    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7" podUID="73a79f30-fb58-46b4-9a8a-e57e730ff703" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 10 23:52:44.839687 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:44.839649    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd"]
Sep 10 23:52:44.840100 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:44.840086    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd1d5ee3-383a-44db-8a7d-7711673c28a6" containerName="istio-proxy"
Sep 10 23:52:44.840148 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:44.840102    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd1d5ee3-383a-44db-8a7d-7711673c28a6" containerName="istio-proxy"
Sep 10 23:52:44.840186 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:44.840171    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd1d5ee3-383a-44db-8a7d-7711673c28a6" containerName="istio-proxy"
Sep 10 23:52:44.840186 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:44.840184    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd1d5ee3-383a-44db-8a7d-7711673c28a6" containerName="istio-proxy"
Sep 10 23:52:44.842129 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:44.842113    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd"
Sep 10 23:52:44.844580 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:44.844563    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22lrj\""
Sep 10 23:52:44.844766 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:44.844747    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:52:44.851181 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:44.851157    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd"]
Sep 10 23:52:44.967696 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:44.963907    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fd03737-ab40-4bf6-bb8b-f9e6870daa8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd\" (UID: \"3fd03737-ab40-4bf6-bb8b-f9e6870daa8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd"
Sep 10 23:52:45.064836 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:45.064789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fd03737-ab40-4bf6-bb8b-f9e6870daa8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd\" (UID: \"3fd03737-ab40-4bf6-bb8b-f9e6870daa8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd"
Sep 10 23:52:45.065847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:45.065817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fd03737-ab40-4bf6-bb8b-f9e6870daa8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd\" (UID: \"3fd03737-ab40-4bf6-bb8b-f9e6870daa8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd"
Sep 10 23:52:45.153477 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:45.153387    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd"
Sep 10 23:52:45.318504 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:45.318066    2581 patch_prober.go:28] interesting pod/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 23:52:45.318504 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:45.318131    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d" podUID="f93ba844-56b5-4e45-8c96-34b8a434e362" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 23:52:45.382214 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:45.382179    2581 patch_prober.go:28] interesting pod/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 10 23:52:45.382540 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:45.382492    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7" podUID="73a79f30-fb58-46b4-9a8a-e57e730ff703" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 10 23:52:45.477640 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:45.477584    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd"]
Sep 10 23:52:45.490956 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:52:45.490867    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd03737_ab40_4bf6_bb8b_f9e6870daa8e.slice/crio-be63ba7436963f85d69e110e42ebe6b00ea4774155754c37e7108c0c266f478b WatchSource:0}: Error finding container be63ba7436963f85d69e110e42ebe6b00ea4774155754c37e7108c0c266f478b: Status 404 returned error can't find the container with id be63ba7436963f85d69e110e42ebe6b00ea4774155754c37e7108c0c266f478b
Sep 10 23:52:45.831453 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:45.831365    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd" event={"ID":"3fd03737-ab40-4bf6-bb8b-f9e6870daa8e","Type":"ContainerStarted","Data":"be63ba7436963f85d69e110e42ebe6b00ea4774155754c37e7108c0c266f478b"}
Sep 10 23:52:46.310313 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:46.310262    2581 patch_prober.go:28] interesting pod/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 23:52:46.310540 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:46.310339    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d" podUID="f93ba844-56b5-4e45-8c96-34b8a434e362" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 23:52:46.382450 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:46.382413    2581 patch_prober.go:28] interesting pod/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 10 23:52:46.383070 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:46.383034    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7" podUID="73a79f30-fb58-46b4-9a8a-e57e730ff703" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 10 23:52:46.607617 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:46.606645    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:46.839617 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:46.839581    2581 generic.go:356] "Generic (PLEG): container finished" podID="3fd03737-ab40-4bf6-bb8b-f9e6870daa8e" containerID="8bbafc07eec9a3e89bd48c83b9bfdb6f172cdbd421c3467d9b86622f0a2d5d56" exitCode=0
Sep 10 23:52:46.839839 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:46.839699    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd" event={"ID":"3fd03737-ab40-4bf6-bb8b-f9e6870daa8e","Type":"ContainerDied","Data":"8bbafc07eec9a3e89bd48c83b9bfdb6f172cdbd421c3467d9b86622f0a2d5d56"}
Sep 10 23:52:47.310139 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:47.310102    2581 patch_prober.go:28] interesting pod/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 23:52:47.310328 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:47.310160    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d" podUID="f93ba844-56b5-4e45-8c96-34b8a434e362" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 23:52:47.395861 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:47.395831    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:47.396931 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:47.396908    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:52:48.020710 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:48.020657    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd"
Sep 10 23:52:48.101901 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:48.101812    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fd03737-ab40-4bf6-bb8b-f9e6870daa8e-maas-api-service-ca\") pod \"3fd03737-ab40-4bf6-bb8b-f9e6870daa8e\" (UID: \"3fd03737-ab40-4bf6-bb8b-f9e6870daa8e\") "
Sep 10 23:52:48.102160 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:48.102136    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fd03737-ab40-4bf6-bb8b-f9e6870daa8e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3fd03737-ab40-4bf6-bb8b-f9e6870daa8e" (UID: "3fd03737-ab40-4bf6-bb8b-f9e6870daa8e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:52:48.203247 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:48.203209    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fd03737-ab40-4bf6-bb8b-f9e6870daa8e-maas-api-service-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:48.492565 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:48.492406    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:48.493015 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:48.492835    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:48.493918 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:48.493896    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:48.852236 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:48.852148    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd"
Sep 10 23:52:48.852236 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:48.852176    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd" event={"ID":"3fd03737-ab40-4bf6-bb8b-f9e6870daa8e","Type":"ContainerDied","Data":"be63ba7436963f85d69e110e42ebe6b00ea4774155754c37e7108c0c266f478b"}
Sep 10 23:52:48.852236 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:48.852220    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be63ba7436963f85d69e110e42ebe6b00ea4774155754c37e7108c0c266f478b"
Sep 10 23:52:50.206360 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:50.206326    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"]
Sep 10 23:52:50.228313 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:50.228272    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:52.031907 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:52.031870    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:52.131372 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:52.131343    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:52.235214 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:52.235178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:52.295839 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:52.295750    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd"]
Sep 10 23:52:52.300986 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:52.300958    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15a3a094-bg7hd"]
Sep 10 23:52:52.313542 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:52.313508    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:52.417398 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:52.417365    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"]
Sep 10 23:52:52.417877 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:52.417842    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d" podUID="f93ba844-56b5-4e45-8c96-34b8a434e362" containerName="istio-proxy" containerID="cri-o://cfe32f6efdccd0eaa3b955d00d6b190f724437c7f14c23f867c46b1a252eb54c" gracePeriod=30
Sep 10 23:52:52.451349 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:52.451320    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:52.485937 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:52.485906    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fd03737-ab40-4bf6-bb8b-f9e6870daa8e" path="/var/lib/kubelet/pods/3fd03737-ab40-4bf6-bb8b-f9e6870daa8e/volumes"
Sep 10 23:52:53.116399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:53.116369    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:53.216841 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:53.216811    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:53.313898 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:53.313867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:54.636096 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:54.636062    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:52:57.676520 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.676493    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:57.799946 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.799909    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cz89b\" (UniqueName: \"kubernetes.io/projected/f93ba844-56b5-4e45-8c96-34b8a434e362-kube-api-access-cz89b\") pod \"f93ba844-56b5-4e45-8c96-34b8a434e362\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") "
Sep 10 23:52:57.800145 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.799962    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-token\") pod \"f93ba844-56b5-4e45-8c96-34b8a434e362\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") "
Sep 10 23:52:57.800145 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.799990    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-credential-socket\") pod \"f93ba844-56b5-4e45-8c96-34b8a434e362\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") "
Sep 10 23:52:57.800145 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.800040    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-workload-socket\") pod \"f93ba844-56b5-4e45-8c96-34b8a434e362\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") "
Sep 10 23:52:57.800145 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.800082    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f93ba844-56b5-4e45-8c96-34b8a434e362-istiod-ca-cert\") pod \"f93ba844-56b5-4e45-8c96-34b8a434e362\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") "
Sep 10 23:52:57.800145 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.800129    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-envoy\") pod \"f93ba844-56b5-4e45-8c96-34b8a434e362\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") "
Sep 10 23:52:57.800404 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.800175    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-podinfo\") pod \"f93ba844-56b5-4e45-8c96-34b8a434e362\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") "
Sep 10 23:52:57.800404 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.800215    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-data\") pod \"f93ba844-56b5-4e45-8c96-34b8a434e362\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") "
Sep 10 23:52:57.800404 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.800264    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-workload-certs\") pod \"f93ba844-56b5-4e45-8c96-34b8a434e362\" (UID: \"f93ba844-56b5-4e45-8c96-34b8a434e362\") "
Sep 10 23:52:57.800404 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.800284    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f93ba844-56b5-4e45-8c96-34b8a434e362" (UID: "f93ba844-56b5-4e45-8c96-34b8a434e362"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:57.800404 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.800328    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f93ba844-56b5-4e45-8c96-34b8a434e362" (UID: "f93ba844-56b5-4e45-8c96-34b8a434e362"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:57.800644 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.800543    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-data" (OuterVolumeSpecName: "istio-data") pod "f93ba844-56b5-4e45-8c96-34b8a434e362" (UID: "f93ba844-56b5-4e45-8c96-34b8a434e362"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:57.800644 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.800566    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f93ba844-56b5-4e45-8c96-34b8a434e362-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f93ba844-56b5-4e45-8c96-34b8a434e362" (UID: "f93ba844-56b5-4e45-8c96-34b8a434e362"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:52:57.800644 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.800596    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-credential-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:57.800644 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.800615    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-workload-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:57.800910 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.800780    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f93ba844-56b5-4e45-8c96-34b8a434e362" (UID: "f93ba844-56b5-4e45-8c96-34b8a434e362"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:57.802400 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.802370    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f93ba844-56b5-4e45-8c96-34b8a434e362-kube-api-access-cz89b" (OuterVolumeSpecName: "kube-api-access-cz89b") pod "f93ba844-56b5-4e45-8c96-34b8a434e362" (UID: "f93ba844-56b5-4e45-8c96-34b8a434e362"). InnerVolumeSpecName "kube-api-access-cz89b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:52:57.802495 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.802398    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f93ba844-56b5-4e45-8c96-34b8a434e362" (UID: "f93ba844-56b5-4e45-8c96-34b8a434e362"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:52:57.802876 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.802847    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f93ba844-56b5-4e45-8c96-34b8a434e362" (UID: "f93ba844-56b5-4e45-8c96-34b8a434e362"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:52:57.802876 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.802856    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-token" (OuterVolumeSpecName: "istio-token") pod "f93ba844-56b5-4e45-8c96-34b8a434e362" (UID: "f93ba844-56b5-4e45-8c96-34b8a434e362"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:52:57.901750 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.901720    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-data\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:57.901750 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.901747    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-workload-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:57.901750 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.901756    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cz89b\" (UniqueName: \"kubernetes.io/projected/f93ba844-56b5-4e45-8c96-34b8a434e362-kube-api-access-cz89b\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:57.901989 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.901765    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-token\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:57.901989 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.901775    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f93ba844-56b5-4e45-8c96-34b8a434e362-istiod-ca-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:57.901989 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.901785    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-envoy\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:57.901989 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.901797    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f93ba844-56b5-4e45-8c96-34b8a434e362-istio-podinfo\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:52:57.913387 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.913357    2581 generic.go:356] "Generic (PLEG): container finished" podID="f93ba844-56b5-4e45-8c96-34b8a434e362" containerID="cfe32f6efdccd0eaa3b955d00d6b190f724437c7f14c23f867c46b1a252eb54c" exitCode=0
Sep 10 23:52:57.913551 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.913405    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"
Sep 10 23:52:57.913551 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.913413    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d" event={"ID":"f93ba844-56b5-4e45-8c96-34b8a434e362","Type":"ContainerDied","Data":"cfe32f6efdccd0eaa3b955d00d6b190f724437c7f14c23f867c46b1a252eb54c"}
Sep 10 23:52:57.913551 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.913459    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d" event={"ID":"f93ba844-56b5-4e45-8c96-34b8a434e362","Type":"ContainerDied","Data":"3f7fe298387dc004eb6c2e34dd802a92a7488e058c7bef9b14c3ab8e17a71006"}
Sep 10 23:52:57.913551 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.913480    2581 scope.go:117] "RemoveContainer" containerID="cfe32f6efdccd0eaa3b955d00d6b190f724437c7f14c23f867c46b1a252eb54c"
Sep 10 23:52:57.923386 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.923369    2581 scope.go:117] "RemoveContainer" containerID="6d08cbc38a2a2546e9843b7eb21333cfd069d776821c0b7e32652a128d2ca155"
Sep 10 23:52:57.932153 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.932131    2581 scope.go:117] "RemoveContainer" containerID="cfe32f6efdccd0eaa3b955d00d6b190f724437c7f14c23f867c46b1a252eb54c"
Sep 10 23:52:57.932424 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:52:57.932402    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfe32f6efdccd0eaa3b955d00d6b190f724437c7f14c23f867c46b1a252eb54c\": container with ID starting with cfe32f6efdccd0eaa3b955d00d6b190f724437c7f14c23f867c46b1a252eb54c not found: ID does not exist" containerID="cfe32f6efdccd0eaa3b955d00d6b190f724437c7f14c23f867c46b1a252eb54c"
Sep 10 23:52:57.932553 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.932432    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe32f6efdccd0eaa3b955d00d6b190f724437c7f14c23f867c46b1a252eb54c"} err="failed to get container status \"cfe32f6efdccd0eaa3b955d00d6b190f724437c7f14c23f867c46b1a252eb54c\": rpc error: code = NotFound desc = could not find container \"cfe32f6efdccd0eaa3b955d00d6b190f724437c7f14c23f867c46b1a252eb54c\": container with ID starting with cfe32f6efdccd0eaa3b955d00d6b190f724437c7f14c23f867c46b1a252eb54c not found: ID does not exist"
Sep 10 23:52:57.932553 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.932449    2581 scope.go:117] "RemoveContainer" containerID="6d08cbc38a2a2546e9843b7eb21333cfd069d776821c0b7e32652a128d2ca155"
Sep 10 23:52:57.932769 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:52:57.932745    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d08cbc38a2a2546e9843b7eb21333cfd069d776821c0b7e32652a128d2ca155\": container with ID starting with 6d08cbc38a2a2546e9843b7eb21333cfd069d776821c0b7e32652a128d2ca155 not found: ID does not exist" containerID="6d08cbc38a2a2546e9843b7eb21333cfd069d776821c0b7e32652a128d2ca155"
Sep 10 23:52:57.932875 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.932780    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d08cbc38a2a2546e9843b7eb21333cfd069d776821c0b7e32652a128d2ca155"} err="failed to get container status \"6d08cbc38a2a2546e9843b7eb21333cfd069d776821c0b7e32652a128d2ca155\": rpc error: code = NotFound desc = could not find container \"6d08cbc38a2a2546e9843b7eb21333cfd069d776821c0b7e32652a128d2ca155\": container with ID starting with 6d08cbc38a2a2546e9843b7eb21333cfd069d776821c0b7e32652a128d2ca155 not found: ID does not exist"
Sep 10 23:52:57.935726 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.935708    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"]
Sep 10 23:52:57.939552 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:57.939532    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d"]
Sep 10 23:52:58.484473 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:58.484438    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f93ba844-56b5-4e45-8c96-34b8a434e362" path="/var/lib/kubelet/pods/f93ba844-56b5-4e45-8c96-34b8a434e362/volumes"
Sep 10 23:52:59.621797 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:52:59.621744    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:53:00.600326 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:00.600293    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:00.707540 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:00.707488    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:00.804020 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:00.803981    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:00.900991 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:00.900906    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:01.312129 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:01.312101    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:05.226244 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.226203    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5" podUID="a5f8bf95-e74f-499d-af29-7d3a91a88f45" containerName="main" containerID="cri-o://a3c83e7749d5e238702f75185fb737ba4ce8f92496b481afb335ddd0ee570445" gracePeriod=45
Sep 10 23:53:05.479793 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.479733    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:53:05.568476 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.568435    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5f8bf95-e74f-499d-af29-7d3a91a88f45-tls-certs\") pod \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") "
Sep 10 23:53:05.568476 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.568469    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-tmp-dir\") pod \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") "
Sep 10 23:53:05.568766 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.568492    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95nq4\" (UniqueName: \"kubernetes.io/projected/a5f8bf95-e74f-499d-af29-7d3a91a88f45-kube-api-access-95nq4\") pod \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") "
Sep 10 23:53:05.568766 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.568514    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-dshm\") pod \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") "
Sep 10 23:53:05.568766 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.568564    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-model-cache\") pod \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") "
Sep 10 23:53:05.568766 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.568597    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-home\") pod \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\" (UID: \"a5f8bf95-e74f-499d-af29-7d3a91a88f45\") "
Sep 10 23:53:05.569179 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.569061    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a5f8bf95-e74f-499d-af29-7d3a91a88f45" (UID: "a5f8bf95-e74f-499d-af29-7d3a91a88f45"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:53:05.569179 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.569139    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-model-cache" (OuterVolumeSpecName: "model-cache") pod "a5f8bf95-e74f-499d-af29-7d3a91a88f45" (UID: "a5f8bf95-e74f-499d-af29-7d3a91a88f45"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:53:05.569387 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.569191    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-home" (OuterVolumeSpecName: "home") pod "a5f8bf95-e74f-499d-af29-7d3a91a88f45" (UID: "a5f8bf95-e74f-499d-af29-7d3a91a88f45"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:53:05.571006 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.570981    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-dshm" (OuterVolumeSpecName: "dshm") pod "a5f8bf95-e74f-499d-af29-7d3a91a88f45" (UID: "a5f8bf95-e74f-499d-af29-7d3a91a88f45"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:53:05.571218 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.571199    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5f8bf95-e74f-499d-af29-7d3a91a88f45-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a5f8bf95-e74f-499d-af29-7d3a91a88f45" (UID: "a5f8bf95-e74f-499d-af29-7d3a91a88f45"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:53:05.571280 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.571247    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5f8bf95-e74f-499d-af29-7d3a91a88f45-kube-api-access-95nq4" (OuterVolumeSpecName: "kube-api-access-95nq4") pod "a5f8bf95-e74f-499d-af29-7d3a91a88f45" (UID: "a5f8bf95-e74f-499d-af29-7d3a91a88f45"). InnerVolumeSpecName "kube-api-access-95nq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:53:05.670240 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.670197    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5f8bf95-e74f-499d-af29-7d3a91a88f45-tls-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:05.670240 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.670237    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-tmp-dir\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:05.670438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.670252    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95nq4\" (UniqueName: \"kubernetes.io/projected/a5f8bf95-e74f-499d-af29-7d3a91a88f45-kube-api-access-95nq4\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:05.670438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.670267    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-dshm\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:05.670438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.670280    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-model-cache\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:05.670438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.670293    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5f8bf95-e74f-499d-af29-7d3a91a88f45-home\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:05.965232 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.965195    2581 generic.go:356] "Generic (PLEG): container finished" podID="a5f8bf95-e74f-499d-af29-7d3a91a88f45" containerID="a3c83e7749d5e238702f75185fb737ba4ce8f92496b481afb335ddd0ee570445" exitCode=0
Sep 10 23:53:05.965418 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.965251    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"
Sep 10 23:53:05.965418 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.965285    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5" event={"ID":"a5f8bf95-e74f-499d-af29-7d3a91a88f45","Type":"ContainerDied","Data":"a3c83e7749d5e238702f75185fb737ba4ce8f92496b481afb335ddd0ee570445"}
Sep 10 23:53:05.965418 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.965330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5" event={"ID":"a5f8bf95-e74f-499d-af29-7d3a91a88f45","Type":"ContainerDied","Data":"a00b0de4ae8791771b77572b425c45f2d40160ec55de9794da49691d8b556eff"}
Sep 10 23:53:05.965418 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.965353    2581 scope.go:117] "RemoveContainer" containerID="a3c83e7749d5e238702f75185fb737ba4ce8f92496b481afb335ddd0ee570445"
Sep 10 23:53:05.977048 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.977025    2581 scope.go:117] "RemoveContainer" containerID="a3c83e7749d5e238702f75185fb737ba4ce8f92496b481afb335ddd0ee570445"
Sep 10 23:53:05.977453 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:53:05.977430    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3c83e7749d5e238702f75185fb737ba4ce8f92496b481afb335ddd0ee570445\": container with ID starting with a3c83e7749d5e238702f75185fb737ba4ce8f92496b481afb335ddd0ee570445 not found: ID does not exist" containerID="a3c83e7749d5e238702f75185fb737ba4ce8f92496b481afb335ddd0ee570445"
Sep 10 23:53:05.977539 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.977466    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3c83e7749d5e238702f75185fb737ba4ce8f92496b481afb335ddd0ee570445"} err="failed to get container status \"a3c83e7749d5e238702f75185fb737ba4ce8f92496b481afb335ddd0ee570445\": rpc error: code = NotFound desc = could not find container \"a3c83e7749d5e238702f75185fb737ba4ce8f92496b481afb335ddd0ee570445\": container with ID starting with a3c83e7749d5e238702f75185fb737ba4ce8f92496b481afb335ddd0ee570445 not found: ID does not exist"
Sep 10 23:53:05.995034 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.995008    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"]
Sep 10 23:53:05.998685 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:05.998649    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-d43a0552-kserve-7856998f6f-fz4l5"]
Sep 10 23:53:06.484401 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:06.484368    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5f8bf95-e74f-499d-af29-7d3a91a88f45" path="/var/lib/kubelet/pods/a5f8bf95-e74f-499d-af29-7d3a91a88f45/volumes"
Sep 10 23:53:12.422289 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:12.422257    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:53:15.513324 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.513291    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"]
Sep 10 23:53:15.513804 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.513789    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5f8bf95-e74f-499d-af29-7d3a91a88f45" containerName="main"
Sep 10 23:53:15.513857 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.513807    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5f8bf95-e74f-499d-af29-7d3a91a88f45" containerName="main"
Sep 10 23:53:15.513857 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.513821    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f93ba844-56b5-4e45-8c96-34b8a434e362" containerName="istio-proxy"
Sep 10 23:53:15.513857 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.513827    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f93ba844-56b5-4e45-8c96-34b8a434e362" containerName="istio-proxy"
Sep 10 23:53:15.513857 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.513838    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fd03737-ab40-4bf6-bb8b-f9e6870daa8e" containerName="revoke-keys"
Sep 10 23:53:15.513857 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.513845    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fd03737-ab40-4bf6-bb8b-f9e6870daa8e" containerName="revoke-keys"
Sep 10 23:53:15.513857 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.513852    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd1d5ee3-383a-44db-8a7d-7711673c28a6" containerName="istio-proxy"
Sep 10 23:53:15.513857 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.513858    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd1d5ee3-383a-44db-8a7d-7711673c28a6" containerName="istio-proxy"
Sep 10 23:53:15.514101 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.513929    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fd03737-ab40-4bf6-bb8b-f9e6870daa8e" containerName="revoke-keys"
Sep 10 23:53:15.514101 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.513938    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f93ba844-56b5-4e45-8c96-34b8a434e362" containerName="istio-proxy"
Sep 10 23:53:15.514101 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.513944    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5f8bf95-e74f-499d-af29-7d3a91a88f45" containerName="main"
Sep 10 23:53:15.514101 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.513950    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f93ba844-56b5-4e45-8c96-34b8a434e362" containerName="istio-proxy"
Sep 10 23:53:15.516321 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.516303    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.519320 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.519297    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-677d3c\"/\"explicit-model-677d3c-kserve-self-signed-certs\""
Sep 10 23:53:15.520041 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.520012    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-677d3c\"/\"kube-root-ca.crt\""
Sep 10 23:53:15.520176 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.520059    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-677d3c\"/\"default-dockercfg-rlxwr\""
Sep 10 23:53:15.520176 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.520106    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-677d3c\"/\"openshift-service-ca.crt\""
Sep 10 23:53:15.533357 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.533326    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"]
Sep 10 23:53:15.541472 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.541442    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:15.560766 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.560737    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-model-cache\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.560900 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.560829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62dc7\" (UniqueName: \"kubernetes.io/projected/c90c74c1-f182-4a54-9ac2-580e2daf565f-kube-api-access-62dc7\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.560900 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.560884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-home\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.561022 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.560928    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-dshm\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.561022 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.561011    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c90c74c1-f182-4a54-9ac2-580e2daf565f-tls-certs\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.561117 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.561053    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-tmp-dir\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.662099 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.662059    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62dc7\" (UniqueName: \"kubernetes.io/projected/c90c74c1-f182-4a54-9ac2-580e2daf565f-kube-api-access-62dc7\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.662099 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.662105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-home\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.662377 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.662148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-dshm\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.662377 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.662202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c90c74c1-f182-4a54-9ac2-580e2daf565f-tls-certs\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.662377 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.662244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-tmp-dir\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.662377 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.662298    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-model-cache\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.662996 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.662970    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-home\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.663328 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.663011    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-model-cache\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.663493 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.663268    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-tmp-dir\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.665757 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.665731    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c90c74c1-f182-4a54-9ac2-580e2daf565f-tls-certs\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.677001 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.676966    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-dshm\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.677410 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.677356    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62dc7\" (UniqueName: \"kubernetes.io/projected/c90c74c1-f182-4a54-9ac2-580e2daf565f-kube-api-access-62dc7\") pod \"explicit-model-677d3c-kserve-6f84ffd7b5-8dckc\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") " pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:15.826289 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:15.826197    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:16.103157 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:16.101015    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"]
Sep 10 23:53:16.103878 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:53:16.103843    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc90c74c1_f182_4a54_9ac2_580e2daf565f.slice/crio-4c261bef8867d839c62d76daec91a88d58721080c08bae07bdde91c15468088c WatchSource:0}: Error finding container 4c261bef8867d839c62d76daec91a88d58721080c08bae07bdde91c15468088c: Status 404 returned error can't find the container with id 4c261bef8867d839c62d76daec91a88d58721080c08bae07bdde91c15468088c
Sep 10 23:53:17.040656 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:17.040613    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc" event={"ID":"c90c74c1-f182-4a54-9ac2-580e2daf565f","Type":"ContainerStarted","Data":"180cc0586fc90db040aa1c1136613f788b52ef3b5528aef5c288984e410eb780"}
Sep 10 23:53:17.040656 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:17.040659    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc" event={"ID":"c90c74c1-f182-4a54-9ac2-580e2daf565f","Type":"ContainerStarted","Data":"4c261bef8867d839c62d76daec91a88d58721080c08bae07bdde91c15468088c"}
Sep 10 23:53:17.060828 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:17.060777    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc" podStartSLOduration=2.06076105 podStartE2EDuration="2.06076105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:53:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:53:17.060361485 +0000 UTC m=+997.101230790" watchObservedRunningTime="2026-09-10 23:53:17.06076105 +0000 UTC m=+997.101630356"
Sep 10 23:53:21.723368 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:21.723335    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:53:25.827161 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:25.827109    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:25.827574 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:25.827191    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:25.839969 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:25.839945    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:26.108827 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:26.108750    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:27.188603 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:27.188572    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:31.709530 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.709486    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"]
Sep 10 23:53:31.710121 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.710096    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f93ba844-56b5-4e45-8c96-34b8a434e362" containerName="istio-proxy"
Sep 10 23:53:31.710216 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.710125    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f93ba844-56b5-4e45-8c96-34b8a434e362" containerName="istio-proxy"
Sep 10 23:53:31.712740 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.712715    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.715442 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.715419    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-13374d\"/\"openshift-service-ca.crt\""
Sep 10 23:53:31.716397 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.716377    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-13374d\"/\"test-model-13374d-kserve-self-signed-certs\""
Sep 10 23:53:31.716505 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.716440    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-13374d\"/\"kube-root-ca.crt\""
Sep 10 23:53:31.716601 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.716574    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-13374d\"/\"default-dockercfg-zprkc\""
Sep 10 23:53:31.721461 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.721435    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"]
Sep 10 23:53:31.819978 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.819940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-dshm\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.820161 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.820031    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f07f7c62-2552-458d-bf29-54b8fd99abd8-tls-certs\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.820161 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.820091    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-model-cache\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.820318 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.820237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-tmp-dir\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.820318 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.820264    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4d6v\" (UniqueName: \"kubernetes.io/projected/f07f7c62-2552-458d-bf29-54b8fd99abd8-kube-api-access-r4d6v\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.820318 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.820305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-home\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.825938 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.825908    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:31.921867 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.921827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-model-cache\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.922069 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.921943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-tmp-dir\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.922069 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.921973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4d6v\" (UniqueName: \"kubernetes.io/projected/f07f7c62-2552-458d-bf29-54b8fd99abd8-kube-api-access-r4d6v\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.922069 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.922033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-home\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.922270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.922070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-dshm\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.922270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.922133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f07f7c62-2552-458d-bf29-54b8fd99abd8-tls-certs\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.922383 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.922309    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-model-cache\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.922643 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.922567    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-home\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.922643 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.922572    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-tmp-dir\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.925052 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.925019    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-dshm\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.925178 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.925113    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f07f7c62-2552-458d-bf29-54b8fd99abd8-tls-certs\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:31.930809 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:31.930787    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4d6v\" (UniqueName: \"kubernetes.io/projected/f07f7c62-2552-458d-bf29-54b8fd99abd8-kube-api-access-r4d6v\") pod \"test-model-13374d-kserve-798d9bcdbf-c5n29\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") " pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:32.027455 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:32.027349    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:32.305886 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:32.305860    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"]
Sep 10 23:53:32.307942 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:53:32.307913    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf07f7c62_2552_458d_bf29_54b8fd99abd8.slice/crio-5db4a0041f8b8ef404c3fa4ba0143226cffd59d5252f359afca2e1936c5afdd4 WatchSource:0}: Error finding container 5db4a0041f8b8ef404c3fa4ba0143226cffd59d5252f359afca2e1936c5afdd4: Status 404 returned error can't find the container with id 5db4a0041f8b8ef404c3fa4ba0143226cffd59d5252f359afca2e1936c5afdd4
Sep 10 23:53:32.910987 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:32.910953    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:33.141918 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:33.141880    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29" event={"ID":"f07f7c62-2552-458d-bf29-54b8fd99abd8","Type":"ContainerStarted","Data":"1ed9efa58f6786317b49093316d8687561342da482993d500b5702077e143041"}
Sep 10 23:53:33.142064 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:33.141929    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29" event={"ID":"f07f7c62-2552-458d-bf29-54b8fd99abd8","Type":"ContainerStarted","Data":"5db4a0041f8b8ef404c3fa4ba0143226cffd59d5252f359afca2e1936c5afdd4"}
Sep 10 23:53:33.159433 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:33.159382    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29" podStartSLOduration=2.159367696 podStartE2EDuration="2.159367696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:53:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:53:33.157798251 +0000 UTC m=+1013.198667557" watchObservedRunningTime="2026-09-10 23:53:33.159367696 +0000 UTC m=+1013.200237002"
Sep 10 23:53:33.378846 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:33.378808    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:33.480979 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:33.480951    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:33.577931 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:33.577903    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:35.474162 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:35.474129    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"]
Sep 10 23:53:35.495151 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:35.495123    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:35.603692 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:35.603635    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf"]
Sep 10 23:53:35.606022 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:35.606006    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf"
Sep 10 23:53:35.609232 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:35.609210    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22lrj\""
Sep 10 23:53:35.609457 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:35.609442    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:53:35.615473 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:35.615449    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf"]
Sep 10 23:53:35.738479 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:35.738340    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:35.760649 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:35.760618    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/657c5fff-2e52-47dc-9755-de1f2b414e2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf\" (UID: \"657c5fff-2e52-47dc-9755-de1f2b414e2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf"
Sep 10 23:53:35.861494 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:35.861458    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/657c5fff-2e52-47dc-9755-de1f2b414e2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf\" (UID: \"657c5fff-2e52-47dc-9755-de1f2b414e2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf"
Sep 10 23:53:35.862172 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:35.862151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/657c5fff-2e52-47dc-9755-de1f2b414e2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf\" (UID: \"657c5fff-2e52-47dc-9755-de1f2b414e2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf"
Sep 10 23:53:35.918425 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:35.918379    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf"
Sep 10 23:53:36.199150 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:36.199075    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf"]
Sep 10 23:53:36.202236 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:53:36.202204    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657c5fff_2e52_47dc_9755_de1f2b414e2a.slice/crio-504171f5deec73e7dcaa5fac11d1cde720d8353ff2b358ff0c25974b67c3a1c0 WatchSource:0}: Error finding container 504171f5deec73e7dcaa5fac11d1cde720d8353ff2b358ff0c25974b67c3a1c0: Status 404 returned error can't find the container with id 504171f5deec73e7dcaa5fac11d1cde720d8353ff2b358ff0c25974b67c3a1c0
Sep 10 23:53:37.168210 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:37.168119    2581 generic.go:356] "Generic (PLEG): container finished" podID="657c5fff-2e52-47dc-9755-de1f2b414e2a" containerID="518131fdd47d23d47cde4aec871815986a609a0b92ec3eece3eac61caf6f0ffd" exitCode=0
Sep 10 23:53:37.168210 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:37.168173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf" event={"ID":"657c5fff-2e52-47dc-9755-de1f2b414e2a","Type":"ContainerDied","Data":"518131fdd47d23d47cde4aec871815986a609a0b92ec3eece3eac61caf6f0ffd"}
Sep 10 23:53:37.168622 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:37.168226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf" event={"ID":"657c5fff-2e52-47dc-9755-de1f2b414e2a","Type":"ContainerStarted","Data":"504171f5deec73e7dcaa5fac11d1cde720d8353ff2b358ff0c25974b67c3a1c0"}
Sep 10 23:53:38.314687 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:38.314652    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf"
Sep 10 23:53:38.487969 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:38.487935    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/657c5fff-2e52-47dc-9755-de1f2b414e2a-maas-api-service-ca\") pod \"657c5fff-2e52-47dc-9755-de1f2b414e2a\" (UID: \"657c5fff-2e52-47dc-9755-de1f2b414e2a\") "
Sep 10 23:53:38.488280 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:38.488257    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/657c5fff-2e52-47dc-9755-de1f2b414e2a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "657c5fff-2e52-47dc-9755-de1f2b414e2a" (UID: "657c5fff-2e52-47dc-9755-de1f2b414e2a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:53:38.589319 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:38.589284    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/657c5fff-2e52-47dc-9755-de1f2b414e2a-maas-api-service-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:38.643393 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:38.643357    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:53:39.183184 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:39.183157    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf"
Sep 10 23:53:39.183184 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:39.183173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf" event={"ID":"657c5fff-2e52-47dc-9755-de1f2b414e2a","Type":"ContainerDied","Data":"504171f5deec73e7dcaa5fac11d1cde720d8353ff2b358ff0c25974b67c3a1c0"}
Sep 10 23:53:39.183398 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:39.183214    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="504171f5deec73e7dcaa5fac11d1cde720d8353ff2b358ff0c25974b67c3a1c0"
Sep 10 23:53:42.028264 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:42.028229    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:42.028656 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:42.028566    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:42.041422 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:42.041398    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:42.210898 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:42.210869    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:53:46.097619 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:46.097579    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:46.196910 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:46.196880    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:46.302020 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:46.301982    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:46.326149 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:46.326122    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf"]
Sep 10 23:53:46.329786 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:46.329759    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-677d3c-xwbhf"]
Sep 10 23:53:46.377155 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:46.377062    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:46.484329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:46.484295    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="657c5fff-2e52-47dc-9755-de1f2b414e2a" path="/var/lib/kubelet/pods/657c5fff-2e52-47dc-9755-de1f2b414e2a/volumes"
Sep 10 23:53:46.671617 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:46.671524    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:49.471039 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:49.470992    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:50.494515 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.494461    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc" podUID="c90c74c1-f182-4a54-9ac2-580e2daf565f" containerName="main" containerID="cri-o://180cc0586fc90db040aa1c1136613f788b52ef3b5528aef5c288984e410eb780" gracePeriod=45
Sep 10 23:53:50.787703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.787657    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:50.892202 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.892173    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-tmp-dir\") pod \"c90c74c1-f182-4a54-9ac2-580e2daf565f\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") "
Sep 10 23:53:50.892406 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.892217    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-dshm\") pod \"c90c74c1-f182-4a54-9ac2-580e2daf565f\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") "
Sep 10 23:53:50.892406 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.892250    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c90c74c1-f182-4a54-9ac2-580e2daf565f-tls-certs\") pod \"c90c74c1-f182-4a54-9ac2-580e2daf565f\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") "
Sep 10 23:53:50.892406 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.892308    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-model-cache\") pod \"c90c74c1-f182-4a54-9ac2-580e2daf565f\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") "
Sep 10 23:53:50.892406 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.892375    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-home\") pod \"c90c74c1-f182-4a54-9ac2-580e2daf565f\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") "
Sep 10 23:53:50.892406 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.892402    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62dc7\" (UniqueName: \"kubernetes.io/projected/c90c74c1-f182-4a54-9ac2-580e2daf565f-kube-api-access-62dc7\") pod \"c90c74c1-f182-4a54-9ac2-580e2daf565f\" (UID: \"c90c74c1-f182-4a54-9ac2-580e2daf565f\") "
Sep 10 23:53:50.892724 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.892446    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c90c74c1-f182-4a54-9ac2-580e2daf565f" (UID: "c90c74c1-f182-4a54-9ac2-580e2daf565f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:53:50.892724 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.892602    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-model-cache" (OuterVolumeSpecName: "model-cache") pod "c90c74c1-f182-4a54-9ac2-580e2daf565f" (UID: "c90c74c1-f182-4a54-9ac2-580e2daf565f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:53:50.892724 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.892628    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-home" (OuterVolumeSpecName: "home") pod "c90c74c1-f182-4a54-9ac2-580e2daf565f" (UID: "c90c74c1-f182-4a54-9ac2-580e2daf565f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:53:50.892885 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.892749    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-model-cache\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:50.892885 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.892764    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-home\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:50.892885 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.892772    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-tmp-dir\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:50.894649 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.894622    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c90c74c1-f182-4a54-9ac2-580e2daf565f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c90c74c1-f182-4a54-9ac2-580e2daf565f" (UID: "c90c74c1-f182-4a54-9ac2-580e2daf565f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:53:50.894649 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.894639    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-dshm" (OuterVolumeSpecName: "dshm") pod "c90c74c1-f182-4a54-9ac2-580e2daf565f" (UID: "c90c74c1-f182-4a54-9ac2-580e2daf565f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:53:50.894806 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.894658    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c90c74c1-f182-4a54-9ac2-580e2daf565f-kube-api-access-62dc7" (OuterVolumeSpecName: "kube-api-access-62dc7") pod "c90c74c1-f182-4a54-9ac2-580e2daf565f" (UID: "c90c74c1-f182-4a54-9ac2-580e2daf565f"). InnerVolumeSpecName "kube-api-access-62dc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:53:50.993870 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.993839    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c90c74c1-f182-4a54-9ac2-580e2daf565f-dshm\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:50.993870 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.993866    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c90c74c1-f182-4a54-9ac2-580e2daf565f-tls-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:50.993870 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:50.993878    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62dc7\" (UniqueName: \"kubernetes.io/projected/c90c74c1-f182-4a54-9ac2-580e2daf565f-kube-api-access-62dc7\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:51.257308 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:51.257272    2581 generic.go:356] "Generic (PLEG): container finished" podID="c90c74c1-f182-4a54-9ac2-580e2daf565f" containerID="180cc0586fc90db040aa1c1136613f788b52ef3b5528aef5c288984e410eb780" exitCode=0
Sep 10 23:53:51.257308 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:51.257309    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"
Sep 10 23:53:51.257537 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:51.257351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc" event={"ID":"c90c74c1-f182-4a54-9ac2-580e2daf565f","Type":"ContainerDied","Data":"180cc0586fc90db040aa1c1136613f788b52ef3b5528aef5c288984e410eb780"}
Sep 10 23:53:51.257537 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:51.257392    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc" event={"ID":"c90c74c1-f182-4a54-9ac2-580e2daf565f","Type":"ContainerDied","Data":"4c261bef8867d839c62d76daec91a88d58721080c08bae07bdde91c15468088c"}
Sep 10 23:53:51.257537 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:51.257415    2581 scope.go:117] "RemoveContainer" containerID="180cc0586fc90db040aa1c1136613f788b52ef3b5528aef5c288984e410eb780"
Sep 10 23:53:51.268522 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:51.268495    2581 scope.go:117] "RemoveContainer" containerID="180cc0586fc90db040aa1c1136613f788b52ef3b5528aef5c288984e410eb780"
Sep 10 23:53:51.268885 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:53:51.268859    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"180cc0586fc90db040aa1c1136613f788b52ef3b5528aef5c288984e410eb780\": container with ID starting with 180cc0586fc90db040aa1c1136613f788b52ef3b5528aef5c288984e410eb780 not found: ID does not exist" containerID="180cc0586fc90db040aa1c1136613f788b52ef3b5528aef5c288984e410eb780"
Sep 10 23:53:51.268956 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:51.268901    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"180cc0586fc90db040aa1c1136613f788b52ef3b5528aef5c288984e410eb780"} err="failed to get container status \"180cc0586fc90db040aa1c1136613f788b52ef3b5528aef5c288984e410eb780\": rpc error: code = NotFound desc = could not find container \"180cc0586fc90db040aa1c1136613f788b52ef3b5528aef5c288984e410eb780\": container with ID starting with 180cc0586fc90db040aa1c1136613f788b52ef3b5528aef5c288984e410eb780 not found: ID does not exist"
Sep 10 23:53:51.283768 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:51.283738    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"]
Sep 10 23:53:51.287575 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:51.287551    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-677d3c/explicit-model-677d3c-kserve-6f84ffd7b5-8dckc"]
Sep 10 23:53:52.484186 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:52.484152    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c90c74c1-f182-4a54-9ac2-580e2daf565f" path="/var/lib/kubelet/pods/c90c74c1-f182-4a54-9ac2-580e2daf565f/volumes"
Sep 10 23:53:52.562269 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:52.562240    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:52.662850 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:52.662818    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:52.804739 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:52.804645    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"]
Sep 10 23:53:52.804911 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:52.804852    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7" podUID="73a79f30-fb58-46b4-9a8a-e57e730ff703" containerName="istio-proxy" containerID="cri-o://729e10e624995a2beb9b58345c0fbcbb639e904fc7279f99bebe7d7cd1b53f55" gracePeriod=30
Sep 10 23:53:52.829399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:52.829354    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:53.308146 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:53.308114    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:53.639169 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:53.639072    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:53.789992 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:53.789960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:54.910568 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:54.910514    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:55.009320 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:55.009290    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:55.108854 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:55.108813    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:55.852085 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:55.852053    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:55.955208 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:55.955174    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:56.052228 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:56.052192    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:53:58.057543 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.057520    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:53:58.158869 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.158786    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-data\") pod \"73a79f30-fb58-46b4-9a8a-e57e730ff703\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") "
Sep 10 23:53:58.158869 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.158823    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-credential-socket\") pod \"73a79f30-fb58-46b4-9a8a-e57e730ff703\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") "
Sep 10 23:53:58.158869 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.158859    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfqwp\" (UniqueName: \"kubernetes.io/projected/73a79f30-fb58-46b4-9a8a-e57e730ff703-kube-api-access-dfqwp\") pod \"73a79f30-fb58-46b4-9a8a-e57e730ff703\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") "
Sep 10 23:53:58.159120 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.158899    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-podinfo\") pod \"73a79f30-fb58-46b4-9a8a-e57e730ff703\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") "
Sep 10 23:53:58.159120 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.158934    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73a79f30-fb58-46b4-9a8a-e57e730ff703-istiod-ca-cert\") pod \"73a79f30-fb58-46b4-9a8a-e57e730ff703\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") "
Sep 10 23:53:58.159120 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.159087    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-token\") pod \"73a79f30-fb58-46b4-9a8a-e57e730ff703\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") "
Sep 10 23:53:58.159283 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.159114    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-data" (OuterVolumeSpecName: "istio-data") pod "73a79f30-fb58-46b4-9a8a-e57e730ff703" (UID: "73a79f30-fb58-46b4-9a8a-e57e730ff703"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:53:58.159283 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.159128    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73a79f30-fb58-46b4-9a8a-e57e730ff703" (UID: "73a79f30-fb58-46b4-9a8a-e57e730ff703"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:53:58.159283 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.159142    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-workload-certs\") pod \"73a79f30-fb58-46b4-9a8a-e57e730ff703\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") "
Sep 10 23:53:58.159283 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.159172    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-envoy\") pod \"73a79f30-fb58-46b4-9a8a-e57e730ff703\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") "
Sep 10 23:53:58.159283 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.159252    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-workload-socket\") pod \"73a79f30-fb58-46b4-9a8a-e57e730ff703\" (UID: \"73a79f30-fb58-46b4-9a8a-e57e730ff703\") "
Sep 10 23:53:58.159514 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.159404    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73a79f30-fb58-46b4-9a8a-e57e730ff703" (UID: "73a79f30-fb58-46b4-9a8a-e57e730ff703"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:53:58.159514 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.159330    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73a79f30-fb58-46b4-9a8a-e57e730ff703-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73a79f30-fb58-46b4-9a8a-e57e730ff703" (UID: "73a79f30-fb58-46b4-9a8a-e57e730ff703"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:53:58.159620 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.159524    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73a79f30-fb58-46b4-9a8a-e57e730ff703" (UID: "73a79f30-fb58-46b4-9a8a-e57e730ff703"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:53:58.159620 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.159587    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-workload-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:58.159620 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.159607    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-data\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:58.159774 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.159620    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-credential-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:58.159774 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.159634    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73a79f30-fb58-46b4-9a8a-e57e730ff703-istiod-ca-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:58.161377 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.161347    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-token" (OuterVolumeSpecName: "istio-token") pod "73a79f30-fb58-46b4-9a8a-e57e730ff703" (UID: "73a79f30-fb58-46b4-9a8a-e57e730ff703"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:53:58.161502 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.161374    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73a79f30-fb58-46b4-9a8a-e57e730ff703" (UID: "73a79f30-fb58-46b4-9a8a-e57e730ff703"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:53:58.161502 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.161376    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73a79f30-fb58-46b4-9a8a-e57e730ff703" (UID: "73a79f30-fb58-46b4-9a8a-e57e730ff703"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:53:58.161583 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.161551    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73a79f30-fb58-46b4-9a8a-e57e730ff703-kube-api-access-dfqwp" (OuterVolumeSpecName: "kube-api-access-dfqwp") pod "73a79f30-fb58-46b4-9a8a-e57e730ff703" (UID: "73a79f30-fb58-46b4-9a8a-e57e730ff703"). InnerVolumeSpecName "kube-api-access-dfqwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:53:58.261008 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.260975    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-podinfo\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:58.261008 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.261000    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-token\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:58.261008 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.261009    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-istio-envoy\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:58.261008 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.261016    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73a79f30-fb58-46b4-9a8a-e57e730ff703-workload-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:58.261269 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.261025    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfqwp\" (UniqueName: \"kubernetes.io/projected/73a79f30-fb58-46b4-9a8a-e57e730ff703-kube-api-access-dfqwp\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:53:58.303346 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.303312    2581 generic.go:356] "Generic (PLEG): container finished" podID="73a79f30-fb58-46b4-9a8a-e57e730ff703" containerID="729e10e624995a2beb9b58345c0fbcbb639e904fc7279f99bebe7d7cd1b53f55" exitCode=0
Sep 10 23:53:58.303512 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.303362    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"
Sep 10 23:53:58.303512 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.303388    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7" event={"ID":"73a79f30-fb58-46b4-9a8a-e57e730ff703","Type":"ContainerDied","Data":"729e10e624995a2beb9b58345c0fbcbb639e904fc7279f99bebe7d7cd1b53f55"}
Sep 10 23:53:58.303512 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.303438    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7" event={"ID":"73a79f30-fb58-46b4-9a8a-e57e730ff703","Type":"ContainerDied","Data":"c937e9fa8beee0208c86046c4d6a1419b551b3101a3cd860b2896f8da0c19a35"}
Sep 10 23:53:58.303512 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.303461    2581 scope.go:117] "RemoveContainer" containerID="729e10e624995a2beb9b58345c0fbcbb639e904fc7279f99bebe7d7cd1b53f55"
Sep 10 23:53:58.313216 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.313174    2581 scope.go:117] "RemoveContainer" containerID="30b7be72cbc7f13bc1ade5e959e8da4929643423b973ece589fcdc289d9673ac"
Sep 10 23:53:58.321482 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.321466    2581 scope.go:117] "RemoveContainer" containerID="729e10e624995a2beb9b58345c0fbcbb639e904fc7279f99bebe7d7cd1b53f55"
Sep 10 23:53:58.321782 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:53:58.321764    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"729e10e624995a2beb9b58345c0fbcbb639e904fc7279f99bebe7d7cd1b53f55\": container with ID starting with 729e10e624995a2beb9b58345c0fbcbb639e904fc7279f99bebe7d7cd1b53f55 not found: ID does not exist" containerID="729e10e624995a2beb9b58345c0fbcbb639e904fc7279f99bebe7d7cd1b53f55"
Sep 10 23:53:58.321840 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.321792    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"729e10e624995a2beb9b58345c0fbcbb639e904fc7279f99bebe7d7cd1b53f55"} err="failed to get container status \"729e10e624995a2beb9b58345c0fbcbb639e904fc7279f99bebe7d7cd1b53f55\": rpc error: code = NotFound desc = could not find container \"729e10e624995a2beb9b58345c0fbcbb639e904fc7279f99bebe7d7cd1b53f55\": container with ID starting with 729e10e624995a2beb9b58345c0fbcbb639e904fc7279f99bebe7d7cd1b53f55 not found: ID does not exist"
Sep 10 23:53:58.321840 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.321810    2581 scope.go:117] "RemoveContainer" containerID="30b7be72cbc7f13bc1ade5e959e8da4929643423b973ece589fcdc289d9673ac"
Sep 10 23:53:58.322159 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:53:58.322133    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30b7be72cbc7f13bc1ade5e959e8da4929643423b973ece589fcdc289d9673ac\": container with ID starting with 30b7be72cbc7f13bc1ade5e959e8da4929643423b973ece589fcdc289d9673ac not found: ID does not exist" containerID="30b7be72cbc7f13bc1ade5e959e8da4929643423b973ece589fcdc289d9673ac"
Sep 10 23:53:58.322272 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.322163    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b7be72cbc7f13bc1ade5e959e8da4929643423b973ece589fcdc289d9673ac"} err="failed to get container status \"30b7be72cbc7f13bc1ade5e959e8da4929643423b973ece589fcdc289d9673ac\": rpc error: code = NotFound desc = could not find container \"30b7be72cbc7f13bc1ade5e959e8da4929643423b973ece589fcdc289d9673ac\": container with ID starting with 30b7be72cbc7f13bc1ade5e959e8da4929643423b973ece589fcdc289d9673ac not found: ID does not exist"
Sep 10 23:53:58.324946 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.324926    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"]
Sep 10 23:53:58.328713 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.328663    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7"]
Sep 10 23:53:58.484276 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:58.484247    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73a79f30-fb58-46b4-9a8a-e57e730ff703" path="/var/lib/kubelet/pods/73a79f30-fb58-46b4-9a8a-e57e730ff703/volumes"
Sep 10 23:53:59.033423 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:53:59.033389    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:54:06.583367 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:06.583334    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:07.343925 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:07.343890    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:13.267977 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:13.267930    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:13.380224 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:13.380190    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:13.471523 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:13.471486    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:13.582089 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:13.582013    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:14.261616 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:14.261585    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:14.365089 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:14.365054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:14.460325 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:14.460297    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:15.847414 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:15.847380    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:19.522853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:19.522822    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:54:20.064260 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:20.064220    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:21.649324 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:21.649286    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:21.776074 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:21.776042    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:22.305222 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:22.305184    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:22.740312 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:22.740281    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:22.849278 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:22.849248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:23.052168 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:23.052082    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:23.160294 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:23.160267    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:28.285489 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:28.285454    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:28.701530 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:28.701499    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:28.772227 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:28.772193    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:28.960025 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:28.959934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:29.266399 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.266324    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"]
Sep 10 23:54:29.266904 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.266886    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c90c74c1-f182-4a54-9ac2-580e2daf565f" containerName="main"
Sep 10 23:54:29.266964 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.266908    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c90c74c1-f182-4a54-9ac2-580e2daf565f" containerName="main"
Sep 10 23:54:29.266964 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.266926    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="657c5fff-2e52-47dc-9755-de1f2b414e2a" containerName="revoke-keys"
Sep 10 23:54:29.266964 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.266934    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="657c5fff-2e52-47dc-9755-de1f2b414e2a" containerName="revoke-keys"
Sep 10 23:54:29.266964 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.266957    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a79f30-fb58-46b4-9a8a-e57e730ff703" containerName="istio-proxy"
Sep 10 23:54:29.267101 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.266966    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a79f30-fb58-46b4-9a8a-e57e730ff703" containerName="istio-proxy"
Sep 10 23:54:29.267101 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.266977    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a79f30-fb58-46b4-9a8a-e57e730ff703" containerName="istio-proxy"
Sep 10 23:54:29.267101 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.266985    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a79f30-fb58-46b4-9a8a-e57e730ff703" containerName="istio-proxy"
Sep 10 23:54:29.267101 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.267071    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="73a79f30-fb58-46b4-9a8a-e57e730ff703" containerName="istio-proxy"
Sep 10 23:54:29.267101 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.267084    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="657c5fff-2e52-47dc-9755-de1f2b414e2a" containerName="revoke-keys"
Sep 10 23:54:29.267101 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.267095    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="73a79f30-fb58-46b4-9a8a-e57e730ff703" containerName="istio-proxy"
Sep 10 23:54:29.267288 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.267104    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c90c74c1-f182-4a54-9ac2-580e2daf565f" containerName="main"
Sep 10 23:54:29.270708 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.270691    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.274183 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.274162    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ff0028b6-openshift-default-dockercfg-lw667\""
Sep 10 23:54:29.282080 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.282059    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"]
Sep 10 23:54:29.296620 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.296596    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:29.356102 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.356073    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-data\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.356271 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.356121    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-podinfo\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.356271 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.356177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-credential-socket\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.356271 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.356193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-token\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.356271 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.356233    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-workload-socket\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.356454 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.356282    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9hvz\" (UniqueName: \"kubernetes.io/projected/dbb4fd51-3253-4198-b4e5-be4f91281f13-kube-api-access-v9hvz\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.356454 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.356308    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-workload-certs\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.356454 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.356325    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbb4fd51-3253-4198-b4e5-be4f91281f13-istiod-ca-cert\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.356454 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.356378    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-envoy\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.457254 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.457220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-envoy\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.457447 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.457270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-data\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.457447 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.457312    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-podinfo\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.457447 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.457341    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-credential-socket\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.457447 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.457357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-token\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.457447 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.457376    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-workload-socket\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.457447 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.457413    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9hvz\" (UniqueName: \"kubernetes.io/projected/dbb4fd51-3253-4198-b4e5-be4f91281f13-kube-api-access-v9hvz\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.457447 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.457448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-workload-certs\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.457895 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.457478    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbb4fd51-3253-4198-b4e5-be4f91281f13-istiod-ca-cert\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.457895 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.457787    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-credential-socket\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.457895 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.457817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-data\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.458031 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.457988    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-workload-socket\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.458073 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.458038    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-workload-certs\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.458486 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.458464    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbb4fd51-3253-4198-b4e5-be4f91281f13-istiod-ca-cert\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.459711 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.459664    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-envoy\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.459905 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.459888    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-podinfo\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.466997 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.466975    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9hvz\" (UniqueName: \"kubernetes.io/projected/dbb4fd51-3253-4198-b4e5-be4f91281f13-kube-api-access-v9hvz\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.467781 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.467763    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-token\") pod \"e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") " pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.583193 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.583098    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:29.583193 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.583101    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:29.872147 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.872122    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"]
Sep 10 23:54:29.874240 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:54:29.874212    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb4fd51_3253_4198_b4e5_be4f91281f13.slice/crio-e4c8647f9afe1042442d8de6ec6022667cabe0b804eb62b9da0f8f850748baaa WatchSource:0}: Error finding container e4c8647f9afe1042442d8de6ec6022667cabe0b804eb62b9da0f8f850748baaa: Status 404 returned error can't find the container with id e4c8647f9afe1042442d8de6ec6022667cabe0b804eb62b9da0f8f850748baaa
Sep 10 23:54:29.876592 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.876558    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:54:29.876704 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.876635    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:54:29.876777 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:29.876709    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:54:30.495278 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:30.495250    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7" event={"ID":"dbb4fd51-3253-4198-b4e5-be4f91281f13","Type":"ContainerStarted","Data":"dba6741dde81fc469875ed68915375f335b2388c9939b51cdbaa0e1ea56ce5d3"}
Sep 10 23:54:30.495703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:30.495292    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7" event={"ID":"dbb4fd51-3253-4198-b4e5-be4f91281f13","Type":"ContainerStarted","Data":"e4c8647f9afe1042442d8de6ec6022667cabe0b804eb62b9da0f8f850748baaa"}
Sep 10 23:54:30.518609 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:30.518562    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7" podStartSLOduration=1.518546291 podStartE2EDuration="1.518546291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:54:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:54:30.515701125 +0000 UTC m=+1070.556570423" watchObservedRunningTime="2026-09-10 23:54:30.518546291 +0000 UTC m=+1070.559415596"
Sep 10 23:54:30.583654 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:30.583622    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:30.588866 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:30.588845    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:31.501288 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:31.501207    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:31.502219 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:31.502201    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:32.452947 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:32.452912    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:32.656867 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:32.656829    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:33.665740 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:33.665700    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:33.763649 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:33.763597    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:33.854738 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:33.854707    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:54:33.868237 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:33.868205    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:34.291976 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:34.291942    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:34.402005 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:34.401972    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:49.837799 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:49.837762    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:54:52.639732 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:52.639699    2581 generic.go:356] "Generic (PLEG): container finished" podID="dbb4fd51-3253-4198-b4e5-be4f91281f13" containerID="dba6741dde81fc469875ed68915375f335b2388c9939b51cdbaa0e1ea56ce5d3" exitCode=0
Sep 10 23:54:52.640163 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:52.639812    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7" event={"ID":"dbb4fd51-3253-4198-b4e5-be4f91281f13","Type":"ContainerDied","Data":"dba6741dde81fc469875ed68915375f335b2388c9939b51cdbaa0e1ea56ce5d3"}
Sep 10 23:54:52.640248 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:52.640234    2581 scope.go:117] "RemoveContainer" containerID="dba6741dde81fc469875ed68915375f335b2388c9939b51cdbaa0e1ea56ce5d3"
Sep 10 23:54:52.641297 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:52.641270    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:54:52.641355 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:52.641339    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:54:52.641391 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:52.641370    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:54:53.647792 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:53.647763    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7" event={"ID":"dbb4fd51-3253-4198-b4e5-be4f91281f13","Type":"ContainerStarted","Data":"c2ee4272a1186be02155d85f7357d60e65a43918cef3ef5ac09773d5906dc404"}
Sep 10 23:54:54.584422 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:54.584388    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:54.584820 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:54.584793    2581 patch_prober.go:28] interesting pod/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 23:54:54.585026 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:54.584996    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7" podUID="dbb4fd51-3253-4198-b4e5-be4f91281f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 23:54:55.584091 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:55.584053    2581 patch_prober.go:28] interesting pod/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 23:54:55.584795 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:55.584757    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7" podUID="dbb4fd51-3253-4198-b4e5-be4f91281f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 23:54:56.584437 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:56.584394    2581 patch_prober.go:28] interesting pod/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 23:54:56.585079 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:56.585043    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7" podUID="dbb4fd51-3253-4198-b4e5-be4f91281f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 23:54:57.386137 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:57.386096    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:57.584478 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:57.584435    2581 patch_prober.go:28] interesting pod/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 23:54:57.585001 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:57.584508    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7" podUID="dbb4fd51-3253-4198-b4e5-be4f91281f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 23:54:58.017717 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:58.017641    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:58.118189 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:58.118158    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:58.477938 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:58.477902    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:58.584225 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:58.584176    2581 patch_prober.go:28] interesting pod/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 23:54:58.584438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:58.584254    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7" podUID="dbb4fd51-3253-4198-b4e5-be4f91281f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 23:54:59.356574 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:59.356542    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"]
Sep 10 23:54:59.384380 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:59.384353    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:54:59.588074 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:59.588043    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:59.588342 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:59.588316    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:54:59.589044 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:54:59.589025    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:55:00.447689 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:00.447646    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"]
Sep 10 23:55:00.466023 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:00.465990    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:00.623363 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:00.623332    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc"]
Sep 10 23:55:00.625747 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:00.625731    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc"
Sep 10 23:55:00.629830 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:00.629809    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:55:00.629961 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:00.629809    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22lrj\""
Sep 10 23:55:00.645008 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:00.644980    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc"]
Sep 10 23:55:00.760564 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:00.760533    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4929233-57e9-4faa-b2a1-402a904f683f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc\" (UID: \"b4929233-57e9-4faa-b2a1-402a904f683f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc"
Sep 10 23:55:00.856416 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:00.856385    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:00.861722 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:00.861697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4929233-57e9-4faa-b2a1-402a904f683f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc\" (UID: \"b4929233-57e9-4faa-b2a1-402a904f683f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc"
Sep 10 23:55:00.862316 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:00.862295    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4929233-57e9-4faa-b2a1-402a904f683f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc\" (UID: \"b4929233-57e9-4faa-b2a1-402a904f683f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc"
Sep 10 23:55:00.936422 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:00.936389    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc"
Sep 10 23:55:01.209260 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:01.209233    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc"]
Sep 10 23:55:01.210788 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:55:01.210760    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4929233_57e9_4faa_b2a1_402a904f683f.slice/crio-baa6ddef951b0d53a4501d2dd957a54a1aea81743c46a52259868484c1e4d479 WatchSource:0}: Error finding container baa6ddef951b0d53a4501d2dd957a54a1aea81743c46a52259868484c1e4d479: Status 404 returned error can't find the container with id baa6ddef951b0d53a4501d2dd957a54a1aea81743c46a52259868484c1e4d479
Sep 10 23:55:01.707567 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:01.707529    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc" event={"ID":"b4929233-57e9-4faa-b2a1-402a904f683f","Type":"ContainerStarted","Data":"aa265116d0a72fb3115779ab042a1ee02f393e023a123070924051e2f87918f8"}
Sep 10 23:55:01.708020 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:01.707593    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc" event={"ID":"b4929233-57e9-4faa-b2a1-402a904f683f","Type":"ContainerStarted","Data":"baa6ddef951b0d53a4501d2dd957a54a1aea81743c46a52259868484c1e4d479"}
Sep 10 23:55:01.737934 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:01.737836    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc" podStartSLOduration=1.7378197210000002 podStartE2EDuration="1.737819721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:55:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:55:01.737196724 +0000 UTC m=+1101.778066030" watchObservedRunningTime="2026-09-10 23:55:01.737819721 +0000 UTC m=+1101.778689025"
Sep 10 23:55:02.715129 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:02.715097    2581 generic.go:356] "Generic (PLEG): container finished" podID="b4929233-57e9-4faa-b2a1-402a904f683f" containerID="aa265116d0a72fb3115779ab042a1ee02f393e023a123070924051e2f87918f8" exitCode=0
Sep 10 23:55:02.715519 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:02.715176    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc" event={"ID":"b4929233-57e9-4faa-b2a1-402a904f683f","Type":"ContainerDied","Data":"aa265116d0a72fb3115779ab042a1ee02f393e023a123070924051e2f87918f8"}
Sep 10 23:55:03.854758 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:03.854732    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc"
Sep 10 23:55:03.994692 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:03.994589    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4929233-57e9-4faa-b2a1-402a904f683f-maas-api-service-ca\") pod \"b4929233-57e9-4faa-b2a1-402a904f683f\" (UID: \"b4929233-57e9-4faa-b2a1-402a904f683f\") "
Sep 10 23:55:03.994951 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:03.994926    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4929233-57e9-4faa-b2a1-402a904f683f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b4929233-57e9-4faa-b2a1-402a904f683f" (UID: "b4929233-57e9-4faa-b2a1-402a904f683f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:55:04.095503 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:04.095467    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4929233-57e9-4faa-b2a1-402a904f683f-maas-api-service-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:04.597782 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:04.597746    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:04.632107 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:04.632072    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:55:04.698519 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:04.698486    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:04.727551 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:04.727529    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc"
Sep 10 23:55:04.727730 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:04.727565    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc" event={"ID":"b4929233-57e9-4faa-b2a1-402a904f683f","Type":"ContainerDied","Data":"baa6ddef951b0d53a4501d2dd957a54a1aea81743c46a52259868484c1e4d479"}
Sep 10 23:55:04.727730 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:04.727610    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="baa6ddef951b0d53a4501d2dd957a54a1aea81743c46a52259868484c1e4d479"
Sep 10 23:55:04.965969 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:04.965922    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5"]
Sep 10 23:55:04.966535 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:04.966516    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4929233-57e9-4faa-b2a1-402a904f683f" containerName="revoke-keys"
Sep 10 23:55:04.966604 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:04.966538    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4929233-57e9-4faa-b2a1-402a904f683f" containerName="revoke-keys"
Sep 10 23:55:04.966648 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:04.966631    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4929233-57e9-4faa-b2a1-402a904f683f" containerName="revoke-keys"
Sep 10 23:55:04.968773 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:04.968756    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5"
Sep 10 23:55:04.971384 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:04.971358    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22lrj\""
Sep 10 23:55:04.971506 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:04.971366    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:55:04.976650 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:04.976625    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5"]
Sep 10 23:55:05.070129 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:05.070096    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:05.104374 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:05.104337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0840bbf-9fb8-4248-9771-d16de31d570f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5\" (UID: \"c0840bbf-9fb8-4248-9771-d16de31d570f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5"
Sep 10 23:55:05.205556 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:05.205519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0840bbf-9fb8-4248-9771-d16de31d570f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5\" (UID: \"c0840bbf-9fb8-4248-9771-d16de31d570f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5"
Sep 10 23:55:05.206204 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:05.206186    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0840bbf-9fb8-4248-9771-d16de31d570f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5\" (UID: \"c0840bbf-9fb8-4248-9771-d16de31d570f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5"
Sep 10 23:55:05.282202 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:05.282118    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5"
Sep 10 23:55:05.562080 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:05.562054    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5"]
Sep 10 23:55:05.563352 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:55:05.563328    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0840bbf_9fb8_4248_9771_d16de31d570f.slice/crio-efe9bde707dd94f1cf94c890f10e166185702212a9d070af12f4e5141fa35da9 WatchSource:0}: Error finding container efe9bde707dd94f1cf94c890f10e166185702212a9d070af12f4e5141fa35da9: Status 404 returned error can't find the container with id efe9bde707dd94f1cf94c890f10e166185702212a9d070af12f4e5141fa35da9
Sep 10 23:55:05.735291 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:05.735255    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5" event={"ID":"c0840bbf-9fb8-4248-9771-d16de31d570f","Type":"ContainerStarted","Data":"efe9bde707dd94f1cf94c890f10e166185702212a9d070af12f4e5141fa35da9"}
Sep 10 23:55:05.914368 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:05.914332    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:06.743273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:06.743242    2581 generic.go:356] "Generic (PLEG): container finished" podID="c0840bbf-9fb8-4248-9771-d16de31d570f" containerID="e5a5ebe92f03295414a756852eed6789bd2cc14800879a7ab3b5a133a9b57285" exitCode=0
Sep 10 23:55:06.743659 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:06.743282    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5" event={"ID":"c0840bbf-9fb8-4248-9771-d16de31d570f","Type":"ContainerDied","Data":"e5a5ebe92f03295414a756852eed6789bd2cc14800879a7ab3b5a133a9b57285"}
Sep 10 23:55:07.895045 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:07.895021    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5"
Sep 10 23:55:07.925619 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:07.925595    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0840bbf-9fb8-4248-9771-d16de31d570f-maas-api-service-ca\") pod \"c0840bbf-9fb8-4248-9771-d16de31d570f\" (UID: \"c0840bbf-9fb8-4248-9771-d16de31d570f\") "
Sep 10 23:55:07.925984 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:07.925964    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0840bbf-9fb8-4248-9771-d16de31d570f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c0840bbf-9fb8-4248-9771-d16de31d570f" (UID: "c0840bbf-9fb8-4248-9771-d16de31d570f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:55:08.027184 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:08.027108    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0840bbf-9fb8-4248-9771-d16de31d570f-maas-api-service-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:08.757832 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:08.757746    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5"
Sep 10 23:55:08.757832 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:08.757792    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5" event={"ID":"c0840bbf-9fb8-4248-9771-d16de31d570f","Type":"ContainerDied","Data":"efe9bde707dd94f1cf94c890f10e166185702212a9d070af12f4e5141fa35da9"}
Sep 10 23:55:08.758004 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:08.757850    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efe9bde707dd94f1cf94c890f10e166185702212a9d070af12f4e5141fa35da9"
Sep 10 23:55:10.733306 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:10.733272    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:11.356984 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:11.356952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:11.432242 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:11.432202    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:11.504076 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:11.504043    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:11.598491 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:11.598458    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc"]
Sep 10 23:55:11.600996 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:11.600953    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:11.601236 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:11.601216    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ce1dd5-z7zhc"]
Sep 10 23:55:11.682515 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:11.682433    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:11.972311 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:11.972280    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:12.483953 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:12.483924    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4929233-57e9-4faa-b2a1-402a904f683f" path="/var/lib/kubelet/pods/b4929233-57e9-4faa-b2a1-402a904f683f/volumes"
Sep 10 23:55:14.259258 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.259232    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:14.376409 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.376354    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz" podUID="0d872730-6f79-4e83-9a57-a67660dd9bd3" containerName="main" containerID="cri-o://970f7c9bdca1f95d438c14207704b18fdefe1dc5109698e72bc75bdfe961b773" gracePeriod=45
Sep 10 23:55:14.381884 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.381858    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:14.632019 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.631991    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:55:14.685416 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.685386    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-766vf\" (UniqueName: \"kubernetes.io/projected/0d872730-6f79-4e83-9a57-a67660dd9bd3-kube-api-access-766vf\") pod \"0d872730-6f79-4e83-9a57-a67660dd9bd3\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") "
Sep 10 23:55:14.685597 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.685430    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-model-cache\") pod \"0d872730-6f79-4e83-9a57-a67660dd9bd3\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") "
Sep 10 23:55:14.685597 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.685474    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d872730-6f79-4e83-9a57-a67660dd9bd3-tls-certs\") pod \"0d872730-6f79-4e83-9a57-a67660dd9bd3\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") "
Sep 10 23:55:14.685597 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.685491    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-tmp-dir\") pod \"0d872730-6f79-4e83-9a57-a67660dd9bd3\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") "
Sep 10 23:55:14.685597 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.685525    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-home\") pod \"0d872730-6f79-4e83-9a57-a67660dd9bd3\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") "
Sep 10 23:55:14.685836 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.685600    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-dshm\") pod \"0d872730-6f79-4e83-9a57-a67660dd9bd3\" (UID: \"0d872730-6f79-4e83-9a57-a67660dd9bd3\") "
Sep 10 23:55:14.685903 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.685843    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0d872730-6f79-4e83-9a57-a67660dd9bd3" (UID: "0d872730-6f79-4e83-9a57-a67660dd9bd3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:14.686005 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.685971    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-home" (OuterVolumeSpecName: "home") pod "0d872730-6f79-4e83-9a57-a67660dd9bd3" (UID: "0d872730-6f79-4e83-9a57-a67660dd9bd3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:14.686124 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.686083    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-model-cache" (OuterVolumeSpecName: "model-cache") pod "0d872730-6f79-4e83-9a57-a67660dd9bd3" (UID: "0d872730-6f79-4e83-9a57-a67660dd9bd3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:14.688083 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.688059    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d872730-6f79-4e83-9a57-a67660dd9bd3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0d872730-6f79-4e83-9a57-a67660dd9bd3" (UID: "0d872730-6f79-4e83-9a57-a67660dd9bd3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:55:14.688222 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.688203    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d872730-6f79-4e83-9a57-a67660dd9bd3-kube-api-access-766vf" (OuterVolumeSpecName: "kube-api-access-766vf") pod "0d872730-6f79-4e83-9a57-a67660dd9bd3" (UID: "0d872730-6f79-4e83-9a57-a67660dd9bd3"). InnerVolumeSpecName "kube-api-access-766vf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:55:14.688374 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.688349    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-dshm" (OuterVolumeSpecName: "dshm") pod "0d872730-6f79-4e83-9a57-a67660dd9bd3" (UID: "0d872730-6f79-4e83-9a57-a67660dd9bd3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:14.786324 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.786299    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-dshm\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:14.786324 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.786324    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-766vf\" (UniqueName: \"kubernetes.io/projected/0d872730-6f79-4e83-9a57-a67660dd9bd3-kube-api-access-766vf\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:14.786490 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.786334    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-model-cache\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:14.786490 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.786344    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d872730-6f79-4e83-9a57-a67660dd9bd3-tls-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:14.786490 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.786351    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-tmp-dir\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:14.786490 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.786359    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d872730-6f79-4e83-9a57-a67660dd9bd3-home\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:14.797220 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.797140    2581 generic.go:356] "Generic (PLEG): container finished" podID="0d872730-6f79-4e83-9a57-a67660dd9bd3" containerID="970f7c9bdca1f95d438c14207704b18fdefe1dc5109698e72bc75bdfe961b773" exitCode=0
Sep 10 23:55:14.797220 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.797203    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"
Sep 10 23:55:14.797395 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.797224    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz" event={"ID":"0d872730-6f79-4e83-9a57-a67660dd9bd3","Type":"ContainerDied","Data":"970f7c9bdca1f95d438c14207704b18fdefe1dc5109698e72bc75bdfe961b773"}
Sep 10 23:55:14.797395 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.797265    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz" event={"ID":"0d872730-6f79-4e83-9a57-a67660dd9bd3","Type":"ContainerDied","Data":"ec536b8990dd305b2cfd0c6284813873cf22350ee07e5184080fcbb669837ef6"}
Sep 10 23:55:14.797395 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.797287    2581 scope.go:117] "RemoveContainer" containerID="970f7c9bdca1f95d438c14207704b18fdefe1dc5109698e72bc75bdfe961b773"
Sep 10 23:55:14.810864 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.809217    2581 scope.go:117] "RemoveContainer" containerID="970f7c9bdca1f95d438c14207704b18fdefe1dc5109698e72bc75bdfe961b773"
Sep 10 23:55:14.810864 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:55:14.809705    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"970f7c9bdca1f95d438c14207704b18fdefe1dc5109698e72bc75bdfe961b773\": container with ID starting with 970f7c9bdca1f95d438c14207704b18fdefe1dc5109698e72bc75bdfe961b773 not found: ID does not exist" containerID="970f7c9bdca1f95d438c14207704b18fdefe1dc5109698e72bc75bdfe961b773"
Sep 10 23:55:14.810864 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.809735    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"970f7c9bdca1f95d438c14207704b18fdefe1dc5109698e72bc75bdfe961b773"} err="failed to get container status \"970f7c9bdca1f95d438c14207704b18fdefe1dc5109698e72bc75bdfe961b773\": rpc error: code = NotFound desc = could not find container \"970f7c9bdca1f95d438c14207704b18fdefe1dc5109698e72bc75bdfe961b773\": container with ID starting with 970f7c9bdca1f95d438c14207704b18fdefe1dc5109698e72bc75bdfe961b773 not found: ID does not exist"
Sep 10 23:55:14.824416 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.824392    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"]
Sep 10 23:55:14.829661 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:14.829636    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-ce1dd5/test-model-ce1dd5-kserve-9bfbb4665-9jxwz"]
Sep 10 23:55:15.215174 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.215142    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:15.468510 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.468410    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29" podUID="f07f7c62-2552-458d-bf29-54b8fd99abd8" containerName="main" containerID="cri-o://1ed9efa58f6786317b49093316d8687561342da482993d500b5702077e143041" gracePeriod=45
Sep 10 23:55:15.625711 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.625650    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:55:15.739030 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.739004    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:55:15.795580 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.795550    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-home\") pod \"f07f7c62-2552-458d-bf29-54b8fd99abd8\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") "
Sep 10 23:55:15.795783 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.795589    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-tmp-dir\") pod \"f07f7c62-2552-458d-bf29-54b8fd99abd8\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") "
Sep 10 23:55:15.795783 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.795616    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-model-cache\") pod \"f07f7c62-2552-458d-bf29-54b8fd99abd8\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") "
Sep 10 23:55:15.795783 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.795658    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4d6v\" (UniqueName: \"kubernetes.io/projected/f07f7c62-2552-458d-bf29-54b8fd99abd8-kube-api-access-r4d6v\") pod \"f07f7c62-2552-458d-bf29-54b8fd99abd8\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") "
Sep 10 23:55:15.795783 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.795696    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-dshm\") pod \"f07f7c62-2552-458d-bf29-54b8fd99abd8\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") "
Sep 10 23:55:15.795783 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.795722    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f07f7c62-2552-458d-bf29-54b8fd99abd8-tls-certs\") pod \"f07f7c62-2552-458d-bf29-54b8fd99abd8\" (UID: \"f07f7c62-2552-458d-bf29-54b8fd99abd8\") "
Sep 10 23:55:15.796041 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.795895    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f07f7c62-2552-458d-bf29-54b8fd99abd8" (UID: "f07f7c62-2552-458d-bf29-54b8fd99abd8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:15.796041 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.795907    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-home" (OuterVolumeSpecName: "home") pod "f07f7c62-2552-458d-bf29-54b8fd99abd8" (UID: "f07f7c62-2552-458d-bf29-54b8fd99abd8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:15.796041 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.795960    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-model-cache" (OuterVolumeSpecName: "model-cache") pod "f07f7c62-2552-458d-bf29-54b8fd99abd8" (UID: "f07f7c62-2552-458d-bf29-54b8fd99abd8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:15.796193 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.796146    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-home\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:15.796193 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.796159    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-tmp-dir\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:15.796193 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.796169    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-model-cache\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:15.798090 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.798064    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-dshm" (OuterVolumeSpecName: "dshm") pod "f07f7c62-2552-458d-bf29-54b8fd99abd8" (UID: "f07f7c62-2552-458d-bf29-54b8fd99abd8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:15.798208 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.798120    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f07f7c62-2552-458d-bf29-54b8fd99abd8-kube-api-access-r4d6v" (OuterVolumeSpecName: "kube-api-access-r4d6v") pod "f07f7c62-2552-458d-bf29-54b8fd99abd8" (UID: "f07f7c62-2552-458d-bf29-54b8fd99abd8"). InnerVolumeSpecName "kube-api-access-r4d6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:55:15.798208 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.798183    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f07f7c62-2552-458d-bf29-54b8fd99abd8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f07f7c62-2552-458d-bf29-54b8fd99abd8" (UID: "f07f7c62-2552-458d-bf29-54b8fd99abd8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:55:15.807100 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.807068    2581 generic.go:356] "Generic (PLEG): container finished" podID="f07f7c62-2552-458d-bf29-54b8fd99abd8" containerID="1ed9efa58f6786317b49093316d8687561342da482993d500b5702077e143041" exitCode=0
Sep 10 23:55:15.807185 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.807113    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"
Sep 10 23:55:15.807185 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.807150    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29" event={"ID":"f07f7c62-2552-458d-bf29-54b8fd99abd8","Type":"ContainerDied","Data":"1ed9efa58f6786317b49093316d8687561342da482993d500b5702077e143041"}
Sep 10 23:55:15.807279 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.807197    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29" event={"ID":"f07f7c62-2552-458d-bf29-54b8fd99abd8","Type":"ContainerDied","Data":"5db4a0041f8b8ef404c3fa4ba0143226cffd59d5252f359afca2e1936c5afdd4"}
Sep 10 23:55:15.807279 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.807221    2581 scope.go:117] "RemoveContainer" containerID="1ed9efa58f6786317b49093316d8687561342da482993d500b5702077e143041"
Sep 10 23:55:15.817821 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.817774    2581 scope.go:117] "RemoveContainer" containerID="1ed9efa58f6786317b49093316d8687561342da482993d500b5702077e143041"
Sep 10 23:55:15.818063 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:55:15.818047    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ed9efa58f6786317b49093316d8687561342da482993d500b5702077e143041\": container with ID starting with 1ed9efa58f6786317b49093316d8687561342da482993d500b5702077e143041 not found: ID does not exist" containerID="1ed9efa58f6786317b49093316d8687561342da482993d500b5702077e143041"
Sep 10 23:55:15.818134 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.818070    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ed9efa58f6786317b49093316d8687561342da482993d500b5702077e143041"} err="failed to get container status \"1ed9efa58f6786317b49093316d8687561342da482993d500b5702077e143041\": rpc error: code = NotFound desc = could not find container \"1ed9efa58f6786317b49093316d8687561342da482993d500b5702077e143041\": container with ID starting with 1ed9efa58f6786317b49093316d8687561342da482993d500b5702077e143041 not found: ID does not exist"
Sep 10 23:55:15.830228 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.830195    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"]
Sep 10 23:55:15.833947 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.833922    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-13374d/test-model-13374d-kserve-798d9bcdbf-c5n29"]
Sep 10 23:55:15.873646 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.873621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:15.896790 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.896756    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4d6v\" (UniqueName: \"kubernetes.io/projected/f07f7c62-2552-458d-bf29-54b8fd99abd8-kube-api-access-r4d6v\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:15.896790 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.896791    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f07f7c62-2552-458d-bf29-54b8fd99abd8-dshm\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:15.897010 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.896806    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f07f7c62-2552-458d-bf29-54b8fd99abd8-tls-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:15.974883 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:15.974804    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:16.077138 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:16.077095    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5"]
Sep 10 23:55:16.078353 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:16.078313    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:16.079533 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:16.079513    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff0028b6-w4cd5"]
Sep 10 23:55:16.173925 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:16.173893    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:16.472213 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:16.472181    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:16.485294 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:16.485262    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d872730-6f79-4e83-9a57-a67660dd9bd3" path="/var/lib/kubelet/pods/0d872730-6f79-4e83-9a57-a67660dd9bd3/volumes"
Sep 10 23:55:16.485726 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:16.485706    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0840bbf-9fb8-4248-9771-d16de31d570f" path="/var/lib/kubelet/pods/c0840bbf-9fb8-4248-9771-d16de31d570f/volumes"
Sep 10 23:55:16.486133 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:16.486115    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f07f7c62-2552-458d-bf29-54b8fd99abd8" path="/var/lib/kubelet/pods/f07f7c62-2552-458d-bf29-54b8fd99abd8/volumes"
Sep 10 23:55:17.859825 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:17.859796    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:17.935129 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:17.935099    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:18.110944 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.110867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:18.437089 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.437010    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13374d-vccvc"]
Sep 10 23:55:18.437402 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.437389    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0840bbf-9fb8-4248-9771-d16de31d570f" containerName="revoke-keys"
Sep 10 23:55:18.437446 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.437404    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0840bbf-9fb8-4248-9771-d16de31d570f" containerName="revoke-keys"
Sep 10 23:55:18.437446 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.437413    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d872730-6f79-4e83-9a57-a67660dd9bd3" containerName="main"
Sep 10 23:55:18.437446 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.437419    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d872730-6f79-4e83-9a57-a67660dd9bd3" containerName="main"
Sep 10 23:55:18.437446 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.437432    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f07f7c62-2552-458d-bf29-54b8fd99abd8" containerName="main"
Sep 10 23:55:18.437446 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.437438    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f07f7c62-2552-458d-bf29-54b8fd99abd8" containerName="main"
Sep 10 23:55:18.437599 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.437493    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d872730-6f79-4e83-9a57-a67660dd9bd3" containerName="main"
Sep 10 23:55:18.437599 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.437501    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0840bbf-9fb8-4248-9771-d16de31d570f" containerName="revoke-keys"
Sep 10 23:55:18.437599 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.437507    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f07f7c62-2552-458d-bf29-54b8fd99abd8" containerName="main"
Sep 10 23:55:18.441853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.441836    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13374d-vccvc"
Sep 10 23:55:18.444339 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.444312    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:55:18.444458 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.444396    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22lrj\""
Sep 10 23:55:18.450155 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.450132    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13374d-vccvc"]
Sep 10 23:55:18.519581 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.519545    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d72c93b2-4467-4cde-80bb-9cefce792367-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-13374d-vccvc\" (UID: \"d72c93b2-4467-4cde-80bb-9cefce792367\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13374d-vccvc"
Sep 10 23:55:18.554359 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.554308    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:18.620870 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.620842    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d72c93b2-4467-4cde-80bb-9cefce792367-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-13374d-vccvc\" (UID: \"d72c93b2-4467-4cde-80bb-9cefce792367\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13374d-vccvc"
Sep 10 23:55:18.621500 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.621476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d72c93b2-4467-4cde-80bb-9cefce792367-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-13374d-vccvc\" (UID: \"d72c93b2-4467-4cde-80bb-9cefce792367\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13374d-vccvc"
Sep 10 23:55:18.752879 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:18.752841    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13374d-vccvc"
Sep 10 23:55:19.027977 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:19.027955    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13374d-vccvc"]
Sep 10 23:55:19.029545 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:55:19.029516    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72c93b2_4467_4cde_80bb_9cefce792367.slice/crio-0c7aef9954c23c45b4f0b18c03967cd15a5561078cf3811e47a5342aac4e22aa WatchSource:0}: Error finding container 0c7aef9954c23c45b4f0b18c03967cd15a5561078cf3811e47a5342aac4e22aa: Status 404 returned error can't find the container with id 0c7aef9954c23c45b4f0b18c03967cd15a5561078cf3811e47a5342aac4e22aa
Sep 10 23:55:19.834366 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:19.834331    2581 generic.go:356] "Generic (PLEG): container finished" podID="d72c93b2-4467-4cde-80bb-9cefce792367" containerID="953ca40cd9b4cf74f93d957fa2e9218be4ed89938bd4984593cd1c2c87b575e6" exitCode=0
Sep 10 23:55:19.834545 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:19.834423    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13374d-vccvc" event={"ID":"d72c93b2-4467-4cde-80bb-9cefce792367","Type":"ContainerDied","Data":"953ca40cd9b4cf74f93d957fa2e9218be4ed89938bd4984593cd1c2c87b575e6"}
Sep 10 23:55:19.834545 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:19.834486    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13374d-vccvc" event={"ID":"d72c93b2-4467-4cde-80bb-9cefce792367","Type":"ContainerStarted","Data":"0c7aef9954c23c45b4f0b18c03967cd15a5561078cf3811e47a5342aac4e22aa"}
Sep 10 23:55:20.981031 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:20.981009    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13374d-vccvc"
Sep 10 23:55:21.044544 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:21.044515    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d72c93b2-4467-4cde-80bb-9cefce792367-maas-api-service-ca\") pod \"d72c93b2-4467-4cde-80bb-9cefce792367\" (UID: \"d72c93b2-4467-4cde-80bb-9cefce792367\") "
Sep 10 23:55:21.044960 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:21.044935    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d72c93b2-4467-4cde-80bb-9cefce792367-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d72c93b2-4467-4cde-80bb-9cefce792367" (UID: "d72c93b2-4467-4cde-80bb-9cefce792367"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:55:21.145739 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:21.145639    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d72c93b2-4467-4cde-80bb-9cefce792367-maas-api-service-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:21.847116 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:21.847083    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13374d-vccvc" event={"ID":"d72c93b2-4467-4cde-80bb-9cefce792367","Type":"ContainerDied","Data":"0c7aef9954c23c45b4f0b18c03967cd15a5561078cf3811e47a5342aac4e22aa"}
Sep 10 23:55:21.847116 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:21.847112    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13374d-vccvc"
Sep 10 23:55:21.847324 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:21.847129    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c7aef9954c23c45b4f0b18c03967cd15a5561078cf3811e47a5342aac4e22aa"
Sep 10 23:55:22.270686 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:22.270643    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:22.370796 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:22.370764    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:22.517235 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:22.517201    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"]
Sep 10 23:55:22.517494 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:22.517469    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7" podUID="dbb4fd51-3253-4198-b4e5-be4f91281f13" containerName="istio-proxy" containerID="cri-o://c2ee4272a1186be02155d85f7357d60e65a43918cef3ef5ac09773d5906dc404" gracePeriod=30
Sep 10 23:55:22.533386 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:22.533292    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:22.900640 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:22.900555    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:23.000711 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:23.000657    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:23.117451 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:23.117423    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:25.622180 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:25.622146    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:55:27.776743 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.776719    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:55:27.886544 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.886457    2581 generic.go:356] "Generic (PLEG): container finished" podID="dbb4fd51-3253-4198-b4e5-be4f91281f13" containerID="c2ee4272a1186be02155d85f7357d60e65a43918cef3ef5ac09773d5906dc404" exitCode=0
Sep 10 23:55:27.886544 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.886508    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"
Sep 10 23:55:27.886544 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.886529    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7" event={"ID":"dbb4fd51-3253-4198-b4e5-be4f91281f13","Type":"ContainerDied","Data":"c2ee4272a1186be02155d85f7357d60e65a43918cef3ef5ac09773d5906dc404"}
Sep 10 23:55:27.886838 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.886578    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7" event={"ID":"dbb4fd51-3253-4198-b4e5-be4f91281f13","Type":"ContainerDied","Data":"e4c8647f9afe1042442d8de6ec6022667cabe0b804eb62b9da0f8f850748baaa"}
Sep 10 23:55:27.886838 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.886601    2581 scope.go:117] "RemoveContainer" containerID="c2ee4272a1186be02155d85f7357d60e65a43918cef3ef5ac09773d5906dc404"
Sep 10 23:55:27.896076 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.896059    2581 scope.go:117] "RemoveContainer" containerID="dba6741dde81fc469875ed68915375f335b2388c9939b51cdbaa0e1ea56ce5d3"
Sep 10 23:55:27.904429 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.904411    2581 scope.go:117] "RemoveContainer" containerID="c2ee4272a1186be02155d85f7357d60e65a43918cef3ef5ac09773d5906dc404"
Sep 10 23:55:27.904700 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:55:27.904664    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2ee4272a1186be02155d85f7357d60e65a43918cef3ef5ac09773d5906dc404\": container with ID starting with c2ee4272a1186be02155d85f7357d60e65a43918cef3ef5ac09773d5906dc404 not found: ID does not exist" containerID="c2ee4272a1186be02155d85f7357d60e65a43918cef3ef5ac09773d5906dc404"
Sep 10 23:55:27.904769 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.904708    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2ee4272a1186be02155d85f7357d60e65a43918cef3ef5ac09773d5906dc404"} err="failed to get container status \"c2ee4272a1186be02155d85f7357d60e65a43918cef3ef5ac09773d5906dc404\": rpc error: code = NotFound desc = could not find container \"c2ee4272a1186be02155d85f7357d60e65a43918cef3ef5ac09773d5906dc404\": container with ID starting with c2ee4272a1186be02155d85f7357d60e65a43918cef3ef5ac09773d5906dc404 not found: ID does not exist"
Sep 10 23:55:27.904769 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.904725    2581 scope.go:117] "RemoveContainer" containerID="dba6741dde81fc469875ed68915375f335b2388c9939b51cdbaa0e1ea56ce5d3"
Sep 10 23:55:27.905022 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:55:27.905001    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dba6741dde81fc469875ed68915375f335b2388c9939b51cdbaa0e1ea56ce5d3\": container with ID starting with dba6741dde81fc469875ed68915375f335b2388c9939b51cdbaa0e1ea56ce5d3 not found: ID does not exist" containerID="dba6741dde81fc469875ed68915375f335b2388c9939b51cdbaa0e1ea56ce5d3"
Sep 10 23:55:27.905076 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.905028    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba6741dde81fc469875ed68915375f335b2388c9939b51cdbaa0e1ea56ce5d3"} err="failed to get container status \"dba6741dde81fc469875ed68915375f335b2388c9939b51cdbaa0e1ea56ce5d3\": rpc error: code = NotFound desc = could not find container \"dba6741dde81fc469875ed68915375f335b2388c9939b51cdbaa0e1ea56ce5d3\": container with ID starting with dba6741dde81fc469875ed68915375f335b2388c9939b51cdbaa0e1ea56ce5d3 not found: ID does not exist"
Sep 10 23:55:27.909325 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.909307    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-credential-socket\") pod \"dbb4fd51-3253-4198-b4e5-be4f91281f13\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") "
Sep 10 23:55:27.909386 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.909336    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-podinfo\") pod \"dbb4fd51-3253-4198-b4e5-be4f91281f13\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") "
Sep 10 23:55:27.909386 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.909370    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbb4fd51-3253-4198-b4e5-be4f91281f13-istiod-ca-cert\") pod \"dbb4fd51-3253-4198-b4e5-be4f91281f13\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") "
Sep 10 23:55:27.909463 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.909400    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9hvz\" (UniqueName: \"kubernetes.io/projected/dbb4fd51-3253-4198-b4e5-be4f91281f13-kube-api-access-v9hvz\") pod \"dbb4fd51-3253-4198-b4e5-be4f91281f13\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") "
Sep 10 23:55:27.909463 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.909449    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-envoy\") pod \"dbb4fd51-3253-4198-b4e5-be4f91281f13\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") "
Sep 10 23:55:27.909543 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.909499    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-data\") pod \"dbb4fd51-3253-4198-b4e5-be4f91281f13\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") "
Sep 10 23:55:27.909599 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.909559    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-workload-socket\") pod \"dbb4fd51-3253-4198-b4e5-be4f91281f13\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") "
Sep 10 23:55:27.909599 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.909580    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dbb4fd51-3253-4198-b4e5-be4f91281f13" (UID: "dbb4fd51-3253-4198-b4e5-be4f91281f13"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:27.909733 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.909588    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-token\") pod \"dbb4fd51-3253-4198-b4e5-be4f91281f13\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") "
Sep 10 23:55:27.909733 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.909648    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-workload-certs\") pod \"dbb4fd51-3253-4198-b4e5-be4f91281f13\" (UID: \"dbb4fd51-3253-4198-b4e5-be4f91281f13\") "
Sep 10 23:55:27.909852 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.909813    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbb4fd51-3253-4198-b4e5-be4f91281f13-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dbb4fd51-3253-4198-b4e5-be4f91281f13" (UID: "dbb4fd51-3253-4198-b4e5-be4f91281f13"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:55:27.910018 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.909995    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-data" (OuterVolumeSpecName: "istio-data") pod "dbb4fd51-3253-4198-b4e5-be4f91281f13" (UID: "dbb4fd51-3253-4198-b4e5-be4f91281f13"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:27.910018 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.910010    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbb4fd51-3253-4198-b4e5-be4f91281f13-istiod-ca-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:27.910328 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.910027    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-credential-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:27.910328 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.910197    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dbb4fd51-3253-4198-b4e5-be4f91281f13" (UID: "dbb4fd51-3253-4198-b4e5-be4f91281f13"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:27.910328 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.910159    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dbb4fd51-3253-4198-b4e5-be4f91281f13" (UID: "dbb4fd51-3253-4198-b4e5-be4f91281f13"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:27.911562 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.911526    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dbb4fd51-3253-4198-b4e5-be4f91281f13" (UID: "dbb4fd51-3253-4198-b4e5-be4f91281f13"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:55:27.911690 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.911658    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dbb4fd51-3253-4198-b4e5-be4f91281f13" (UID: "dbb4fd51-3253-4198-b4e5-be4f91281f13"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:27.911794 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.911771    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbb4fd51-3253-4198-b4e5-be4f91281f13-kube-api-access-v9hvz" (OuterVolumeSpecName: "kube-api-access-v9hvz") pod "dbb4fd51-3253-4198-b4e5-be4f91281f13" (UID: "dbb4fd51-3253-4198-b4e5-be4f91281f13"). InnerVolumeSpecName "kube-api-access-v9hvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:55:27.911918 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:27.911904    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-token" (OuterVolumeSpecName: "istio-token") pod "dbb4fd51-3253-4198-b4e5-be4f91281f13" (UID: "dbb4fd51-3253-4198-b4e5-be4f91281f13"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:55:28.010454 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:28.010422    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-data\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:28.010454 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:28.010447    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-workload-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:28.010454 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:28.010456    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-token\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:28.010454 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:28.010464    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-workload-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:28.010750 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:28.010473    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-podinfo\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:28.010750 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:28.010482    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9hvz\" (UniqueName: \"kubernetes.io/projected/dbb4fd51-3253-4198-b4e5-be4f91281f13-kube-api-access-v9hvz\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:28.010750 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:28.010490    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbb4fd51-3253-4198-b4e5-be4f91281f13-istio-envoy\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:28.208690 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:28.208637    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"]
Sep 10 23:55:28.213917 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:28.213896    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7"]
Sep 10 23:55:28.484210 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:28.484173    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbb4fd51-3253-4198-b4e5-be4f91281f13" path="/var/lib/kubelet/pods/dbb4fd51-3253-4198-b4e5-be4f91281f13/volumes"
Sep 10 23:55:28.676102 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:28.676071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:28.777780 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:28.777692    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:28.873813 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:28.873779    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:29.025064 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:29.025025    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:29.098359 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:29.098272    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:29.168086 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:29.168056    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:29.227981 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:29.227948    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13374d-vccvc"]
Sep 10 23:55:29.230493 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:29.230467    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:29.231231 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:29.231213    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13374d-vccvc"]
Sep 10 23:55:29.297719 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:29.297686    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:29.602588 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:29.602555    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:30.485179 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:30.485144    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d72c93b2-4467-4cde-80bb-9cefce792367" path="/var/lib/kubelet/pods/d72c93b2-4467-4cde-80bb-9cefce792367/volumes"
Sep 10 23:55:31.328478 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:31.328440    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:55:34.845436 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:34.845407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:35.107406 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:35.107319    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:35.207316 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:35.207286    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:35.945139 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:35.945108    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:36.042335 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:36.042305    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:36.144656 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:36.144622    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:36.181171 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:36.181134    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"]
Sep 10 23:55:36.181456 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:36.181419    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm" podUID="21cb341a-dbb5-460c-ba47-1b56f6526917" containerName="istio-proxy" containerID="cri-o://91b7a20a22c29fec3e9ea111885b9f8c14d4b1ff8ce3dde061f3a746ea2ba0f0" gracePeriod=30
Sep 10 23:55:36.214025 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:36.213996    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:36.399745 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:36.399714    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:36.551905 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:36.551812    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:36.771459 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:36.771427    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:37.062486 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.062451    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"]
Sep 10 23:55:37.062879 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.062867    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb4fd51-3253-4198-b4e5-be4f91281f13" containerName="istio-proxy"
Sep 10 23:55:37.062924 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.062881    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb4fd51-3253-4198-b4e5-be4f91281f13" containerName="istio-proxy"
Sep 10 23:55:37.062924 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.062891    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d72c93b2-4467-4cde-80bb-9cefce792367" containerName="revoke-keys"
Sep 10 23:55:37.062924 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.062896    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d72c93b2-4467-4cde-80bb-9cefce792367" containerName="revoke-keys"
Sep 10 23:55:37.063019 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.062969    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d72c93b2-4467-4cde-80bb-9cefce792367" containerName="revoke-keys"
Sep 10 23:55:37.063019 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.062978    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbb4fd51-3253-4198-b4e5-be4f91281f13" containerName="istio-proxy"
Sep 10 23:55:37.066196 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.066169    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.069315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.069293    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-37692b-openshift-default-dockercfg-9fdzg\""
Sep 10 23:55:37.088462 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.088429    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"]
Sep 10 23:55:37.106866 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.106825    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:37.192633 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.192591    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-token\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.192834 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.192645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-credential-socket\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.192834 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.192716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-workload-certs\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.192834 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.192743    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t559f\" (UniqueName: \"kubernetes.io/projected/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-kube-api-access-t559f\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.192834 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.192776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-workload-socket\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.192834 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.192794    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-envoy\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.193044 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.192850    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-data\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.193044 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.192892    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istiod-ca-cert\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.193044 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.192914    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-podinfo\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.293618 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.293581    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-credential-socket\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.293812 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.293623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-workload-certs\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.293812 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.293654    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t559f\" (UniqueName: \"kubernetes.io/projected/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-kube-api-access-t559f\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.293812 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.293737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-workload-socket\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.293812 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.293772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-envoy\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.293812 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.293798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-data\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.294094 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.293825    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istiod-ca-cert\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.294094 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.293850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-podinfo\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.294094 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.293889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-token\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.294094 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.294052    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-workload-certs\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.294318 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.294092    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-data\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.294318 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.294212    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-workload-socket\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.294420 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.294351    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-credential-socket\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.294594 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.294573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istiod-ca-cert\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.296318 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.296289    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-envoy\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.296679 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.296646    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-podinfo\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.304893 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.304846    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-token\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.305033 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.305002    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t559f\" (UniqueName: \"kubernetes.io/projected/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-kube-api-access-t559f\") pod \"e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") " pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.378282 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.378217    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:37.598185 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.598149    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:37.663465 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.663438    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"]
Sep 10 23:55:37.665148 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:55:37.665120    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc4342e8_dd5d_48ef_96e2_f093cecdae6f.slice/crio-b144acb47df2acdfc5caa20167805641893be7703676ef238eea0c67dd66b656 WatchSource:0}: Error finding container b144acb47df2acdfc5caa20167805641893be7703676ef238eea0c67dd66b656: Status 404 returned error can't find the container with id b144acb47df2acdfc5caa20167805641893be7703676ef238eea0c67dd66b656
Sep 10 23:55:37.667288 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.667256    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:55:37.667417 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.667343    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:55:37.667417 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.667387    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:55:37.954388 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.954355    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b" event={"ID":"dc4342e8-dd5d-48ef-96e2-f093cecdae6f","Type":"ContainerStarted","Data":"be145786d2446181a3810c1fd7db658c8e4d9e2766d2d7afe814b2768b1b38b4"}
Sep 10 23:55:37.954563 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:37.954411    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b" event={"ID":"dc4342e8-dd5d-48ef-96e2-f093cecdae6f","Type":"ContainerStarted","Data":"b144acb47df2acdfc5caa20167805641893be7703676ef238eea0c67dd66b656"}
Sep 10 23:55:38.378768 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:38.378686    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:38.384044 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:38.384015    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:38.406508 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:38.406450    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b" podStartSLOduration=1.406429451 podStartE2EDuration="1.406429451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:55:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:55:38.004281084 +0000 UTC m=+1138.045150390" watchObservedRunningTime="2026-09-10 23:55:38.406429451 +0000 UTC m=+1138.447298772"
Sep 10 23:55:38.960434 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:38.960400    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:38.961400 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:38.961385    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:39.072302 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:39.072270    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:39.166476 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:39.166442    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:40.060121 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:40.060093    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:40.165589 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:40.165554    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:40.350525 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:40.350451    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:40.454320 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:40.454282    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:40.555609 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:40.555575    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:40.872431 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:40.872335    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:40.971540 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:40.971506    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:41.435313 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.435288    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:55:41.435924 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.435904    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:41.533963 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.533932    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-token\") pod \"21cb341a-dbb5-460c-ba47-1b56f6526917\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") "
Sep 10 23:55:41.533963 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.533966    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzb76\" (UniqueName: \"kubernetes.io/projected/21cb341a-dbb5-460c-ba47-1b56f6526917-kube-api-access-pzb76\") pod \"21cb341a-dbb5-460c-ba47-1b56f6526917\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") "
Sep 10 23:55:41.534196 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.534025    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-credential-socket\") pod \"21cb341a-dbb5-460c-ba47-1b56f6526917\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") "
Sep 10 23:55:41.534196 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.534050    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-workload-certs\") pod \"21cb341a-dbb5-460c-ba47-1b56f6526917\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") "
Sep 10 23:55:41.534196 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.534084    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-envoy\") pod \"21cb341a-dbb5-460c-ba47-1b56f6526917\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") "
Sep 10 23:55:41.534196 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.534116    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21cb341a-dbb5-460c-ba47-1b56f6526917-istiod-ca-cert\") pod \"21cb341a-dbb5-460c-ba47-1b56f6526917\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") "
Sep 10 23:55:41.534196 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.534146    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-workload-socket\") pod \"21cb341a-dbb5-460c-ba47-1b56f6526917\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") "
Sep 10 23:55:41.534196 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.534175    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-data\") pod \"21cb341a-dbb5-460c-ba47-1b56f6526917\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") "
Sep 10 23:55:41.534503 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.534396    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "21cb341a-dbb5-460c-ba47-1b56f6526917" (UID: "21cb341a-dbb5-460c-ba47-1b56f6526917"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:41.534503 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.534427    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "21cb341a-dbb5-460c-ba47-1b56f6526917" (UID: "21cb341a-dbb5-460c-ba47-1b56f6526917"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:41.534503 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.534433    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "21cb341a-dbb5-460c-ba47-1b56f6526917" (UID: "21cb341a-dbb5-460c-ba47-1b56f6526917"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:41.534503 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.534477    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-podinfo\") pod \"21cb341a-dbb5-460c-ba47-1b56f6526917\" (UID: \"21cb341a-dbb5-460c-ba47-1b56f6526917\") "
Sep 10 23:55:41.534719 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.534559    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21cb341a-dbb5-460c-ba47-1b56f6526917-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "21cb341a-dbb5-460c-ba47-1b56f6526917" (UID: "21cb341a-dbb5-460c-ba47-1b56f6526917"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:55:41.534719 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.534564    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-data" (OuterVolumeSpecName: "istio-data") pod "21cb341a-dbb5-460c-ba47-1b56f6526917" (UID: "21cb341a-dbb5-460c-ba47-1b56f6526917"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:41.535336 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.535313    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-credential-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:41.535429 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.535342    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-workload-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:41.535429 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.535356    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21cb341a-dbb5-460c-ba47-1b56f6526917-istiod-ca-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:41.535429 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.535368    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-workload-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:41.535429 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.535382    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-data\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:41.536508 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.536476    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "21cb341a-dbb5-460c-ba47-1b56f6526917" (UID: "21cb341a-dbb5-460c-ba47-1b56f6526917"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:41.536653 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.536631    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "21cb341a-dbb5-460c-ba47-1b56f6526917" (UID: "21cb341a-dbb5-460c-ba47-1b56f6526917"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:55:41.536847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.536821    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-token" (OuterVolumeSpecName: "istio-token") pod "21cb341a-dbb5-460c-ba47-1b56f6526917" (UID: "21cb341a-dbb5-460c-ba47-1b56f6526917"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:55:41.536847 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.536825    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21cb341a-dbb5-460c-ba47-1b56f6526917-kube-api-access-pzb76" (OuterVolumeSpecName: "kube-api-access-pzb76") pod "21cb341a-dbb5-460c-ba47-1b56f6526917" (UID: "21cb341a-dbb5-460c-ba47-1b56f6526917"). InnerVolumeSpecName "kube-api-access-pzb76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:55:41.574469 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.574432    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:41.636986 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.636954    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-envoy\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:41.636986 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.636982    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-podinfo\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:41.636986 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.636991    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21cb341a-dbb5-460c-ba47-1b56f6526917-istio-token\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:41.637234 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.637002    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzb76\" (UniqueName: \"kubernetes.io/projected/21cb341a-dbb5-460c-ba47-1b56f6526917-kube-api-access-pzb76\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:55:41.984172 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.984140    2581 generic.go:356] "Generic (PLEG): container finished" podID="21cb341a-dbb5-460c-ba47-1b56f6526917" containerID="91b7a20a22c29fec3e9ea111885b9f8c14d4b1ff8ce3dde061f3a746ea2ba0f0" exitCode=0
Sep 10 23:55:41.984353 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.984207    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"
Sep 10 23:55:41.984353 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.984278    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm" event={"ID":"21cb341a-dbb5-460c-ba47-1b56f6526917","Type":"ContainerDied","Data":"91b7a20a22c29fec3e9ea111885b9f8c14d4b1ff8ce3dde061f3a746ea2ba0f0"}
Sep 10 23:55:41.984353 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.984345    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm" event={"ID":"21cb341a-dbb5-460c-ba47-1b56f6526917","Type":"ContainerDied","Data":"86ac6fed00cd5ad1c350f99b548ac204c2c5c7e1350101fb0173aa644c951fc4"}
Sep 10 23:55:41.984560 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.984376    2581 scope.go:117] "RemoveContainer" containerID="91b7a20a22c29fec3e9ea111885b9f8c14d4b1ff8ce3dde061f3a746ea2ba0f0"
Sep 10 23:55:41.997467 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:41.996845    2581 scope.go:117] "RemoveContainer" containerID="f9e3b178bb5bff127f355fac3b862d0ae44797d8a46e57543023a5084a111386"
Sep 10 23:55:42.006000 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:42.005981    2581 scope.go:117] "RemoveContainer" containerID="91b7a20a22c29fec3e9ea111885b9f8c14d4b1ff8ce3dde061f3a746ea2ba0f0"
Sep 10 23:55:42.006288 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:55:42.006266    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91b7a20a22c29fec3e9ea111885b9f8c14d4b1ff8ce3dde061f3a746ea2ba0f0\": container with ID starting with 91b7a20a22c29fec3e9ea111885b9f8c14d4b1ff8ce3dde061f3a746ea2ba0f0 not found: ID does not exist" containerID="91b7a20a22c29fec3e9ea111885b9f8c14d4b1ff8ce3dde061f3a746ea2ba0f0"
Sep 10 23:55:42.006380 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:42.006295    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91b7a20a22c29fec3e9ea111885b9f8c14d4b1ff8ce3dde061f3a746ea2ba0f0"} err="failed to get container status \"91b7a20a22c29fec3e9ea111885b9f8c14d4b1ff8ce3dde061f3a746ea2ba0f0\": rpc error: code = NotFound desc = could not find container \"91b7a20a22c29fec3e9ea111885b9f8c14d4b1ff8ce3dde061f3a746ea2ba0f0\": container with ID starting with 91b7a20a22c29fec3e9ea111885b9f8c14d4b1ff8ce3dde061f3a746ea2ba0f0 not found: ID does not exist"
Sep 10 23:55:42.006380 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:42.006312    2581 scope.go:117] "RemoveContainer" containerID="f9e3b178bb5bff127f355fac3b862d0ae44797d8a46e57543023a5084a111386"
Sep 10 23:55:42.006625 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:55:42.006605    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9e3b178bb5bff127f355fac3b862d0ae44797d8a46e57543023a5084a111386\": container with ID starting with f9e3b178bb5bff127f355fac3b862d0ae44797d8a46e57543023a5084a111386 not found: ID does not exist" containerID="f9e3b178bb5bff127f355fac3b862d0ae44797d8a46e57543023a5084a111386"
Sep 10 23:55:42.006697 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:42.006632    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9e3b178bb5bff127f355fac3b862d0ae44797d8a46e57543023a5084a111386"} err="failed to get container status \"f9e3b178bb5bff127f355fac3b862d0ae44797d8a46e57543023a5084a111386\": rpc error: code = NotFound desc = could not find container \"f9e3b178bb5bff127f355fac3b862d0ae44797d8a46e57543023a5084a111386\": container with ID starting with f9e3b178bb5bff127f355fac3b862d0ae44797d8a46e57543023a5084a111386 not found: ID does not exist"
Sep 10 23:55:42.011092 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:42.011070    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"]
Sep 10 23:55:42.017573 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:42.017552    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm"]
Sep 10 23:55:42.101237 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:42.101208    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:42.199561 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:42.199525    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:42.484456 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:42.484426    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21cb341a-dbb5-460c-ba47-1b56f6526917" path="/var/lib/kubelet/pods/21cb341a-dbb5-460c-ba47-1b56f6526917/volumes"
Sep 10 23:55:42.542613 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:42.542583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:43.434401 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:43.434357    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:44.693350 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:44.693307    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:55:52.320432 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:52.320389    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:52.461965 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:52.461928    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:55:54.478164 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:54.477743    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": read tcp 10.133.0.2:36840->10.133.0.75:15021: read: connection reset by peer" start-of-body=
Sep 10 23:55:54.478164 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:54.477804    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b" podUID="dc4342e8-dd5d-48ef-96e2-f093cecdae6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": read tcp 10.133.0.2:36840->10.133.0.75:15021: read: connection reset by peer"
Sep 10 23:55:55.070361 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:55.070332    2581 generic.go:356] "Generic (PLEG): container finished" podID="dc4342e8-dd5d-48ef-96e2-f093cecdae6f" containerID="be145786d2446181a3810c1fd7db658c8e4d9e2766d2d7afe814b2768b1b38b4" exitCode=0
Sep 10 23:55:55.070536 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:55.070379    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b" event={"ID":"dc4342e8-dd5d-48ef-96e2-f093cecdae6f","Type":"ContainerDied","Data":"be145786d2446181a3810c1fd7db658c8e4d9e2766d2d7afe814b2768b1b38b4"}
Sep 10 23:55:55.070791 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:55.070778    2581 scope.go:117] "RemoveContainer" containerID="be145786d2446181a3810c1fd7db658c8e4d9e2766d2d7afe814b2768b1b38b4"
Sep 10 23:55:55.071866 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:55.071839    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:55:55.071952 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:55.071913    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:55:55.071952 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:55.071949    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:55:56.083008 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:56.082961    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b" event={"ID":"dc4342e8-dd5d-48ef-96e2-f093cecdae6f","Type":"ContainerStarted","Data":"69b14a7861795d6767ca2c83f69b338b7ebb341fb452bf9a2031a84c23e0f69d"}
Sep 10 23:55:56.379165 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:56.379061    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:55:56.379350 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:56.379203    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 23:55:56.379350 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:56.379247    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b" podUID="dc4342e8-dd5d-48ef-96e2-f093cecdae6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 23:55:57.379225 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:57.379188    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 23:55:57.380278 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:57.380244    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b" podUID="dc4342e8-dd5d-48ef-96e2-f093cecdae6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 23:55:58.378961 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:58.378914    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 23:55:58.379175 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:58.379003    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b" podUID="dc4342e8-dd5d-48ef-96e2-f093cecdae6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 23:55:59.379363 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:59.378897    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 23:55:59.379363 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:55:59.378966    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b" podUID="dc4342e8-dd5d-48ef-96e2-f093cecdae6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 23:56:00.379469 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:00.379434    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 23:56:00.380512 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:00.380086    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b" podUID="dc4342e8-dd5d-48ef-96e2-f093cecdae6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 23:56:01.306705 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:01.306655    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:01.382400 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:01.382363    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:56:01.382814 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:01.382698    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:56:01.383540 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:01.383518    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 10 23:56:02.989194 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:02.989164    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:04.054309 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.054270    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:04.487008 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.486971    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:04.725895 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.725864    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"]
Sep 10 23:56:04.726285 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.726268    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21cb341a-dbb5-460c-ba47-1b56f6526917" containerName="istio-proxy"
Sep 10 23:56:04.726285 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.726285    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="21cb341a-dbb5-460c-ba47-1b56f6526917" containerName="istio-proxy"
Sep 10 23:56:04.726423 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.726309    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb4fd51-3253-4198-b4e5-be4f91281f13" containerName="istio-proxy"
Sep 10 23:56:04.726423 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.726314    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb4fd51-3253-4198-b4e5-be4f91281f13" containerName="istio-proxy"
Sep 10 23:56:04.726423 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.726371    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="21cb341a-dbb5-460c-ba47-1b56f6526917" containerName="istio-proxy"
Sep 10 23:56:04.726423 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.726379    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbb4fd51-3253-4198-b4e5-be4f91281f13" containerName="istio-proxy"
Sep 10 23:56:04.729397 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.729378    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.732403 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.732387    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-dd5958-openshift-default-dockercfg-wkxmz\""
Sep 10 23:56:04.746179 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.746121    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"]
Sep 10 23:56:04.748282 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.748261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45njz\" (UniqueName: \"kubernetes.io/projected/1c1a686a-f3a6-4d53-87d7-0ebd54610009-kube-api-access-45njz\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.748400 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.748300    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-token\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.748400 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.748372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istiod-ca-cert\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.748501 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.748430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-envoy\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.748501 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.748470    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-workload-certs\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.748585 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.748532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-data\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.748642 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.748580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-workload-socket\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.748712 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.748684    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-podinfo\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.748773 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.748724    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-credential-socket\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.791337 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.791308    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:04.850106 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.850065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-workload-socket\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.850315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.850125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-podinfo\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.850315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.850154    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-credential-socket\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.850315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.850214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45njz\" (UniqueName: \"kubernetes.io/projected/1c1a686a-f3a6-4d53-87d7-0ebd54610009-kube-api-access-45njz\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.850315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.850246    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-token\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.850315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.850279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istiod-ca-cert\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.850589 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.850321    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-envoy\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.850589 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.850360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-workload-certs\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.850589 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.850405    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-data\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.850589 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.850491    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-workload-socket\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.850840 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.850628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-credential-socket\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.850840 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.850771    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-data\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.850840 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.850808    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-workload-certs\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.851238 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.851215    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istiod-ca-cert\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.852699 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.852656    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-envoy\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.852856 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.852841    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-podinfo\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.858873 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.858848    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-token\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.858984 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.858960    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45njz\" (UniqueName: \"kubernetes.io/projected/1c1a686a-f3a6-4d53-87d7-0ebd54610009-kube-api-access-45njz\") pod \"e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") " pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:04.959868 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:04.959827    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:05.040130 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.040047    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:05.188015 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.187983    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:05.291415 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.291333    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:05.320509 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.320484    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"]
Sep 10 23:56:05.321944 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:56:05.321916    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c1a686a_f3a6_4d53_87d7_0ebd54610009.slice/crio-02840ac93f67c7c370c919ba357ec34394a43c97af853b7288053db9871e8ef8 WatchSource:0}: Error finding container 02840ac93f67c7c370c919ba357ec34394a43c97af853b7288053db9871e8ef8: Status 404 returned error can't find the container with id 02840ac93f67c7c370c919ba357ec34394a43c97af853b7288053db9871e8ef8
Sep 10 23:56:05.324326 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.324291    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:56:05.324439 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.324370    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:56:05.324511 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.324435    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:56:05.391175 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.391150    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:05.588878 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.588802    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"]
Sep 10 23:56:05.589368 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.589352    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21cb341a-dbb5-460c-ba47-1b56f6526917" containerName="istio-proxy"
Sep 10 23:56:05.589417 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.589370    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="21cb341a-dbb5-460c-ba47-1b56f6526917" containerName="istio-proxy"
Sep 10 23:56:05.589480 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.589469    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="21cb341a-dbb5-460c-ba47-1b56f6526917" containerName="istio-proxy"
Sep 10 23:56:05.592938 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.592922    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.597194 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.597177    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-e96d4c-openshift-default-dockercfg-s4blr\""
Sep 10 23:56:05.622065 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.622037    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"]
Sep 10 23:56:05.658761 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.658727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/862f5684-5473-4af1-a90d-25205f186e45-istio-podinfo\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.658905 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.658770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/862f5684-5473-4af1-a90d-25205f186e45-istiod-ca-cert\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.658905 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.658790    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-workload-socket\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.658905 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.658887    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-istio-envoy\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.659038 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.658917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/862f5684-5473-4af1-a90d-25205f186e45-istio-token\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.659038 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.658940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-workload-certs\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.659038 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.658958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-credential-socket\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.659147 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.659060    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s9wz\" (UniqueName: \"kubernetes.io/projected/862f5684-5473-4af1-a90d-25205f186e45-kube-api-access-8s9wz\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.659147 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.659116    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-istio-data\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.668825 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.668792    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:05.759532 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.759497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/862f5684-5473-4af1-a90d-25205f186e45-istio-podinfo\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.759743 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.759541    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/862f5684-5473-4af1-a90d-25205f186e45-istiod-ca-cert\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.759743 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.759560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-workload-socket\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.759743 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.759614    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-istio-envoy\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.759743 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.759648    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/862f5684-5473-4af1-a90d-25205f186e45-istio-token\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.759743 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.759706    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-workload-certs\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.759743 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.759735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-credential-socket\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.760075 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.759793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s9wz\" (UniqueName: \"kubernetes.io/projected/862f5684-5473-4af1-a90d-25205f186e45-kube-api-access-8s9wz\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.760075 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.759836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-istio-data\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.760191 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.760077    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-workload-socket\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.760191 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.760172    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-istio-data\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.760314 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.760286    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-credential-socket\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.760457 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.760311    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/862f5684-5473-4af1-a90d-25205f186e45-istiod-ca-cert\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.760743 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.760721    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-workload-certs\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.762158 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.762136    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-istio-envoy\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.762375 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.762355    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/862f5684-5473-4af1-a90d-25205f186e45-istio-podinfo\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.775636 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.775616    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s9wz\" (UniqueName: \"kubernetes.io/projected/862f5684-5473-4af1-a90d-25205f186e45-kube-api-access-8s9wz\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.783065 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.783044    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/862f5684-5473-4af1-a90d-25205f186e45-istio-token\") pod \"e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") " pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.904176 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.904093    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:05.965866 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:05.965784    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:06.154054 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:06.154016    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg" event={"ID":"1c1a686a-f3a6-4d53-87d7-0ebd54610009","Type":"ContainerStarted","Data":"03dfd2b01214c2e4a23a0b673bd2320da94cd764379aeaeb27f60c5db468f354"}
Sep 10 23:56:06.154265 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:06.154076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg" event={"ID":"1c1a686a-f3a6-4d53-87d7-0ebd54610009","Type":"ContainerStarted","Data":"02840ac93f67c7c370c919ba357ec34394a43c97af853b7288053db9871e8ef8"}
Sep 10 23:56:06.178984 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:06.178932    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg" podStartSLOduration=2.178916356 podStartE2EDuration="2.178916356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:56:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:56:06.175379374 +0000 UTC m=+1166.216248680" watchObservedRunningTime="2026-09-10 23:56:06.178916356 +0000 UTC m=+1166.219785660"
Sep 10 23:56:06.184541 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:06.184520    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"]
Sep 10 23:56:06.185980 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:56:06.185956    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod862f5684_5473_4af1_a90d_25205f186e45.slice/crio-d434009687fcd14af48e2fa744ea77b069bc8c3640616f70c2a66d68905e641f WatchSource:0}: Error finding container d434009687fcd14af48e2fa744ea77b069bc8c3640616f70c2a66d68905e641f: Status 404 returned error can't find the container with id d434009687fcd14af48e2fa744ea77b069bc8c3640616f70c2a66d68905e641f
Sep 10 23:56:06.188582 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:06.188555    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:56:06.188866 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:06.188614    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:56:06.188866 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:06.188642    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:56:07.040652 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:07.040616    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:07.045367 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:07.045340    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:07.161682 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:07.161637    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78" event={"ID":"862f5684-5473-4af1-a90d-25205f186e45","Type":"ContainerStarted","Data":"2f31dfacc3093c86fe9d16a82318a38fead2365129d08a9d2ead540b239cde82"}
Sep 10 23:56:07.161865 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:07.161716    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78" event={"ID":"862f5684-5473-4af1-a90d-25205f186e45","Type":"ContainerStarted","Data":"d434009687fcd14af48e2fa744ea77b069bc8c3640616f70c2a66d68905e641f"}
Sep 10 23:56:07.161981 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:07.161963    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:07.162770 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:07.162753    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:07.186041 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:07.185998    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78" podStartSLOduration=2.185984675 podStartE2EDuration="2.185984675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:56:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:56:07.183064884 +0000 UTC m=+1167.223934189" watchObservedRunningTime="2026-09-10 23:56:07.185984675 +0000 UTC m=+1167.226853979"
Sep 10 23:56:07.904453 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:07.904423    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:07.909509 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:07.909488    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:08.029351 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:08.029307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:08.122146 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:08.122104    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:08.168536 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:08.168461    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:08.169427 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:08.169408    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:09.314482 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:09.314454    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:09.411786 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:09.411755    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:10.090612 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:10.090574    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:10.196305 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:10.196278    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:11.094027 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:11.093984    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:11.193167 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:11.193127    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:11.280501 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:11.280437    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:11.696605 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:11.696576    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:11.793391 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:11.793359    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:11.830584 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:11.830555    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"]
Sep 10 23:56:11.834175 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:11.834158    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"
Sep 10 23:56:11.837201 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:11.837182    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-e96d4c-dockercfg-mltkh\""
Sep 10 23:56:11.837285 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:11.837188    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-e96d4c\""
Sep 10 23:56:11.849338 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:11.849313    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"]
Sep 10 23:56:11.918242 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:11.918206    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83f2a448-d6eb-4c60-b152-ff675ed63d64-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl\" (UID: \"83f2a448-d6eb-4c60-b152-ff675ed63d64\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"
Sep 10 23:56:11.918423 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:11.918298    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwsnq\" (UniqueName: \"kubernetes.io/projected/83f2a448-d6eb-4c60-b152-ff675ed63d64-kube-api-access-rwsnq\") pod \"payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl\" (UID: \"83f2a448-d6eb-4c60-b152-ff675ed63d64\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"
Sep 10 23:56:12.019767 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:12.019735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83f2a448-d6eb-4c60-b152-ff675ed63d64-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl\" (UID: \"83f2a448-d6eb-4c60-b152-ff675ed63d64\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"
Sep 10 23:56:12.019954 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:12.019782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwsnq\" (UniqueName: \"kubernetes.io/projected/83f2a448-d6eb-4c60-b152-ff675ed63d64-kube-api-access-rwsnq\") pod \"payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl\" (UID: \"83f2a448-d6eb-4c60-b152-ff675ed63d64\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"
Sep 10 23:56:12.020498 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:12.020481    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83f2a448-d6eb-4c60-b152-ff675ed63d64-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl\" (UID: \"83f2a448-d6eb-4c60-b152-ff675ed63d64\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"
Sep 10 23:56:12.028312 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:12.028286    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwsnq\" (UniqueName: \"kubernetes.io/projected/83f2a448-d6eb-4c60-b152-ff675ed63d64-kube-api-access-rwsnq\") pod \"payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl\" (UID: \"83f2a448-d6eb-4c60-b152-ff675ed63d64\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"
Sep 10 23:56:12.127834 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:12.127806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:12.144810 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:12.144786    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"
Sep 10 23:56:12.426008 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:12.425979    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"]
Sep 10 23:56:12.426939 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:56:12.426914    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83f2a448_d6eb_4c60_b152_ff675ed63d64.slice/crio-b38391cfa5ccd7874ed7f4eabf311f76cb2f3c52d9ffe7ba218e7022021ef15e WatchSource:0}: Error finding container b38391cfa5ccd7874ed7f4eabf311f76cb2f3c52d9ffe7ba218e7022021ef15e: Status 404 returned error can't find the container with id b38391cfa5ccd7874ed7f4eabf311f76cb2f3c52d9ffe7ba218e7022021ef15e
Sep 10 23:56:12.429358 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:12.429341    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:56:12.820551 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:12.820524    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:13.206812 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:13.206773    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl" event={"ID":"83f2a448-d6eb-4c60-b152-ff675ed63d64","Type":"ContainerStarted","Data":"b38391cfa5ccd7874ed7f4eabf311f76cb2f3c52d9ffe7ba218e7022021ef15e"}
Sep 10 23:56:14.213995 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:14.213953    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl" event={"ID":"83f2a448-d6eb-4c60-b152-ff675ed63d64","Type":"ContainerStarted","Data":"7a2054b406db293ec150c94875e591286317fb69e6e63a5d4c62d23f171b1b19"}
Sep 10 23:56:14.214454 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:14.214092    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"
Sep 10 23:56:14.236720 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:14.236647    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl" podStartSLOduration=1.668097022 podStartE2EDuration="3.236624243s" totalImagesPullingTime="1.568527221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:56:14.233452509 +0000 UTC m=+1174.274321814" watchObservedRunningTime="2026-09-10 23:56:14.236624243 +0000 UTC m=+1174.277493550"
Sep 10 23:56:15.830412 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:15.830379    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:56:22.419154 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:22.419116    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:24.210913 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:24.210863    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 23:56:24.211301 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:24.210984    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78" podUID="862f5684-5473-4af1-a90d-25205f186e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 23:56:25.222844 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:25.222816    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"
Sep 10 23:56:26.302507 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:26.302482    2581 generic.go:356] "Generic (PLEG): container finished" podID="1c1a686a-f3a6-4d53-87d7-0ebd54610009" containerID="03dfd2b01214c2e4a23a0b673bd2320da94cd764379aeaeb27f60c5db468f354" exitCode=0
Sep 10 23:56:26.302954 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:26.302556    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg" event={"ID":"1c1a686a-f3a6-4d53-87d7-0ebd54610009","Type":"ContainerDied","Data":"03dfd2b01214c2e4a23a0b673bd2320da94cd764379aeaeb27f60c5db468f354"}
Sep 10 23:56:26.303085 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:26.303067    2581 scope.go:117] "RemoveContainer" containerID="03dfd2b01214c2e4a23a0b673bd2320da94cd764379aeaeb27f60c5db468f354"
Sep 10 23:56:26.304291 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:26.304258    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:56:26.304414 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:26.304334    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:56:26.304414 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:26.304366    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:56:26.304414 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:26.304367    2581 generic.go:356] "Generic (PLEG): container finished" podID="862f5684-5473-4af1-a90d-25205f186e45" containerID="2f31dfacc3093c86fe9d16a82318a38fead2365129d08a9d2ead540b239cde82" exitCode=0
Sep 10 23:56:26.304540 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:26.304415    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78" event={"ID":"862f5684-5473-4af1-a90d-25205f186e45","Type":"ContainerDied","Data":"2f31dfacc3093c86fe9d16a82318a38fead2365129d08a9d2ead540b239cde82"}
Sep 10 23:56:26.304795 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:26.304782    2581 scope.go:117] "RemoveContainer" containerID="2f31dfacc3093c86fe9d16a82318a38fead2365129d08a9d2ead540b239cde82"
Sep 10 23:56:26.305902 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:26.305873    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:56:26.305982 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:26.305934    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:56:26.305982 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:26.305966    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:56:27.318109 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:27.318069    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg" event={"ID":"1c1a686a-f3a6-4d53-87d7-0ebd54610009","Type":"ContainerStarted","Data":"b97a2fd04f5ecee5266c3c4cb167a1f7f3a7a45bb1bf96c1975113c20248f056"}
Sep 10 23:56:27.320297 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:27.320273    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78" event={"ID":"862f5684-5473-4af1-a90d-25205f186e45","Type":"ContainerStarted","Data":"6afaf849cab11982aa9f0b8a95b43f3dc17861a3f53bbcac43c4a9e1759873fa"}
Sep 10 23:56:27.904563 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:27.904524    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:27.905160 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:27.905113    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 10 23:56:27.905292 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:27.905193    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78" podUID="862f5684-5473-4af1-a90d-25205f186e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 10 23:56:28.040624 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:28.040595    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:28.040892 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:28.040774    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 23:56:28.041027 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:28.041008    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg" podUID="1c1a686a-f3a6-4d53-87d7-0ebd54610009" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 23:56:28.905183 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:28.904700    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 10 23:56:28.905183 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:28.904772    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78" podUID="862f5684-5473-4af1-a90d-25205f186e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 10 23:56:29.041206 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:29.041166    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 23:56:29.041383 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:29.041231    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg" podUID="1c1a686a-f3a6-4d53-87d7-0ebd54610009" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 23:56:29.904570 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:29.904524    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 10 23:56:29.904809 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:29.904597    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78" podUID="862f5684-5473-4af1-a90d-25205f186e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 10 23:56:30.040576 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:30.040536    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 23:56:30.041083 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:30.040602    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg" podUID="1c1a686a-f3a6-4d53-87d7-0ebd54610009" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 23:56:30.450964 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:30.450924    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:30.905543 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:30.905441    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 10 23:56:30.905853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:30.905821    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78" podUID="862f5684-5473-4af1-a90d-25205f186e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 10 23:56:31.041223 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:31.041183    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 23:56:31.041616 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:31.041239    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg" podUID="1c1a686a-f3a6-4d53-87d7-0ebd54610009" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 23:56:31.905606 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:31.905569    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 10 23:56:31.905939 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:31.905909    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78" podUID="862f5684-5473-4af1-a90d-25205f186e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 10 23:56:32.040402 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:32.040370    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 23:56:32.040654 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:32.040582    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg" podUID="1c1a686a-f3a6-4d53-87d7-0ebd54610009" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 23:56:32.223073 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:32.223037    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:32.961708 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:32.961656    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:32.961993 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:32.961963    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:32.962627 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:32.962610    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 10 23:56:32.978285 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:32.978262    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:33.044412 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:33.044383    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:33.044796 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:33.044777    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:33.045459 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:33.045440    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 10 23:56:33.691435 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:33.691399    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7838-ff9b04"]
Sep 10 23:56:33.694523 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:33.694504    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-ff9b04"
Sep 10 23:56:33.700696 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:33.697438    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k9g2h\""
Sep 10 23:56:33.703107 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:33.703078    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7838-ff9b04"]
Sep 10 23:56:33.857244 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:33.857210    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snkhx\" (UniqueName: \"kubernetes.io/projected/9d598a27-92aa-4e1f-b678-db316a77555c-kube-api-access-snkhx\") pod \"test-curl-7838-ff9b04\" (UID: \"9d598a27-92aa-4e1f-b678-db316a77555c\") " pod="opendatahub/test-curl-7838-ff9b04"
Sep 10 23:56:33.958392 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:33.958360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snkhx\" (UniqueName: \"kubernetes.io/projected/9d598a27-92aa-4e1f-b678-db316a77555c-kube-api-access-snkhx\") pod \"test-curl-7838-ff9b04\" (UID: \"9d598a27-92aa-4e1f-b678-db316a77555c\") " pod="opendatahub/test-curl-7838-ff9b04"
Sep 10 23:56:33.966229 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:33.966206    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snkhx\" (UniqueName: \"kubernetes.io/projected/9d598a27-92aa-4e1f-b678-db316a77555c-kube-api-access-snkhx\") pod \"test-curl-7838-ff9b04\" (UID: \"9d598a27-92aa-4e1f-b678-db316a77555c\") " pod="opendatahub/test-curl-7838-ff9b04"
Sep 10 23:56:33.987861 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:33.987829    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:34.010040 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:34.010019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-ff9b04"
Sep 10 23:56:34.284172 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:34.284149    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7838-ff9b04"]
Sep 10 23:56:34.287149 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:56:34.287117    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d598a27_92aa_4e1f_b678_db316a77555c.slice/crio-94167a7d169091594e7b1b26d8a9f9621522404554d04113060b33398b09a959 WatchSource:0}: Error finding container 94167a7d169091594e7b1b26d8a9f9621522404554d04113060b33398b09a959: Status 404 returned error can't find the container with id 94167a7d169091594e7b1b26d8a9f9621522404554d04113060b33398b09a959
Sep 10 23:56:34.363268 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:34.363243    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7838-ff9b04" event={"ID":"9d598a27-92aa-4e1f-b678-db316a77555c","Type":"ContainerStarted","Data":"16871f446ca0e7b3d804e72ac5943bade42a28f63c1f4da12c9d9548d3b29f60"}
Sep 10 23:56:34.363385 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:34.363285    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7838-ff9b04" event={"ID":"9d598a27-92aa-4e1f-b678-db316a77555c","Type":"ContainerStarted","Data":"94167a7d169091594e7b1b26d8a9f9621522404554d04113060b33398b09a959"}
Sep 10 23:56:34.376703 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:34.376637    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7838-ff9b04" podStartSLOduration=1.3766227899999999 podStartE2EDuration="1.37662279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:56:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:56:34.376236144 +0000 UTC m=+1194.417105450" watchObservedRunningTime="2026-09-10 23:56:34.37662279 +0000 UTC m=+1194.417492111"
Sep 10 23:56:34.966198 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:34.966166    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7838-ff9b04"]
Sep 10 23:56:34.971318 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:34.971275    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7838-ff9b04"]
Sep 10 23:56:35.082361 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:35.082272    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7838-d545ef"]
Sep 10 23:56:35.082776 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:35.082756    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d598a27-92aa-4e1f-b678-db316a77555c" containerName="test-curl-7838-ff9b04"
Sep 10 23:56:35.082876 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:35.082778    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d598a27-92aa-4e1f-b678-db316a77555c" containerName="test-curl-7838-ff9b04"
Sep 10 23:56:35.082930 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:35.082908    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d598a27-92aa-4e1f-b678-db316a77555c" containerName="test-curl-7838-ff9b04"
Sep 10 23:56:35.084896 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:35.084875    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-d545ef"
Sep 10 23:56:35.092278 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:35.092255    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7838-d545ef"]
Sep 10 23:56:35.170952 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:35.170921    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzhzx\" (UniqueName: \"kubernetes.io/projected/585ac3d9-31f3-499f-a342-a5e4b8034d8a-kube-api-access-gzhzx\") pod \"test-curl-7838-d545ef\" (UID: \"585ac3d9-31f3-499f-a342-a5e4b8034d8a\") " pod="opendatahub/test-curl-7838-d545ef"
Sep 10 23:56:35.271453 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:35.271425    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzhzx\" (UniqueName: \"kubernetes.io/projected/585ac3d9-31f3-499f-a342-a5e4b8034d8a-kube-api-access-gzhzx\") pod \"test-curl-7838-d545ef\" (UID: \"585ac3d9-31f3-499f-a342-a5e4b8034d8a\") " pod="opendatahub/test-curl-7838-d545ef"
Sep 10 23:56:35.279688 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:35.279653    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzhzx\" (UniqueName: \"kubernetes.io/projected/585ac3d9-31f3-499f-a342-a5e4b8034d8a-kube-api-access-gzhzx\") pod \"test-curl-7838-d545ef\" (UID: \"585ac3d9-31f3-499f-a342-a5e4b8034d8a\") " pod="opendatahub/test-curl-7838-d545ef"
Sep 10 23:56:35.369981 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:35.369916    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7838-ff9b04" container="test-curl-7838-ff9b04"
Sep 10 23:56:35.395591 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:35.395563    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-d545ef"
Sep 10 23:56:35.667524 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:35.665554    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7838-d545ef"]
Sep 10 23:56:35.669719 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:56:35.669656    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod585ac3d9_31f3_499f_a342_a5e4b8034d8a.slice/crio-289d41d5146f918bdfcdeae78bde976e0fa9c3aa002b654e51c26f4099c7e9b5 WatchSource:0}: Error finding container 289d41d5146f918bdfcdeae78bde976e0fa9c3aa002b654e51c26f4099c7e9b5: Status 404 returned error can't find the container with id 289d41d5146f918bdfcdeae78bde976e0fa9c3aa002b654e51c26f4099c7e9b5
Sep 10 23:56:36.378813 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:36.378775    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7838-d545ef" event={"ID":"585ac3d9-31f3-499f-a342-a5e4b8034d8a","Type":"ContainerStarted","Data":"c2871984380af8afa7ca7438ac1a58ba2b7284b600d7b781ac329c6e43ea9e5f"}
Sep 10 23:56:36.379341 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:36.378824    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7838-d545ef" event={"ID":"585ac3d9-31f3-499f-a342-a5e4b8034d8a","Type":"ContainerStarted","Data":"289d41d5146f918bdfcdeae78bde976e0fa9c3aa002b654e51c26f4099c7e9b5"}
Sep 10 23:56:36.379341 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:36.378853    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7838-ff9b04" podUID="9d598a27-92aa-4e1f-b678-db316a77555c" containerName="test-curl-7838-ff9b04" containerID="cri-o://16871f446ca0e7b3d804e72ac5943bade42a28f63c1f4da12c9d9548d3b29f60" gracePeriod=2
Sep 10 23:56:36.393612 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:36.393564    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7838-d545ef" podStartSLOduration=1.3935487819999999 podStartE2EDuration="1.393548782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:56:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:56:36.391992151 +0000 UTC m=+1196.432861456" watchObservedRunningTime="2026-09-10 23:56:36.393548782 +0000 UTC m=+1196.434418091"
Sep 10 23:56:36.393883 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:36.393854    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-ff9b04\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="9d598a27-92aa-4e1f-b678-db316a77555c" pod="opendatahub/test-curl-7838-ff9b04"
Sep 10 23:56:36.395543 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:36.395521    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-ff9b04\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="9d598a27-92aa-4e1f-b678-db316a77555c" pod="opendatahub/test-curl-7838-ff9b04"
Sep 10 23:56:36.989261 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:36.989230    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7838-d545ef"]
Sep 10 23:56:36.995528 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:36.995501    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7838-d545ef"]
Sep 10 23:56:37.112249 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:37.112173    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7838-1f23e5"]
Sep 10 23:56:37.112574 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:37.112561    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="585ac3d9-31f3-499f-a342-a5e4b8034d8a" containerName="test-curl-7838-d545ef"
Sep 10 23:56:37.112627 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:37.112576    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="585ac3d9-31f3-499f-a342-a5e4b8034d8a" containerName="test-curl-7838-d545ef"
Sep 10 23:56:37.112694 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:37.112637    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="585ac3d9-31f3-499f-a342-a5e4b8034d8a" containerName="test-curl-7838-d545ef"
Sep 10 23:56:37.116162 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:37.116147    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-1f23e5"
Sep 10 23:56:37.122843 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:37.122819    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7838-1f23e5"]
Sep 10 23:56:37.186626 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:37.186600    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpjjb\" (UniqueName: \"kubernetes.io/projected/b698f221-db1c-44d4-9054-88c83a8d5534-kube-api-access-qpjjb\") pod \"test-curl-7838-1f23e5\" (UID: \"b698f221-db1c-44d4-9054-88c83a8d5534\") " pod="opendatahub/test-curl-7838-1f23e5"
Sep 10 23:56:37.287168 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:37.287138    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpjjb\" (UniqueName: \"kubernetes.io/projected/b698f221-db1c-44d4-9054-88c83a8d5534-kube-api-access-qpjjb\") pod \"test-curl-7838-1f23e5\" (UID: \"b698f221-db1c-44d4-9054-88c83a8d5534\") " pod="opendatahub/test-curl-7838-1f23e5"
Sep 10 23:56:37.295413 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:37.295390    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpjjb\" (UniqueName: \"kubernetes.io/projected/b698f221-db1c-44d4-9054-88c83a8d5534-kube-api-access-qpjjb\") pod \"test-curl-7838-1f23e5\" (UID: \"b698f221-db1c-44d4-9054-88c83a8d5534\") " pod="opendatahub/test-curl-7838-1f23e5"
Sep 10 23:56:37.385280 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:37.385208    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7838-d545ef" container="test-curl-7838-d545ef"
Sep 10 23:56:37.426769 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:37.426745    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-1f23e5"
Sep 10 23:56:37.699324 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:37.699299    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7838-1f23e5"]
Sep 10 23:56:37.700281 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:56:37.700248    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb698f221_db1c_44d4_9054_88c83a8d5534.slice/crio-25546f1d6c49a790d7066db44eca653dd5af06cbeebf63414960517ae99d0ac8 WatchSource:0}: Error finding container 25546f1d6c49a790d7066db44eca653dd5af06cbeebf63414960517ae99d0ac8: Status 404 returned error can't find the container with id 25546f1d6c49a790d7066db44eca653dd5af06cbeebf63414960517ae99d0ac8
Sep 10 23:56:38.392943 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:38.392916    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7838-1f23e5" event={"ID":"b698f221-db1c-44d4-9054-88c83a8d5534","Type":"ContainerStarted","Data":"d43bf5dd8e98691de2562ad7fe68da1bedab5649d3ecef4444523b79e366f85d"}
Sep 10 23:56:38.393318 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:38.392957    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7838-1f23e5" event={"ID":"b698f221-db1c-44d4-9054-88c83a8d5534","Type":"ContainerStarted","Data":"25546f1d6c49a790d7066db44eca653dd5af06cbeebf63414960517ae99d0ac8"}
Sep 10 23:56:38.393318 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:38.393203    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7838-d545ef" podUID="585ac3d9-31f3-499f-a342-a5e4b8034d8a" containerName="test-curl-7838-d545ef" containerID="cri-o://c2871984380af8afa7ca7438ac1a58ba2b7284b600d7b781ac329c6e43ea9e5f" gracePeriod=2
Sep 10 23:56:38.406648 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:38.406607    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7838-1f23e5" podStartSLOduration=1.406590925 podStartE2EDuration="1.406590925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:56:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:56:38.405865281 +0000 UTC m=+1198.446734583" watchObservedRunningTime="2026-09-10 23:56:38.406590925 +0000 UTC m=+1198.447460229"
Sep 10 23:56:38.407748 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:38.407724    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-d545ef\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="585ac3d9-31f3-499f-a342-a5e4b8034d8a" pod="opendatahub/test-curl-7838-d545ef"
Sep 10 23:56:38.562530 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:38.562507    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-ff9b04"
Sep 10 23:56:38.597408 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:38.597383    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snkhx\" (UniqueName: \"kubernetes.io/projected/9d598a27-92aa-4e1f-b678-db316a77555c-kube-api-access-snkhx\") pod \"9d598a27-92aa-4e1f-b678-db316a77555c\" (UID: \"9d598a27-92aa-4e1f-b678-db316a77555c\") "
Sep 10 23:56:38.599691 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:38.599645    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d598a27-92aa-4e1f-b678-db316a77555c-kube-api-access-snkhx" (OuterVolumeSpecName: "kube-api-access-snkhx") pod "9d598a27-92aa-4e1f-b678-db316a77555c" (UID: "9d598a27-92aa-4e1f-b678-db316a77555c"). InnerVolumeSpecName "kube-api-access-snkhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:56:38.699066 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:38.699001    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snkhx\" (UniqueName: \"kubernetes.io/projected/9d598a27-92aa-4e1f-b678-db316a77555c-kube-api-access-snkhx\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:56:38.966150 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:38.966121    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7838-1f23e5"]
Sep 10 23:56:38.971168 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:38.971141    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7838-1f23e5"]
Sep 10 23:56:39.078529 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:39.078503    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7838-3c0ead"]
Sep 10 23:56:39.078914 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:39.078901    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b698f221-db1c-44d4-9054-88c83a8d5534" containerName="test-curl-7838-1f23e5"
Sep 10 23:56:39.078979 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:39.078915    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b698f221-db1c-44d4-9054-88c83a8d5534" containerName="test-curl-7838-1f23e5"
Sep 10 23:56:39.079013 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:39.078982    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b698f221-db1c-44d4-9054-88c83a8d5534" containerName="test-curl-7838-1f23e5"
Sep 10 23:56:39.082132 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:39.082118    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-3c0ead"
Sep 10 23:56:39.087719 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:39.087689    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7838-3c0ead"]
Sep 10 23:56:39.102864 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:39.102838    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf5bf\" (UniqueName: \"kubernetes.io/projected/bead3009-8347-4c2d-8190-6071e347df76-kube-api-access-xf5bf\") pod \"test-curl-7838-3c0ead\" (UID: \"bead3009-8347-4c2d-8190-6071e347df76\") " pod="opendatahub/test-curl-7838-3c0ead"
Sep 10 23:56:39.203412 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:39.203380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf5bf\" (UniqueName: \"kubernetes.io/projected/bead3009-8347-4c2d-8190-6071e347df76-kube-api-access-xf5bf\") pod \"test-curl-7838-3c0ead\" (UID: \"bead3009-8347-4c2d-8190-6071e347df76\") " pod="opendatahub/test-curl-7838-3c0ead"
Sep 10 23:56:39.216846 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:39.216790    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf5bf\" (UniqueName: \"kubernetes.io/projected/bead3009-8347-4c2d-8190-6071e347df76-kube-api-access-xf5bf\") pod \"test-curl-7838-3c0ead\" (UID: \"bead3009-8347-4c2d-8190-6071e347df76\") " pod="opendatahub/test-curl-7838-3c0ead"
Sep 10 23:56:39.392961 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:39.392932    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-3c0ead"
Sep 10 23:56:39.401166 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:39.401132    2581 generic.go:356] "Generic (PLEG): container finished" podID="9d598a27-92aa-4e1f-b678-db316a77555c" containerID="16871f446ca0e7b3d804e72ac5943bade42a28f63c1f4da12c9d9548d3b29f60" exitCode=137
Sep 10 23:56:39.401302 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:39.401180    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-ff9b04"
Sep 10 23:56:39.401302 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:39.401252    2581 scope.go:117] "RemoveContainer" containerID="16871f446ca0e7b3d804e72ac5943bade42a28f63c1f4da12c9d9548d3b29f60"
Sep 10 23:56:39.401588 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:39.401566    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7838-1f23e5" container="test-curl-7838-1f23e5"
Sep 10 23:56:39.422407 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:39.422381    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-ff9b04\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="9d598a27-92aa-4e1f-b678-db316a77555c" pod="opendatahub/test-curl-7838-ff9b04"
Sep 10 23:56:39.422906 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:39.422889    2581 scope.go:117] "RemoveContainer" containerID="16871f446ca0e7b3d804e72ac5943bade42a28f63c1f4da12c9d9548d3b29f60"
Sep 10 23:56:39.423224 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:39.423202    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16871f446ca0e7b3d804e72ac5943bade42a28f63c1f4da12c9d9548d3b29f60\": container with ID starting with 16871f446ca0e7b3d804e72ac5943bade42a28f63c1f4da12c9d9548d3b29f60 not found: ID does not exist" containerID="16871f446ca0e7b3d804e72ac5943bade42a28f63c1f4da12c9d9548d3b29f60"
Sep 10 23:56:39.423314 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:39.423232    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16871f446ca0e7b3d804e72ac5943bade42a28f63c1f4da12c9d9548d3b29f60"} err="failed to get container status \"16871f446ca0e7b3d804e72ac5943bade42a28f63c1f4da12c9d9548d3b29f60\": rpc error: code = NotFound desc = could not find container \"16871f446ca0e7b3d804e72ac5943bade42a28f63c1f4da12c9d9548d3b29f60\": container with ID starting with 16871f446ca0e7b3d804e72ac5943bade42a28f63c1f4da12c9d9548d3b29f60 not found: ID does not exist"
Sep 10 23:56:39.663216 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:39.663188    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7838-3c0ead"]
Sep 10 23:56:39.664378 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:56:39.664353    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbead3009_8347_4c2d_8190_6071e347df76.slice/crio-c4252c43ba608cea92403361e1b4fcd1d27ec1ae3b7d5bb0976595182db78494 WatchSource:0}: Error finding container c4252c43ba608cea92403361e1b4fcd1d27ec1ae3b7d5bb0976595182db78494: Status 404 returned error can't find the container with id c4252c43ba608cea92403361e1b4fcd1d27ec1ae3b7d5bb0976595182db78494
Sep 10 23:56:40.410993 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:40.410964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7838-3c0ead" event={"ID":"bead3009-8347-4c2d-8190-6071e347df76","Type":"ContainerStarted","Data":"e3dbc399a4fa86159f19957f85da0ee348fe8c68675b65edd8831122849c9c0b"}
Sep 10 23:56:40.411315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:40.411007    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7838-3c0ead" event={"ID":"bead3009-8347-4c2d-8190-6071e347df76","Type":"ContainerStarted","Data":"c4252c43ba608cea92403361e1b4fcd1d27ec1ae3b7d5bb0976595182db78494"}
Sep 10 23:56:40.411315 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:40.411127    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7838-1f23e5" podUID="b698f221-db1c-44d4-9054-88c83a8d5534" containerName="test-curl-7838-1f23e5" containerID="cri-o://d43bf5dd8e98691de2562ad7fe68da1bedab5649d3ecef4444523b79e366f85d" gracePeriod=2
Sep 10 23:56:40.425354 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:40.425327    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-ff9b04\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="9d598a27-92aa-4e1f-b678-db316a77555c" pod="opendatahub/test-curl-7838-ff9b04"
Sep 10 23:56:40.426129 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:40.426090    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7838-3c0ead" podStartSLOduration=1.426075482 podStartE2EDuration="1.426075482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:56:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:56:40.423478776 +0000 UTC m=+1200.464348081" watchObservedRunningTime="2026-09-10 23:56:40.426075482 +0000 UTC m=+1200.466944788"
Sep 10 23:56:40.427014 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:40.426990    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-1f23e5\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="b698f221-db1c-44d4-9054-88c83a8d5534" pod="opendatahub/test-curl-7838-1f23e5"
Sep 10 23:56:40.428597 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:40.428572    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-ff9b04\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="9d598a27-92aa-4e1f-b678-db316a77555c" pod="opendatahub/test-curl-7838-ff9b04"
Sep 10 23:56:40.482224 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:40.482185    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-ff9b04\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="9d598a27-92aa-4e1f-b678-db316a77555c" pod="opendatahub/test-curl-7838-ff9b04"
Sep 10 23:56:40.483913 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:40.483878    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-1f23e5\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="b698f221-db1c-44d4-9054-88c83a8d5534" pod="opendatahub/test-curl-7838-1f23e5"
Sep 10 23:56:40.484561 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:40.484542    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d598a27-92aa-4e1f-b678-db316a77555c" path="/var/lib/kubelet/pods/9d598a27-92aa-4e1f-b678-db316a77555c/volumes"
Sep 10 23:56:40.577487 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:40.577463    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-d545ef"
Sep 10 23:56:40.579511 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:40.579477    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-d545ef\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="585ac3d9-31f3-499f-a342-a5e4b8034d8a" pod="opendatahub/test-curl-7838-d545ef"
Sep 10 23:56:40.617408 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:40.617386    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzhzx\" (UniqueName: \"kubernetes.io/projected/585ac3d9-31f3-499f-a342-a5e4b8034d8a-kube-api-access-gzhzx\") pod \"585ac3d9-31f3-499f-a342-a5e4b8034d8a\" (UID: \"585ac3d9-31f3-499f-a342-a5e4b8034d8a\") "
Sep 10 23:56:40.619465 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:40.619439    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/585ac3d9-31f3-499f-a342-a5e4b8034d8a-kube-api-access-gzhzx" (OuterVolumeSpecName: "kube-api-access-gzhzx") pod "585ac3d9-31f3-499f-a342-a5e4b8034d8a" (UID: "585ac3d9-31f3-499f-a342-a5e4b8034d8a"). InnerVolumeSpecName "kube-api-access-gzhzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:56:40.718268 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:40.718236    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzhzx\" (UniqueName: \"kubernetes.io/projected/585ac3d9-31f3-499f-a342-a5e4b8034d8a-kube-api-access-gzhzx\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:56:40.981585 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:40.981556    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7838-3c0ead"]
Sep 10 23:56:40.985817 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:40.985794    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7838-3c0ead"]
Sep 10 23:56:41.220541 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.220509    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"]
Sep 10 23:56:41.220905 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.220892    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bead3009-8347-4c2d-8190-6071e347df76" containerName="test-curl-7838-3c0ead"
Sep 10 23:56:41.220959 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.220907    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bead3009-8347-4c2d-8190-6071e347df76" containerName="test-curl-7838-3c0ead"
Sep 10 23:56:41.220994 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.220978    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bead3009-8347-4c2d-8190-6071e347df76" containerName="test-curl-7838-3c0ead"
Sep 10 23:56:41.225167 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.225147    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.228647 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.228590    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-37692b\"/\"openshift-service-ca.crt\""
Sep 10 23:56:41.228647 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.228590    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-37692b\"/\"kube-root-ca.crt\""
Sep 10 23:56:41.229007 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.228706    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-37692b\"/\"default-dockercfg-r9qlc\""
Sep 10 23:56:41.229007 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.228590    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-37692b\"/\"auth-test-model-37692b-kserve-self-signed-certs\""
Sep 10 23:56:41.234638 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.234613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"]
Sep 10 23:56:41.244607 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:41.244574    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-d545ef\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="585ac3d9-31f3-499f-a342-a5e4b8034d8a" pod="opendatahub/test-curl-7838-d545ef"
Sep 10 23:56:41.312438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.312404    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:41.324453 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.324430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqlbn\" (UniqueName: \"kubernetes.io/projected/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-kube-api-access-mqlbn\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.324583 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.324461    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-home\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.324583 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.324483    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-tls-certs\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.324583 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.324569    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-tmp-dir\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.324733 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.324621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-dshm\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.324733 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.324688    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-model-cache\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.418493 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.418461    2581 generic.go:356] "Generic (PLEG): container finished" podID="585ac3d9-31f3-499f-a342-a5e4b8034d8a" containerID="c2871984380af8afa7ca7438ac1a58ba2b7284b600d7b781ac329c6e43ea9e5f" exitCode=137
Sep 10 23:56:41.418925 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.418501    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-d545ef"
Sep 10 23:56:41.418925 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.418561    2581 scope.go:117] "RemoveContainer" containerID="c2871984380af8afa7ca7438ac1a58ba2b7284b600d7b781ac329c6e43ea9e5f"
Sep 10 23:56:41.418925 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:41.418783    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7838-3c0ead" container="test-curl-7838-3c0ead"
Sep 10 23:56:41.420923 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:41.420898    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-d545ef\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="585ac3d9-31f3-499f-a342-a5e4b8034d8a" pod="opendatahub/test-curl-7838-d545ef"
Sep 10 23:56:41.425700 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.425645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-tmp-dir\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.425806 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.425700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-dshm\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.425806 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.425735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-model-cache\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.425806 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.425799    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqlbn\" (UniqueName: \"kubernetes.io/projected/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-kube-api-access-mqlbn\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.426082 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.425834    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-home\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.426082 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.425856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-tls-certs\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.426203 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.426119    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-tmp-dir\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.426203 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.426133    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-model-cache\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.426405 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.426380    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-home\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.428942 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.428833    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-dshm\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.429018 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.429001    2581 scope.go:117] "RemoveContainer" containerID="c2871984380af8afa7ca7438ac1a58ba2b7284b600d7b781ac329c6e43ea9e5f"
Sep 10 23:56:41.429142 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.429122    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-tls-certs\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.429321 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:41.429295    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2871984380af8afa7ca7438ac1a58ba2b7284b600d7b781ac329c6e43ea9e5f\": container with ID starting with c2871984380af8afa7ca7438ac1a58ba2b7284b600d7b781ac329c6e43ea9e5f not found: ID does not exist" containerID="c2871984380af8afa7ca7438ac1a58ba2b7284b600d7b781ac329c6e43ea9e5f"
Sep 10 23:56:41.429445 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.429328    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2871984380af8afa7ca7438ac1a58ba2b7284b600d7b781ac329c6e43ea9e5f"} err="failed to get container status \"c2871984380af8afa7ca7438ac1a58ba2b7284b600d7b781ac329c6e43ea9e5f\": rpc error: code = NotFound desc = could not find container \"c2871984380af8afa7ca7438ac1a58ba2b7284b600d7b781ac329c6e43ea9e5f\": container with ID starting with c2871984380af8afa7ca7438ac1a58ba2b7284b600d7b781ac329c6e43ea9e5f not found: ID does not exist"
Sep 10 23:56:41.429445 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:41.429404    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-d545ef\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="585ac3d9-31f3-499f-a342-a5e4b8034d8a" pod="opendatahub/test-curl-7838-d545ef"
Sep 10 23:56:41.433853 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.433835    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqlbn\" (UniqueName: \"kubernetes.io/projected/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-kube-api-access-mqlbn\") pod \"auth-test-model-37692b-kserve-746b9bc6bc-bljmk\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") " pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.537048 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.536976    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:41.567270 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.567227    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:41.821947 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.821925    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"]
Sep 10 23:56:41.824005 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:56:41.823978    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b4411ac_c3d7_489f_b58a_8c6a27e710e9.slice/crio-de131eb7f02158485c4ad0fb6c36bac4b69b56eb484612685e6b126c7075e2db WatchSource:0}: Error finding container de131eb7f02158485c4ad0fb6c36bac4b69b56eb484612685e6b126c7075e2db: Status 404 returned error can't find the container with id de131eb7f02158485c4ad0fb6c36bac4b69b56eb484612685e6b126c7075e2db
Sep 10 23:56:41.853133 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.853099    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"]
Sep 10 23:56:41.863316 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.860134    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:41.863592 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:41.863541    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-d545ef\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="585ac3d9-31f3-499f-a342-a5e4b8034d8a" pod="opendatahub/test-curl-7838-d545ef"
Sep 10 23:56:41.863912 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.863885    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6c869d5a-openshift-default-dockercfg-7xzng\""
Sep 10 23:56:41.869472 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.869437    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"]
Sep 10 23:56:41.877974 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.877775    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:41.930999 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.930972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-envoy\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:41.931126 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.931014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-credential-socket\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:41.931126 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.931077    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-data\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:41.931260 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.931170    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-workload-socket\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:41.931260 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.931210    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xv8s\" (UniqueName: \"kubernetes.io/projected/bb3c0127-acb0-4328-a213-cbd588a7c77b-kube-api-access-4xv8s\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:41.931374 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.931259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-token\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:41.931374 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.931298    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-podinfo\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:41.931374 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.931333    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb3c0127-acb0-4328-a213-cbd588a7c77b-istiod-ca-cert\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:41.931374 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:41.931362    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-workload-certs\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.032299 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.032265    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb3c0127-acb0-4328-a213-cbd588a7c77b-istiod-ca-cert\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.032299 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.032301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-workload-certs\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.032536 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.032326    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-envoy\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.032536 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.032371    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-credential-socket\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.032536 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.032419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-data\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.032536 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.032491    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-workload-socket\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.032536 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.032520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xv8s\" (UniqueName: \"kubernetes.io/projected/bb3c0127-acb0-4328-a213-cbd588a7c77b-kube-api-access-4xv8s\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.032800 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.032548    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-token\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.032800 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.032589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-podinfo\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.032800 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.032784    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-workload-certs\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.032960 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.032851    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-credential-socket\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.033063 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.033040    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-data\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.033133 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.033094    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb3c0127-acb0-4328-a213-cbd588a7c77b-istiod-ca-cert\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.033240 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.033218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-workload-socket\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.035318 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.035295    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-envoy\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.035459 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.035443    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-podinfo\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.041075 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.040747    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-token\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.041244 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.041211    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xv8s\" (UniqueName: \"kubernetes.io/projected/bb3c0127-acb0-4328-a213-cbd588a7c77b-kube-api-access-4xv8s\") pod \"e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") " pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.183401 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.183310    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:42.318909 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.318861    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:42.428234 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.428205    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk" event={"ID":"1b4411ac-c3d7-489f-b58a-8c6a27e710e9","Type":"ContainerStarted","Data":"f9c292f8f9e3fe164aa7f30e46e22d0f20586cc645659323cc0b1b521f0973ac"}
Sep 10 23:56:42.428579 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.428244    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk" event={"ID":"1b4411ac-c3d7-489f-b58a-8c6a27e710e9","Type":"ContainerStarted","Data":"de131eb7f02158485c4ad0fb6c36bac4b69b56eb484612685e6b126c7075e2db"}
Sep 10 23:56:42.428579 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.428285    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7838-3c0ead" podUID="bead3009-8347-4c2d-8190-6071e347df76" containerName="test-curl-7838-3c0ead" containerID="cri-o://e3dbc399a4fa86159f19957f85da0ee348fe8c68675b65edd8831122849c9c0b" gracePeriod=2
Sep 10 23:56:42.447468 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:42.447397    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-d545ef\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="585ac3d9-31f3-499f-a342-a5e4b8034d8a" pod="opendatahub/test-curl-7838-d545ef"
Sep 10 23:56:42.447762 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.447729    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk" podStartSLOduration=1.44771501 podStartE2EDuration="1.44771501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:56:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:56:42.445218761 +0000 UTC m=+1202.486088064" watchObservedRunningTime="2026-09-10 23:56:42.44771501 +0000 UTC m=+1202.488584316"
Sep 10 23:56:42.449561 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:42.449537    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-3c0ead\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="bead3009-8347-4c2d-8190-6071e347df76" pod="opendatahub/test-curl-7838-3c0ead"
Sep 10 23:56:42.451473 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:42.451446    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-d545ef\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="585ac3d9-31f3-499f-a342-a5e4b8034d8a" pod="opendatahub/test-curl-7838-d545ef"
Sep 10 23:56:42.453433 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:42.453406    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-3c0ead\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="bead3009-8347-4c2d-8190-6071e347df76" pod="opendatahub/test-curl-7838-3c0ead"
Sep 10 23:56:42.467754 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.467642    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"]
Sep 10 23:56:42.468354 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:56:42.468333    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb3c0127_acb0_4328_a213_cbd588a7c77b.slice/crio-08ab163bd17d766706339fbcb4653daa3a31a7f5de061a2357f7d5182775ad6a WatchSource:0}: Error finding container 08ab163bd17d766706339fbcb4653daa3a31a7f5de061a2357f7d5182775ad6a: Status 404 returned error can't find the container with id 08ab163bd17d766706339fbcb4653daa3a31a7f5de061a2357f7d5182775ad6a
Sep 10 23:56:42.471554 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.471520    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:56:42.471625 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.471597    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:56:42.471707 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.471682    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:56:42.486886 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.486864    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="585ac3d9-31f3-499f-a342-a5e4b8034d8a" path="/var/lib/kubelet/pods/585ac3d9-31f3-499f-a342-a5e4b8034d8a/volumes"
Sep 10 23:56:42.611074 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.611036    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-1f23e5"
Sep 10 23:56:42.637963 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.637939    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpjjb\" (UniqueName: \"kubernetes.io/projected/b698f221-db1c-44d4-9054-88c83a8d5534-kube-api-access-qpjjb\") pod \"b698f221-db1c-44d4-9054-88c83a8d5534\" (UID: \"b698f221-db1c-44d4-9054-88c83a8d5534\") "
Sep 10 23:56:42.640170 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.640135    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b698f221-db1c-44d4-9054-88c83a8d5534-kube-api-access-qpjjb" (OuterVolumeSpecName: "kube-api-access-qpjjb") pod "b698f221-db1c-44d4-9054-88c83a8d5534" (UID: "b698f221-db1c-44d4-9054-88c83a8d5534"). InnerVolumeSpecName "kube-api-access-qpjjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:56:42.739562 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:42.739526    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpjjb\" (UniqueName: \"kubernetes.io/projected/b698f221-db1c-44d4-9054-88c83a8d5534-kube-api-access-qpjjb\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:56:43.436337 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:43.436306    2581 generic.go:356] "Generic (PLEG): container finished" podID="b698f221-db1c-44d4-9054-88c83a8d5534" containerID="d43bf5dd8e98691de2562ad7fe68da1bedab5649d3ecef4444523b79e366f85d" exitCode=137
Sep 10 23:56:43.436745 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:43.436348    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-1f23e5"
Sep 10 23:56:43.436745 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:43.436380    2581 scope.go:117] "RemoveContainer" containerID="d43bf5dd8e98691de2562ad7fe68da1bedab5649d3ecef4444523b79e366f85d"
Sep 10 23:56:43.438382 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:43.438357    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2" event={"ID":"bb3c0127-acb0-4328-a213-cbd588a7c77b","Type":"ContainerStarted","Data":"029570b67206878974257e1e6e08873e5d178b337b46aa218e6b75c726f8474d"}
Sep 10 23:56:43.438498 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:43.438411    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2" event={"ID":"bb3c0127-acb0-4328-a213-cbd588a7c77b","Type":"ContainerStarted","Data":"08ab163bd17d766706339fbcb4653daa3a31a7f5de061a2357f7d5182775ad6a"}
Sep 10 23:56:43.446658 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:43.446637    2581 scope.go:117] "RemoveContainer" containerID="d43bf5dd8e98691de2562ad7fe68da1bedab5649d3ecef4444523b79e366f85d"
Sep 10 23:56:43.447034 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:43.447014    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d43bf5dd8e98691de2562ad7fe68da1bedab5649d3ecef4444523b79e366f85d\": container with ID starting with d43bf5dd8e98691de2562ad7fe68da1bedab5649d3ecef4444523b79e366f85d not found: ID does not exist" containerID="d43bf5dd8e98691de2562ad7fe68da1bedab5649d3ecef4444523b79e366f85d"
Sep 10 23:56:43.447096 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:43.447043    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d43bf5dd8e98691de2562ad7fe68da1bedab5649d3ecef4444523b79e366f85d"} err="failed to get container status \"d43bf5dd8e98691de2562ad7fe68da1bedab5649d3ecef4444523b79e366f85d\": rpc error: code = NotFound desc = could not find container \"d43bf5dd8e98691de2562ad7fe68da1bedab5649d3ecef4444523b79e366f85d\": container with ID starting with d43bf5dd8e98691de2562ad7fe68da1bedab5649d3ecef4444523b79e366f85d not found: ID does not exist"
Sep 10 23:56:43.458945 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:43.458903    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2" podStartSLOduration=2.4588914060000002 podStartE2EDuration="2.458891406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:56:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:56:43.457825306 +0000 UTC m=+1203.498694611" watchObservedRunningTime="2026-09-10 23:56:43.458891406 +0000 UTC m=+1203.499760710"
Sep 10 23:56:43.460064 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:43.460041    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-1f23e5\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="b698f221-db1c-44d4-9054-88c83a8d5534" pod="opendatahub/test-curl-7838-1f23e5"
Sep 10 23:56:44.184414 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:44.184378    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:44.190644 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:44.190616    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:44.192630 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:44.192595    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-1f23e5\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="b698f221-db1c-44d4-9054-88c83a8d5534" pod="opendatahub/test-curl-7838-1f23e5"
Sep 10 23:56:44.446337 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:44.446313    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:44.447310 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:44.447291    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:56:44.449593 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:44.449570    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-1f23e5\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="b698f221-db1c-44d4-9054-88c83a8d5534" pod="opendatahub/test-curl-7838-1f23e5"
Sep 10 23:56:44.485356 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:44.485329    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b698f221-db1c-44d4-9054-88c83a8d5534" path="/var/lib/kubelet/pods/b698f221-db1c-44d4-9054-88c83a8d5534/volumes"
Sep 10 23:56:44.630755 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:44.630726    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-3c0ead"
Sep 10 23:56:44.657010 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:44.656988    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf5bf\" (UniqueName: \"kubernetes.io/projected/bead3009-8347-4c2d-8190-6071e347df76-kube-api-access-xf5bf\") pod \"bead3009-8347-4c2d-8190-6071e347df76\" (UID: \"bead3009-8347-4c2d-8190-6071e347df76\") "
Sep 10 23:56:44.659041 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:44.659015    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bead3009-8347-4c2d-8190-6071e347df76-kube-api-access-xf5bf" (OuterVolumeSpecName: "kube-api-access-xf5bf") pod "bead3009-8347-4c2d-8190-6071e347df76" (UID: "bead3009-8347-4c2d-8190-6071e347df76"). InnerVolumeSpecName "kube-api-access-xf5bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:56:44.757812 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:44.757784    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf5bf\" (UniqueName: \"kubernetes.io/projected/bead3009-8347-4c2d-8190-6071e347df76-kube-api-access-xf5bf\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:56:45.319780 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:45.319744    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:45.420336 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:45.420304    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:45.453157 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:45.453118    2581 generic.go:356] "Generic (PLEG): container finished" podID="bead3009-8347-4c2d-8190-6071e347df76" containerID="e3dbc399a4fa86159f19957f85da0ee348fe8c68675b65edd8831122849c9c0b" exitCode=137
Sep 10 23:56:45.453539 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:45.453167    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-3c0ead"
Sep 10 23:56:45.453539 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:45.453227    2581 scope.go:117] "RemoveContainer" containerID="e3dbc399a4fa86159f19957f85da0ee348fe8c68675b65edd8831122849c9c0b"
Sep 10 23:56:45.463062 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:45.463040    2581 scope.go:117] "RemoveContainer" containerID="e3dbc399a4fa86159f19957f85da0ee348fe8c68675b65edd8831122849c9c0b"
Sep 10 23:56:45.463237 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:45.463204    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-3c0ead\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="bead3009-8347-4c2d-8190-6071e347df76" pod="opendatahub/test-curl-7838-3c0ead"
Sep 10 23:56:45.463343 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:56:45.463319    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3dbc399a4fa86159f19957f85da0ee348fe8c68675b65edd8831122849c9c0b\": container with ID starting with e3dbc399a4fa86159f19957f85da0ee348fe8c68675b65edd8831122849c9c0b not found: ID does not exist" containerID="e3dbc399a4fa86159f19957f85da0ee348fe8c68675b65edd8831122849c9c0b"
Sep 10 23:56:45.463384 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:45.463345    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3dbc399a4fa86159f19957f85da0ee348fe8c68675b65edd8831122849c9c0b"} err="failed to get container status \"e3dbc399a4fa86159f19957f85da0ee348fe8c68675b65edd8831122849c9c0b\": rpc error: code = NotFound desc = could not find container \"e3dbc399a4fa86159f19957f85da0ee348fe8c68675b65edd8831122849c9c0b\": container with ID starting with e3dbc399a4fa86159f19957f85da0ee348fe8c68675b65edd8831122849c9c0b not found: ID does not exist"
Sep 10 23:56:46.483444 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:46.483409    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bead3009-8347-4c2d-8190-6071e347df76" path="/var/lib/kubelet/pods/bead3009-8347-4c2d-8190-6071e347df76/volumes"
Sep 10 23:56:46.629689 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:46.629641    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:46.730303 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:46.730273    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:46.737595 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:46.737531    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:56:47.051022 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.050933    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:47.331311 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.331208    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:47.538434 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.538399    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:56:47.544158 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.544130    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"]
Sep 10 23:56:47.549005 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.548986    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"
Sep 10 23:56:47.552332 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.552311    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-6c869d5a\""
Sep 10 23:56:47.552438 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.552355    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-6c869d5a-dockercfg-w6fth\""
Sep 10 23:56:47.570824 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.570797    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"]
Sep 10 23:56:47.582300 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.582234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gd8b\" (UniqueName: \"kubernetes.io/projected/3fdfe283-eaa3-4347-a142-bfbd5d0fb506-kube-api-access-6gd8b\") pod \"payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p\" (UID: \"3fdfe283-eaa3-4347-a142-bfbd5d0fb506\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"
Sep 10 23:56:47.582300 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.582285    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fdfe283-eaa3-4347-a142-bfbd5d0fb506-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p\" (UID: \"3fdfe283-eaa3-4347-a142-bfbd5d0fb506\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"
Sep 10 23:56:47.633593 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.633557    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"]
Sep 10 23:56:47.637785 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.637756    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"
Sep 10 23:56:47.655598 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.654790    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"]
Sep 10 23:56:47.683121 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.683081    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f044720d-837e-4038-be0c-0b9822b44fa3-plugins-config-volume\") pod \"payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw\" (UID: \"f044720d-837e-4038-be0c-0b9822b44fa3\") " pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"
Sep 10 23:56:47.683294 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.683181    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84btn\" (UniqueName: \"kubernetes.io/projected/f044720d-837e-4038-be0c-0b9822b44fa3-kube-api-access-84btn\") pod \"payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw\" (UID: \"f044720d-837e-4038-be0c-0b9822b44fa3\") " pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"
Sep 10 23:56:47.683294 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.683278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gd8b\" (UniqueName: \"kubernetes.io/projected/3fdfe283-eaa3-4347-a142-bfbd5d0fb506-kube-api-access-6gd8b\") pod \"payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p\" (UID: \"3fdfe283-eaa3-4347-a142-bfbd5d0fb506\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"
Sep 10 23:56:47.683442 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.683329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fdfe283-eaa3-4347-a142-bfbd5d0fb506-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p\" (UID: \"3fdfe283-eaa3-4347-a142-bfbd5d0fb506\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"
Sep 10 23:56:47.684319 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.684292    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fdfe283-eaa3-4347-a142-bfbd5d0fb506-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p\" (UID: \"3fdfe283-eaa3-4347-a142-bfbd5d0fb506\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"
Sep 10 23:56:47.705447 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.705416    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gd8b\" (UniqueName: \"kubernetes.io/projected/3fdfe283-eaa3-4347-a142-bfbd5d0fb506-kube-api-access-6gd8b\") pod \"payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p\" (UID: \"3fdfe283-eaa3-4347-a142-bfbd5d0fb506\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"
Sep 10 23:56:47.784794 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.784754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f044720d-837e-4038-be0c-0b9822b44fa3-plugins-config-volume\") pod \"payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw\" (UID: \"f044720d-837e-4038-be0c-0b9822b44fa3\") " pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"
Sep 10 23:56:47.784979 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.784861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84btn\" (UniqueName: \"kubernetes.io/projected/f044720d-837e-4038-be0c-0b9822b44fa3-kube-api-access-84btn\") pod \"payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw\" (UID: \"f044720d-837e-4038-be0c-0b9822b44fa3\") " pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"
Sep 10 23:56:47.785759 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.785735    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f044720d-837e-4038-be0c-0b9822b44fa3-plugins-config-volume\") pod \"payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw\" (UID: \"f044720d-837e-4038-be0c-0b9822b44fa3\") " pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"
Sep 10 23:56:47.801300 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.801260    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84btn\" (UniqueName: \"kubernetes.io/projected/f044720d-837e-4038-be0c-0b9822b44fa3-kube-api-access-84btn\") pod \"payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw\" (UID: \"f044720d-837e-4038-be0c-0b9822b44fa3\") " pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"
Sep 10 23:56:47.860452 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.860372    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"
Sep 10 23:56:47.954386 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:47.954214    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"
Sep 10 23:56:48.138928 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:48.138903    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"]
Sep 10 23:56:48.140898 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:56:48.140873    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fdfe283_eaa3_4347_a142_bfbd5d0fb506.slice/crio-3b35a6e923cce6ad3b333067a22051128c918971350e7135e70b25231a356ca5 WatchSource:0}: Error finding container 3b35a6e923cce6ad3b333067a22051128c918971350e7135e70b25231a356ca5: Status 404 returned error can't find the container with id 3b35a6e923cce6ad3b333067a22051128c918971350e7135e70b25231a356ca5
Sep 10 23:56:48.237767 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:48.237731    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"]
Sep 10 23:56:48.239131 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:56:48.239103    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf044720d_837e_4038_be0c_0b9822b44fa3.slice/crio-2a191966a22c0873548f11b5587e4c32ad898a1b250466a640262d046344c401 WatchSource:0}: Error finding container 2a191966a22c0873548f11b5587e4c32ad898a1b250466a640262d046344c401: Status 404 returned error can't find the container with id 2a191966a22c0873548f11b5587e4c32ad898a1b250466a640262d046344c401
Sep 10 23:56:48.484854 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:48.484815    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"
Sep 10 23:56:48.485027 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:48.484863    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw" event={"ID":"f044720d-837e-4038-be0c-0b9822b44fa3","Type":"ContainerStarted","Data":"9bcf1cf10625b8ced034f4f5531c18919dc0f88ac3fcc3aad8fb05ecb2f2f13f"}
Sep 10 23:56:48.485027 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:48.484883    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"
Sep 10 23:56:48.485027 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:48.484898    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw" event={"ID":"f044720d-837e-4038-be0c-0b9822b44fa3","Type":"ContainerStarted","Data":"2a191966a22c0873548f11b5587e4c32ad898a1b250466a640262d046344c401"}
Sep 10 23:56:48.485027 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:48.484912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p" event={"ID":"3fdfe283-eaa3-4347-a142-bfbd5d0fb506","Type":"ContainerStarted","Data":"0a53ae54926344b8ff37114e6c3ee80c74e6bc25007ba25d1571f6bcfaf85f57"}
Sep 10 23:56:48.485027 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:48.484925    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p" event={"ID":"3fdfe283-eaa3-4347-a142-bfbd5d0fb506","Type":"ContainerStarted","Data":"3b35a6e923cce6ad3b333067a22051128c918971350e7135e70b25231a356ca5"}
Sep 10 23:56:48.496993 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:48.496949    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw" podStartSLOduration=1.49693255 podStartE2EDuration="1.49693255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:56:48.494842711 +0000 UTC m=+1208.535712021" watchObservedRunningTime="2026-09-10 23:56:48.49693255 +0000 UTC m=+1208.537801852"
Sep 10 23:56:48.514119 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:48.514074    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p" podStartSLOduration=1.514058227 podStartE2EDuration="1.514058227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:56:48.512223742 +0000 UTC m=+1208.553093048" watchObservedRunningTime="2026-09-10 23:56:48.514058227 +0000 UTC m=+1208.554927531"
Sep 10 23:56:51.537554 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:51.537522    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:51.537962 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:51.537575    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:51.549691 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:51.549649    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:52.515248 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:52.515222    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 10 23:56:59.489144 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:59.489095    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"
Sep 10 23:56:59.489865 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:56:59.489841    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"
Sep 10 23:57:04.722440 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:04.722403    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:57:06.602406 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:06.602369    2581 generic.go:356] "Generic (PLEG): container finished" podID="bb3c0127-acb0-4328-a213-cbd588a7c77b" containerID="029570b67206878974257e1e6e08873e5d178b337b46aa218e6b75c726f8474d" exitCode=0
Sep 10 23:57:06.602896 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:06.602447    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2" event={"ID":"bb3c0127-acb0-4328-a213-cbd588a7c77b","Type":"ContainerDied","Data":"029570b67206878974257e1e6e08873e5d178b337b46aa218e6b75c726f8474d"}
Sep 10 23:57:06.602970 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:06.602917    2581 scope.go:117] "RemoveContainer" containerID="029570b67206878974257e1e6e08873e5d178b337b46aa218e6b75c726f8474d"
Sep 10 23:57:06.603802 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:06.603782    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:06.604166 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:06.604139    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:57:06.604224 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:06.604212    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:57:06.604262 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:06.604249    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 23:57:06.704575 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:06.704546    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:07.611518 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:07.611489    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2" event={"ID":"bb3c0127-acb0-4328-a213-cbd588a7c77b","Type":"ContainerStarted","Data":"954d1b6f0dc955b14c4c6820b27fd6d25bf0aff5aea5ed45e149796ecaddcbb8"}
Sep 10 23:57:08.184415 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:08.184372    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:57:08.184777 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:08.184741    2581 patch_prober.go:28] interesting pod/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 10 23:57:08.184900 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:08.184813    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2" podUID="bb3c0127-acb0-4328-a213-cbd588a7c77b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 10 23:57:09.184312 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:09.184275    2581 patch_prober.go:28] interesting pod/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 10 23:57:09.184911 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:09.184878    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2" podUID="bb3c0127-acb0-4328-a213-cbd588a7c77b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 10 23:57:10.184493 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:10.184458    2581 patch_prober.go:28] interesting pod/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 10 23:57:10.185152 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:10.185117    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2" podUID="bb3c0127-acb0-4328-a213-cbd588a7c77b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 10 23:57:10.285025 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:10.284988    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:11.184010 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:11.183969    2581 patch_prober.go:28] interesting pod/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 10 23:57:11.184216 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:11.184059    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2" podUID="bb3c0127-acb0-4328-a213-cbd588a7c77b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 10 23:57:12.183764 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:12.183727    2581 patch_prober.go:28] interesting pod/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 10 23:57:12.184376 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:12.184339    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2" podUID="bb3c0127-acb0-4328-a213-cbd588a7c77b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 10 23:57:13.187543 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:13.187515    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:57:13.187934 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:13.187881    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:57:13.188535 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:13.188520    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:57:17.575842 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:17.575807    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:23.331112 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:23.331076    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:57:40.651810 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:40.651736    2581 scope.go:117] "RemoveContainer" containerID="d7b9b851c185d1d32dc0c203f4d6a274aa4debdf8f8e28938383abe0bcf701e2"
Sep 10 23:57:47.756513 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:47.756475    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:57:54.630545 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:57:54.630506    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:58:10.520712 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:10.520658    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:58:11.298997 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:11.298961    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:30.016329 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:30.016281    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:58:40.690489 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:40.690455    2581 scope.go:117] "RemoveContainer" containerID="7554e11386c4d3bc4954731dc919213c2b032efbd95a2359b80c9d344994b0d3"
Sep 10 23:58:40.700351 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:40.700327    2581 scope.go:117] "RemoveContainer" containerID="cc7c507e0dbdc68379190fb3cec64143cdb4a0dcfd638b7f49c4baa0bce252eb"
Sep 10 23:58:40.883659 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:40.883617    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:40.912742 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:40.912703    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"]
Sep 10 23:58:40.913046 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:40.912998    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw" podUID="f044720d-837e-4038-be0c-0b9822b44fa3" containerName="payload-processing" containerID="cri-o://9bcf1cf10625b8ced034f4f5531c18919dc0f88ac3fcc3aad8fb05ecb2f2f13f" gracePeriod=30
Sep 10 23:58:40.922981 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:40.922856    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"]
Sep 10 23:58:40.923210 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:40.923178    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p" podUID="3fdfe283-eaa3-4347-a142-bfbd5d0fb506" containerName="payload-pre-processing" containerID="cri-o://0a53ae54926344b8ff37114e6c3ee80c74e6bc25007ba25d1571f6bcfaf85f57" gracePeriod=30
Sep 10 23:58:40.964589 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:40.964551    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:41.048830 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.048792    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:41.123200 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.123169    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:41.193139 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.193111    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:41.194641 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.194623    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"
Sep 10 23:58:41.223510 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.223478    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"
Sep 10 23:58:41.223959 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.223934    2581 generic.go:356] "Generic (PLEG): container finished" podID="f044720d-837e-4038-be0c-0b9822b44fa3" containerID="9bcf1cf10625b8ced034f4f5531c18919dc0f88ac3fcc3aad8fb05ecb2f2f13f" exitCode=0
Sep 10 23:58:41.224060 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.223975    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"
Sep 10 23:58:41.224060 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.224015    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw" event={"ID":"f044720d-837e-4038-be0c-0b9822b44fa3","Type":"ContainerDied","Data":"9bcf1cf10625b8ced034f4f5531c18919dc0f88ac3fcc3aad8fb05ecb2f2f13f"}
Sep 10 23:58:41.224188 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.224067    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw" event={"ID":"f044720d-837e-4038-be0c-0b9822b44fa3","Type":"ContainerDied","Data":"2a191966a22c0873548f11b5587e4c32ad898a1b250466a640262d046344c401"}
Sep 10 23:58:41.224188 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.224095    2581 scope.go:117] "RemoveContainer" containerID="9bcf1cf10625b8ced034f4f5531c18919dc0f88ac3fcc3aad8fb05ecb2f2f13f"
Sep 10 23:58:41.225718 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.225651    2581 generic.go:356] "Generic (PLEG): container finished" podID="3fdfe283-eaa3-4347-a142-bfbd5d0fb506" containerID="0a53ae54926344b8ff37114e6c3ee80c74e6bc25007ba25d1571f6bcfaf85f57" exitCode=0
Sep 10 23:58:41.225718 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.225713    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"
Sep 10 23:58:41.225934 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.225907    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p" event={"ID":"3fdfe283-eaa3-4347-a142-bfbd5d0fb506","Type":"ContainerDied","Data":"0a53ae54926344b8ff37114e6c3ee80c74e6bc25007ba25d1571f6bcfaf85f57"}
Sep 10 23:58:41.226002 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.225956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p" event={"ID":"3fdfe283-eaa3-4347-a142-bfbd5d0fb506","Type":"ContainerDied","Data":"3b35a6e923cce6ad3b333067a22051128c918971350e7135e70b25231a356ca5"}
Sep 10 23:58:41.236220 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.235542    2581 scope.go:117] "RemoveContainer" containerID="9bcf1cf10625b8ced034f4f5531c18919dc0f88ac3fcc3aad8fb05ecb2f2f13f"
Sep 10 23:58:41.236220 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:58:41.236054    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bcf1cf10625b8ced034f4f5531c18919dc0f88ac3fcc3aad8fb05ecb2f2f13f\": container with ID starting with 9bcf1cf10625b8ced034f4f5531c18919dc0f88ac3fcc3aad8fb05ecb2f2f13f not found: ID does not exist" containerID="9bcf1cf10625b8ced034f4f5531c18919dc0f88ac3fcc3aad8fb05ecb2f2f13f"
Sep 10 23:58:41.236220 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.236094    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bcf1cf10625b8ced034f4f5531c18919dc0f88ac3fcc3aad8fb05ecb2f2f13f"} err="failed to get container status \"9bcf1cf10625b8ced034f4f5531c18919dc0f88ac3fcc3aad8fb05ecb2f2f13f\": rpc error: code = NotFound desc = could not find container \"9bcf1cf10625b8ced034f4f5531c18919dc0f88ac3fcc3aad8fb05ecb2f2f13f\": container with ID starting with 9bcf1cf10625b8ced034f4f5531c18919dc0f88ac3fcc3aad8fb05ecb2f2f13f not found: ID does not exist"
Sep 10 23:58:41.236220 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.236119    2581 scope.go:117] "RemoveContainer" containerID="0a53ae54926344b8ff37114e6c3ee80c74e6bc25007ba25d1571f6bcfaf85f57"
Sep 10 23:58:41.281709 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.281645    2581 scope.go:117] "RemoveContainer" containerID="0a53ae54926344b8ff37114e6c3ee80c74e6bc25007ba25d1571f6bcfaf85f57"
Sep 10 23:58:41.282107 ip-10-0-139-147 kubenswrapper[2581]: E0910 23:58:41.282078    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a53ae54926344b8ff37114e6c3ee80c74e6bc25007ba25d1571f6bcfaf85f57\": container with ID starting with 0a53ae54926344b8ff37114e6c3ee80c74e6bc25007ba25d1571f6bcfaf85f57 not found: ID does not exist" containerID="0a53ae54926344b8ff37114e6c3ee80c74e6bc25007ba25d1571f6bcfaf85f57"
Sep 10 23:58:41.282225 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.282118    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a53ae54926344b8ff37114e6c3ee80c74e6bc25007ba25d1571f6bcfaf85f57"} err="failed to get container status \"0a53ae54926344b8ff37114e6c3ee80c74e6bc25007ba25d1571f6bcfaf85f57\": rpc error: code = NotFound desc = could not find container \"0a53ae54926344b8ff37114e6c3ee80c74e6bc25007ba25d1571f6bcfaf85f57\": container with ID starting with 0a53ae54926344b8ff37114e6c3ee80c74e6bc25007ba25d1571f6bcfaf85f57 not found: ID does not exist"
Sep 10 23:58:41.287520 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.287492    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f044720d-837e-4038-be0c-0b9822b44fa3-plugins-config-volume\") pod \"f044720d-837e-4038-be0c-0b9822b44fa3\" (UID: \"f044720d-837e-4038-be0c-0b9822b44fa3\") "
Sep 10 23:58:41.287645 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.287535    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84btn\" (UniqueName: \"kubernetes.io/projected/f044720d-837e-4038-be0c-0b9822b44fa3-kube-api-access-84btn\") pod \"f044720d-837e-4038-be0c-0b9822b44fa3\" (UID: \"f044720d-837e-4038-be0c-0b9822b44fa3\") "
Sep 10 23:58:41.287645 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.287570    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fdfe283-eaa3-4347-a142-bfbd5d0fb506-plugins-config-volume\") pod \"3fdfe283-eaa3-4347-a142-bfbd5d0fb506\" (UID: \"3fdfe283-eaa3-4347-a142-bfbd5d0fb506\") "
Sep 10 23:58:41.287645 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.287630    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gd8b\" (UniqueName: \"kubernetes.io/projected/3fdfe283-eaa3-4347-a142-bfbd5d0fb506-kube-api-access-6gd8b\") pod \"3fdfe283-eaa3-4347-a142-bfbd5d0fb506\" (UID: \"3fdfe283-eaa3-4347-a142-bfbd5d0fb506\") "
Sep 10 23:58:41.287989 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.287957    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f044720d-837e-4038-be0c-0b9822b44fa3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f044720d-837e-4038-be0c-0b9822b44fa3" (UID: "f044720d-837e-4038-be0c-0b9822b44fa3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:58:41.288086 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.288000    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fdfe283-eaa3-4347-a142-bfbd5d0fb506-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3fdfe283-eaa3-4347-a142-bfbd5d0fb506" (UID: "3fdfe283-eaa3-4347-a142-bfbd5d0fb506"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:58:41.289878 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.289852    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f044720d-837e-4038-be0c-0b9822b44fa3-kube-api-access-84btn" (OuterVolumeSpecName: "kube-api-access-84btn") pod "f044720d-837e-4038-be0c-0b9822b44fa3" (UID: "f044720d-837e-4038-be0c-0b9822b44fa3"). InnerVolumeSpecName "kube-api-access-84btn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:58:41.289985 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.289971    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fdfe283-eaa3-4347-a142-bfbd5d0fb506-kube-api-access-6gd8b" (OuterVolumeSpecName: "kube-api-access-6gd8b") pod "3fdfe283-eaa3-4347-a142-bfbd5d0fb506" (UID: "3fdfe283-eaa3-4347-a142-bfbd5d0fb506"). InnerVolumeSpecName "kube-api-access-6gd8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:58:41.389171 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.389133    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f044720d-837e-4038-be0c-0b9822b44fa3-plugins-config-volume\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:58:41.389171 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.389165    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84btn\" (UniqueName: \"kubernetes.io/projected/f044720d-837e-4038-be0c-0b9822b44fa3-kube-api-access-84btn\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:58:41.389171 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.389176    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fdfe283-eaa3-4347-a142-bfbd5d0fb506-plugins-config-volume\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:58:41.389419 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.389185    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gd8b\" (UniqueName: \"kubernetes.io/projected/3fdfe283-eaa3-4347-a142-bfbd5d0fb506-kube-api-access-6gd8b\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:58:41.551388 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.551327    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"]
Sep 10 23:58:41.553762 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.553735    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p"]
Sep 10 23:58:41.563525 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.563493    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"]
Sep 10 23:58:41.568554 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:41.568520    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw"]
Sep 10 23:58:42.484750 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:42.484719    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fdfe283-eaa3-4347-a142-bfbd5d0fb506" path="/var/lib/kubelet/pods/3fdfe283-eaa3-4347-a142-bfbd5d0fb506/volumes"
Sep 10 23:58:42.485153 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:42.485107    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f044720d-837e-4038-be0c-0b9822b44fa3" path="/var/lib/kubelet/pods/f044720d-837e-4038-be0c-0b9822b44fa3/volumes"
Sep 10 23:58:44.107046 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:44.107006    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:58:49.137573 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:49.137537    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:58:49.199243 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:58:49.199204    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:06.120541 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:06.120421    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:59:21.526490 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:21.526452    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:59:26.003646 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:26.003618    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:26.709782 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:26.709742    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:32.147593 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:32.147556    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:32.211562 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:32.211529    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:32.371196 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:32.371162    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"]
Sep 10 23:59:32.371484 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:32.371453    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2" podUID="bb3c0127-acb0-4328-a213-cbd588a7c77b" containerName="istio-proxy" containerID="cri-o://954d1b6f0dc955b14c4c6820b27fd6d25bf0aff5aea5ed45e149796ecaddcbb8" gracePeriod=30
Sep 10 23:59:32.385637 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:32.385608    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:33.610961 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:33.610919    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:33.710398 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:33.710360    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:33.809993 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:33.809936    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:34.412966 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:34.412925    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:34.504313 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:34.504280    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:34.604620 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:34.604583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:35.791002 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:35.790969    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:37.581515 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.581477    2581 generic.go:356] "Generic (PLEG): container finished" podID="bb3c0127-acb0-4328-a213-cbd588a7c77b" containerID="954d1b6f0dc955b14c4c6820b27fd6d25bf0aff5aea5ed45e149796ecaddcbb8" exitCode=0
Sep 10 23:59:37.582205 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.581521    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2" event={"ID":"bb3c0127-acb0-4328-a213-cbd588a7c77b","Type":"ContainerDied","Data":"954d1b6f0dc955b14c4c6820b27fd6d25bf0aff5aea5ed45e149796ecaddcbb8"}
Sep 10 23:59:37.582205 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.581591    2581 scope.go:117] "RemoveContainer" containerID="029570b67206878974257e1e6e08873e5d178b337b46aa218e6b75c726f8474d"
Sep 10 23:59:37.640731 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.640638    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:59:37.750655 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.750624    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-data\") pod \"bb3c0127-acb0-4328-a213-cbd588a7c77b\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") "
Sep 10 23:59:37.750854 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.750721    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-credential-socket\") pod \"bb3c0127-acb0-4328-a213-cbd588a7c77b\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") "
Sep 10 23:59:37.750854 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.750749    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-workload-socket\") pod \"bb3c0127-acb0-4328-a213-cbd588a7c77b\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") "
Sep 10 23:59:37.750854 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.750813    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-podinfo\") pod \"bb3c0127-acb0-4328-a213-cbd588a7c77b\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") "
Sep 10 23:59:37.750854 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.750848    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-workload-certs\") pod \"bb3c0127-acb0-4328-a213-cbd588a7c77b\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") "
Sep 10 23:59:37.751070 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.750878    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-token\") pod \"bb3c0127-acb0-4328-a213-cbd588a7c77b\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") "
Sep 10 23:59:37.751070 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.750930    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-data" (OuterVolumeSpecName: "istio-data") pod "bb3c0127-acb0-4328-a213-cbd588a7c77b" (UID: "bb3c0127-acb0-4328-a213-cbd588a7c77b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:59:37.751070 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.750996    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb3c0127-acb0-4328-a213-cbd588a7c77b-istiod-ca-cert\") pod \"bb3c0127-acb0-4328-a213-cbd588a7c77b\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") "
Sep 10 23:59:37.751233 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.751069    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bb3c0127-acb0-4328-a213-cbd588a7c77b" (UID: "bb3c0127-acb0-4328-a213-cbd588a7c77b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:59:37.751233 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.751089    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xv8s\" (UniqueName: \"kubernetes.io/projected/bb3c0127-acb0-4328-a213-cbd588a7c77b-kube-api-access-4xv8s\") pod \"bb3c0127-acb0-4328-a213-cbd588a7c77b\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") "
Sep 10 23:59:37.751233 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.751139    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bb3c0127-acb0-4328-a213-cbd588a7c77b" (UID: "bb3c0127-acb0-4328-a213-cbd588a7c77b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:59:37.751233 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.751157    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-envoy\") pod \"bb3c0127-acb0-4328-a213-cbd588a7c77b\" (UID: \"bb3c0127-acb0-4328-a213-cbd588a7c77b\") "
Sep 10 23:59:37.751439 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.751264    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bb3c0127-acb0-4328-a213-cbd588a7c77b" (UID: "bb3c0127-acb0-4328-a213-cbd588a7c77b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:59:37.751439 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.751379    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb3c0127-acb0-4328-a213-cbd588a7c77b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bb3c0127-acb0-4328-a213-cbd588a7c77b" (UID: "bb3c0127-acb0-4328-a213-cbd588a7c77b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:59:37.751614 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.751596    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-credential-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:59:37.751880 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.751616    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-workload-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:59:37.751880 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.751627    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-workload-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:59:37.751880 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.751638    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb3c0127-acb0-4328-a213-cbd588a7c77b-istiod-ca-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:59:37.751880 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.751652    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-data\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:59:37.753311 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.753280    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb3c0127-acb0-4328-a213-cbd588a7c77b-kube-api-access-4xv8s" (OuterVolumeSpecName: "kube-api-access-4xv8s") pod "bb3c0127-acb0-4328-a213-cbd588a7c77b" (UID: "bb3c0127-acb0-4328-a213-cbd588a7c77b"). InnerVolumeSpecName "kube-api-access-4xv8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:59:37.753414 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.753346    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bb3c0127-acb0-4328-a213-cbd588a7c77b" (UID: "bb3c0127-acb0-4328-a213-cbd588a7c77b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:59:37.753481 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.753456    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-token" (OuterVolumeSpecName: "istio-token") pod "bb3c0127-acb0-4328-a213-cbd588a7c77b" (UID: "bb3c0127-acb0-4328-a213-cbd588a7c77b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:59:37.753784 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.753767    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bb3c0127-acb0-4328-a213-cbd588a7c77b" (UID: "bb3c0127-acb0-4328-a213-cbd588a7c77b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:59:37.852948 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.852909    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-token\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:59:37.852948 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.852942    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xv8s\" (UniqueName: \"kubernetes.io/projected/bb3c0127-acb0-4328-a213-cbd588a7c77b-kube-api-access-4xv8s\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:59:37.852948 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.852951    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-envoy\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:59:37.852948 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:37.852959    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb3c0127-acb0-4328-a213-cbd588a7c77b-istio-podinfo\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 10 23:59:38.594753 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:38.594717    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"
Sep 10 23:59:38.594753 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:38.594725    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2" event={"ID":"bb3c0127-acb0-4328-a213-cbd588a7c77b","Type":"ContainerDied","Data":"08ab163bd17d766706339fbcb4653daa3a31a7f5de061a2357f7d5182775ad6a"}
Sep 10 23:59:38.595298 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:38.594825    2581 scope.go:117] "RemoveContainer" containerID="954d1b6f0dc955b14c4c6820b27fd6d25bf0aff5aea5ed45e149796ecaddcbb8"
Sep 10 23:59:38.614118 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:38.614086    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"]
Sep 10 23:59:38.620625 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:38.620598    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2"]
Sep 10 23:59:40.485263 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:40.485231    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb3c0127-acb0-4328-a213-cbd588a7c77b" path="/var/lib/kubelet/pods/bb3c0127-acb0-4328-a213-cbd588a7c77b/volumes"
Sep 10 23:59:40.715140 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:40.715104    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:59:40.727877 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:40.727849    2581 scope.go:117] "RemoveContainer" containerID="518131fdd47d23d47cde4aec871815986a609a0b92ec3eece3eac61caf6f0ffd"
Sep 10 23:59:40.737286 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:40.737269    2581 scope.go:117] "RemoveContainer" containerID="8bbafc07eec9a3e89bd48c83b9bfdb6f172cdbd421c3467d9b86622f0a2d5d56"
Sep 10 23:59:41.706823 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:41.706793    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:41.771427 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:41.771389    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:42.358679 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:42.358630    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:48.102039 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:48.101998    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:48.218142 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:48.218098    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:48.391235 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:48.391150    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:56.127842 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:56.127806    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 10 23:59:58.839664 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:58.839632    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:59.076489 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.076456    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 10 23:59:59.244554 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.244521    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7841-245dc8"]
Sep 10 23:59:59.244935 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.244921    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f044720d-837e-4038-be0c-0b9822b44fa3" containerName="payload-processing"
Sep 10 23:59:59.244998 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.244937    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f044720d-837e-4038-be0c-0b9822b44fa3" containerName="payload-processing"
Sep 10 23:59:59.244998 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.244956    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fdfe283-eaa3-4347-a142-bfbd5d0fb506" containerName="payload-pre-processing"
Sep 10 23:59:59.244998 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.244961    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fdfe283-eaa3-4347-a142-bfbd5d0fb506" containerName="payload-pre-processing"
Sep 10 23:59:59.244998 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.244974    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb3c0127-acb0-4328-a213-cbd588a7c77b" containerName="istio-proxy"
Sep 10 23:59:59.244998 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.244979    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb3c0127-acb0-4328-a213-cbd588a7c77b" containerName="istio-proxy"
Sep 10 23:59:59.244998 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.244989    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb3c0127-acb0-4328-a213-cbd588a7c77b" containerName="istio-proxy"
Sep 10 23:59:59.244998 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.244994    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb3c0127-acb0-4328-a213-cbd588a7c77b" containerName="istio-proxy"
Sep 10 23:59:59.245238 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.245075    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fdfe283-eaa3-4347-a142-bfbd5d0fb506" containerName="payload-pre-processing"
Sep 10 23:59:59.245238 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.245086    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb3c0127-acb0-4328-a213-cbd588a7c77b" containerName="istio-proxy"
Sep 10 23:59:59.245238 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.245094    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb3c0127-acb0-4328-a213-cbd588a7c77b" containerName="istio-proxy"
Sep 10 23:59:59.245238 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.245099    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f044720d-837e-4038-be0c-0b9822b44fa3" containerName="payload-processing"
Sep 10 23:59:59.250205 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.250178    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7841-245dc8"
Sep 10 23:59:59.252273 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.252245    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7841-245dc8"]
Sep 10 23:59:59.252979 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.252951    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k9g2h\""
Sep 10 23:59:59.355610 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.355574    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lc76\" (UniqueName: \"kubernetes.io/projected/72025d32-fa79-4fee-ba6c-5b083f75265b-kube-api-access-9lc76\") pod \"test-curl-7841-245dc8\" (UID: \"72025d32-fa79-4fee-ba6c-5b083f75265b\") " pod="opendatahub/test-curl-7841-245dc8"
Sep 10 23:59:59.457014 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.456970    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lc76\" (UniqueName: \"kubernetes.io/projected/72025d32-fa79-4fee-ba6c-5b083f75265b-kube-api-access-9lc76\") pod \"test-curl-7841-245dc8\" (UID: \"72025d32-fa79-4fee-ba6c-5b083f75265b\") " pod="opendatahub/test-curl-7841-245dc8"
Sep 10 23:59:59.465652 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.465620    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lc76\" (UniqueName: \"kubernetes.io/projected/72025d32-fa79-4fee-ba6c-5b083f75265b-kube-api-access-9lc76\") pod \"test-curl-7841-245dc8\" (UID: \"72025d32-fa79-4fee-ba6c-5b083f75265b\") " pod="opendatahub/test-curl-7841-245dc8"
Sep 10 23:59:59.560785 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.560700    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7841-245dc8"
Sep 10 23:59:59.832845 ip-10-0-139-147 kubenswrapper[2581]: I0910 23:59:59.832809    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7841-245dc8"]
Sep 10 23:59:59.834158 ip-10-0-139-147 kubenswrapper[2581]: W0910 23:59:59.834129    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72025d32_fa79_4fee_ba6c_5b083f75265b.slice/crio-4d8d6ff729773676cc7601770d574d1ab4967de5649e553511808a2659746162 WatchSource:0}: Error finding container 4d8d6ff729773676cc7601770d574d1ab4967de5649e553511808a2659746162: Status 404 returned error can't find the container with id 4d8d6ff729773676cc7601770d574d1ab4967de5649e553511808a2659746162
Sep 11 00:00:00.161272 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.161180    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818080-lcv4z"]
Sep 11 00:00:00.165343 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.165320    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e96d4c-29818080-tzn8c"]
Sep 11 00:00:00.165474 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.165451    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818080-lcv4z"
Sep 11 00:00:00.167879 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.167854    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22lrj\""
Sep 11 00:00:00.169273 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.169257    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-dd5958-29818080-jxh7q"]
Sep 11 00:00:00.169419 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.169402    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e96d4c-29818080-tzn8c"
Sep 11 00:00:00.172452 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.172435    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-dd5958-29818080-jxh7q"
Sep 11 00:00:00.193512 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.193466    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e96d4c-29818080-tzn8c"]
Sep 11 00:00:00.197416 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.197392    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818080-lcv4z"
Sep 11 00:00:00.209385 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.209357    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e96d4c-29818080-tzn8c"
Sep 11 00:00:00.211729 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.211706    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-dd5958-29818080-jxh7q"]
Sep 11 00:00:00.217926 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.217833    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818080-lcv4z"]
Sep 11 00:00:00.219402 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.219208    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-dd5958-29818080-jxh7q"
Sep 11 00:00:00.511990 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.511957    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818080-lcv4z"]
Sep 11 00:00:00.513120 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:00:00.513089    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4569a83a_4442_46ac_b403_219d89e7c89c.slice/crio-1a8a0d202a4a2f49f600d93fc76604ad6f5ec259a7d32426ae05b2b1aa6f8161 WatchSource:0}: Error finding container 1a8a0d202a4a2f49f600d93fc76604ad6f5ec259a7d32426ae05b2b1aa6f8161: Status 404 returned error can't find the container with id 1a8a0d202a4a2f49f600d93fc76604ad6f5ec259a7d32426ae05b2b1aa6f8161
Sep 11 00:00:00.520482 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.520291    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e96d4c-29818080-tzn8c"]
Sep 11 00:00:00.523190 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:00:00.523167    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bad2802_eaad_4e58_baac_13a56b872b26.slice/crio-f68144080437755d094ef92821299f464958ded9966f6ebb9ee9668517a6ec52 WatchSource:0}: Error finding container f68144080437755d094ef92821299f464958ded9966f6ebb9ee9668517a6ec52: Status 404 returned error can't find the container with id f68144080437755d094ef92821299f464958ded9966f6ebb9ee9668517a6ec52
Sep 11 00:00:00.534738 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.534663    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-dd5958-29818080-jxh7q"]
Sep 11 00:00:00.536026 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:00:00.535997    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f08de44_6052_4125_bf55_84aa59bb4556.slice/crio-4b8af05b38918289c4461241e797886ecdb60ff3f1fc5e5b1b64146e618464c6 WatchSource:0}: Error finding container 4b8af05b38918289c4461241e797886ecdb60ff3f1fc5e5b1b64146e618464c6: Status 404 returned error can't find the container with id 4b8af05b38918289c4461241e797886ecdb60ff3f1fc5e5b1b64146e618464c6
Sep 11 00:00:00.728119 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.728087    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818080-lcv4z" event={"ID":"4569a83a-4442-46ac-b403-219d89e7c89c","Type":"ContainerStarted","Data":"1a8a0d202a4a2f49f600d93fc76604ad6f5ec259a7d32426ae05b2b1aa6f8161"}
Sep 11 00:00:00.729423 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.729394    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e96d4c-29818080-tzn8c" event={"ID":"6bad2802-eaad-4e58-baac-13a56b872b26","Type":"ContainerStarted","Data":"f68144080437755d094ef92821299f464958ded9966f6ebb9ee9668517a6ec52"}
Sep 11 00:00:00.731003 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.730981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7841-245dc8" event={"ID":"72025d32-fa79-4fee-ba6c-5b083f75265b","Type":"ContainerStarted","Data":"2f9dc66b60ae870f30aa49591edaa05e523eb331a30e86aaa5ac5dfef8f749ad"}
Sep 11 00:00:00.731098 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.731018    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7841-245dc8" event={"ID":"72025d32-fa79-4fee-ba6c-5b083f75265b","Type":"ContainerStarted","Data":"4d8d6ff729773676cc7601770d574d1ab4967de5649e553511808a2659746162"}
Sep 11 00:00:00.732200 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.732180    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-dd5958-29818080-jxh7q" event={"ID":"9f08de44-6052-4125-bf55-84aa59bb4556","Type":"ContainerStarted","Data":"4b8af05b38918289c4461241e797886ecdb60ff3f1fc5e5b1b64146e618464c6"}
Sep 11 00:00:00.747154 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:00.747107    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7841-245dc8" podStartSLOduration=1.747091915 podStartE2EDuration="1.747091915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:59:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:00:00.744995088 +0000 UTC m=+1400.785864396" watchObservedRunningTime="2026-09-11 00:00:00.747091915 +0000 UTC m=+1400.787961255"
Sep 11 00:00:01.348493 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:01.348457    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7841-245dc8"]
Sep 11 00:00:01.354850 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:01.354812    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7841-245dc8"]
Sep 11 00:00:01.740564 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:01.740531    2581 generic.go:356] "Generic (PLEG): container finished" podID="6bad2802-eaad-4e58-baac-13a56b872b26" containerID="721966823c98019f2b4ad40875bce27caf0a32ba8cfcf7934887e657b9d54a3c" exitCode=0
Sep 11 00:00:01.740769 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:01.740623    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e96d4c-29818080-tzn8c" event={"ID":"6bad2802-eaad-4e58-baac-13a56b872b26","Type":"ContainerDied","Data":"721966823c98019f2b4ad40875bce27caf0a32ba8cfcf7934887e657b9d54a3c"}
Sep 11 00:00:01.742296 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:01.742267    2581 generic.go:356] "Generic (PLEG): container finished" podID="9f08de44-6052-4125-bf55-84aa59bb4556" containerID="a0071643e95e20255d0e1873b9f1d884a0dd6808e6290acdf9b892c91fe6addd" exitCode=0
Sep 11 00:00:01.742410 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:01.742335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-dd5958-29818080-jxh7q" event={"ID":"9f08de44-6052-4125-bf55-84aa59bb4556","Type":"ContainerDied","Data":"a0071643e95e20255d0e1873b9f1d884a0dd6808e6290acdf9b892c91fe6addd"}
Sep 11 00:00:01.743887 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:01.743864    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818080-lcv4z" event={"ID":"4569a83a-4442-46ac-b403-219d89e7c89c","Type":"ContainerStarted","Data":"08a5331de91012f5933ec29ee593cd6a3b2f0aa35acaae1278d05b1ce6bb7535"}
Sep 11 00:00:01.744174 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:00:01.744158    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7841-245dc8" container="test-curl-7841-245dc8"
Sep 11 00:00:01.773729 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:01.773507    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818080-lcv4z" podStartSLOduration=1.773486998 podStartE2EDuration="1.773486998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:00:01.771880283 +0000 UTC m=+1401.812749589" watchObservedRunningTime="2026-09-11 00:00:01.773486998 +0000 UTC m=+1401.814356304"
Sep 11 00:00:02.669772 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:02.669737    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"]
Sep 11 00:00:02.751525 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:02.751488    2581 generic.go:356] "Generic (PLEG): container finished" podID="4569a83a-4442-46ac-b403-219d89e7c89c" containerID="08a5331de91012f5933ec29ee593cd6a3b2f0aa35acaae1278d05b1ce6bb7535" exitCode=0
Sep 11 00:00:02.751760 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:02.751529    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818080-lcv4z" event={"ID":"4569a83a-4442-46ac-b403-219d89e7c89c","Type":"ContainerDied","Data":"08a5331de91012f5933ec29ee593cd6a3b2f0aa35acaae1278d05b1ce6bb7535"}
Sep 11 00:00:02.751833 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:02.751757    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7841-245dc8" podUID="72025d32-fa79-4fee-ba6c-5b083f75265b" containerName="test-curl-7841-245dc8" containerID="cri-o://2f9dc66b60ae870f30aa49591edaa05e523eb331a30e86aaa5ac5dfef8f749ad" gracePeriod=2
Sep 11 00:00:02.928458 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:02.928381    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-dd5958-29818080-jxh7q"
Sep 11 00:00:02.956305 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:02.956281    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e96d4c-29818080-tzn8c"
Sep 11 00:00:02.979997 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:02.979950    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:03.758893 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:03.758869    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-dd5958-29818080-jxh7q"
Sep 11 00:00:03.759294 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:03.758905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-dd5958-29818080-jxh7q" event={"ID":"9f08de44-6052-4125-bf55-84aa59bb4556","Type":"ContainerDied","Data":"4b8af05b38918289c4461241e797886ecdb60ff3f1fc5e5b1b64146e618464c6"}
Sep 11 00:00:03.759294 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:03.758954    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b8af05b38918289c4461241e797886ecdb60ff3f1fc5e5b1b64146e618464c6"
Sep 11 00:00:03.760427 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:03.760404    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e96d4c-29818080-tzn8c" event={"ID":"6bad2802-eaad-4e58-baac-13a56b872b26","Type":"ContainerDied","Data":"f68144080437755d094ef92821299f464958ded9966f6ebb9ee9668517a6ec52"}
Sep 11 00:00:03.760427 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:03.760425    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e96d4c-29818080-tzn8c"
Sep 11 00:00:03.760597 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:03.760441    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f68144080437755d094ef92821299f464958ded9966f6ebb9ee9668517a6ec52"
Sep 11 00:00:03.908935 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:03.908907    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818080-lcv4z"
Sep 11 00:00:04.287755 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:04.287725    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:04.770343 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:04.770319    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818080-lcv4z"
Sep 11 00:00:04.770772 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:04.770343    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818080-lcv4z" event={"ID":"4569a83a-4442-46ac-b403-219d89e7c89c","Type":"ContainerDied","Data":"1a8a0d202a4a2f49f600d93fc76604ad6f5ec259a7d32426ae05b2b1aa6f8161"}
Sep 11 00:00:04.770772 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:04.770391    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a8a0d202a4a2f49f600d93fc76604ad6f5ec259a7d32426ae05b2b1aa6f8161"
Sep 11 00:00:04.941724 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:04.941697    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7841-245dc8"
Sep 11 00:00:05.015229 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:05.015136    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lc76\" (UniqueName: \"kubernetes.io/projected/72025d32-fa79-4fee-ba6c-5b083f75265b-kube-api-access-9lc76\") pod \"72025d32-fa79-4fee-ba6c-5b083f75265b\" (UID: \"72025d32-fa79-4fee-ba6c-5b083f75265b\") "
Sep 11 00:00:05.017399 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:05.017374    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72025d32-fa79-4fee-ba6c-5b083f75265b-kube-api-access-9lc76" (OuterVolumeSpecName: "kube-api-access-9lc76") pod "72025d32-fa79-4fee-ba6c-5b083f75265b" (UID: "72025d32-fa79-4fee-ba6c-5b083f75265b"). InnerVolumeSpecName "kube-api-access-9lc76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:00:05.116449 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:05.116409    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lc76\" (UniqueName: \"kubernetes.io/projected/72025d32-fa79-4fee-ba6c-5b083f75265b-kube-api-access-9lc76\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:00:05.778733 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:05.778703    2581 generic.go:356] "Generic (PLEG): container finished" podID="72025d32-fa79-4fee-ba6c-5b083f75265b" containerID="2f9dc66b60ae870f30aa49591edaa05e523eb331a30e86aaa5ac5dfef8f749ad" exitCode=137
Sep 11 00:00:05.779167 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:05.778750    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7841-245dc8"
Sep 11 00:00:05.779167 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:05.778791    2581 scope.go:117] "RemoveContainer" containerID="2f9dc66b60ae870f30aa49591edaa05e523eb331a30e86aaa5ac5dfef8f749ad"
Sep 11 00:00:05.788918 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:05.788901    2581 scope.go:117] "RemoveContainer" containerID="2f9dc66b60ae870f30aa49591edaa05e523eb331a30e86aaa5ac5dfef8f749ad"
Sep 11 00:00:05.789208 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:00:05.789183    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f9dc66b60ae870f30aa49591edaa05e523eb331a30e86aaa5ac5dfef8f749ad\": container with ID starting with 2f9dc66b60ae870f30aa49591edaa05e523eb331a30e86aaa5ac5dfef8f749ad not found: ID does not exist" containerID="2f9dc66b60ae870f30aa49591edaa05e523eb331a30e86aaa5ac5dfef8f749ad"
Sep 11 00:00:05.789274 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:05.789221    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f9dc66b60ae870f30aa49591edaa05e523eb331a30e86aaa5ac5dfef8f749ad"} err="failed to get container status \"2f9dc66b60ae870f30aa49591edaa05e523eb331a30e86aaa5ac5dfef8f749ad\": rpc error: code = NotFound desc = could not find container \"2f9dc66b60ae870f30aa49591edaa05e523eb331a30e86aaa5ac5dfef8f749ad\": container with ID starting with 2f9dc66b60ae870f30aa49591edaa05e523eb331a30e86aaa5ac5dfef8f749ad not found: ID does not exist"
Sep 11 00:00:05.789414 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:00:05.789393    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7841-245dc8\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="72025d32-fa79-4fee-ba6c-5b083f75265b" pod="opendatahub/test-curl-7841-245dc8"
Sep 11 00:00:06.485425 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:06.485389    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72025d32-fa79-4fee-ba6c-5b083f75265b" path="/var/lib/kubelet/pods/72025d32-fa79-4fee-ba6c-5b083f75265b/volumes"
Sep 11 00:00:11.825304 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.825273    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"]
Sep 11 00:00:11.825872 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.825853    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f08de44-6052-4125-bf55-84aa59bb4556" containerName="cleanup"
Sep 11 00:00:11.825974 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.825874    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f08de44-6052-4125-bf55-84aa59bb4556" containerName="cleanup"
Sep 11 00:00:11.825974 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.825889    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4569a83a-4442-46ac-b403-219d89e7c89c" containerName="cleanup"
Sep 11 00:00:11.825974 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.825898    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4569a83a-4442-46ac-b403-219d89e7c89c" containerName="cleanup"
Sep 11 00:00:11.825974 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.825929    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72025d32-fa79-4fee-ba6c-5b083f75265b" containerName="test-curl-7841-245dc8"
Sep 11 00:00:11.825974 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.825937    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="72025d32-fa79-4fee-ba6c-5b083f75265b" containerName="test-curl-7841-245dc8"
Sep 11 00:00:11.825974 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.825947    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bad2802-eaad-4e58-baac-13a56b872b26" containerName="cleanup"
Sep 11 00:00:11.825974 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.825957    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bad2802-eaad-4e58-baac-13a56b872b26" containerName="cleanup"
Sep 11 00:00:11.826311 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.826058    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4569a83a-4442-46ac-b403-219d89e7c89c" containerName="cleanup"
Sep 11 00:00:11.826311 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.826072    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bad2802-eaad-4e58-baac-13a56b872b26" containerName="cleanup"
Sep 11 00:00:11.826311 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.826081    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f08de44-6052-4125-bf55-84aa59bb4556" containerName="cleanup"
Sep 11 00:00:11.826311 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.826093    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="72025d32-fa79-4fee-ba6c-5b083f75265b" containerName="test-curl-7841-245dc8"
Sep 11 00:00:11.828916 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.828894    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.831391 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.831370    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-37692b\"/\"sub-test-model-37692b-kserve-self-signed-certs\""
Sep 11 00:00:11.839525 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.839503    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"]
Sep 11 00:00:11.858789 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.858758    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:11.882910 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.882886    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-dshm\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.883031 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.882915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-tmp-dir\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.883031 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.882964    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-model-cache\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.883031 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.883006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrkld\" (UniqueName: \"kubernetes.io/projected/3d248342-46db-4e44-a82c-dd1f3cb614af-kube-api-access-rrkld\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.883150 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.883032    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-home\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.883150 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.883050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d248342-46db-4e44-a82c-dd1f3cb614af-tls-certs\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.984523 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.984488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-dshm\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.984523 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.984526    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-tmp-dir\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.984779 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.984575    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-model-cache\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.984779 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.984615    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrkld\" (UniqueName: \"kubernetes.io/projected/3d248342-46db-4e44-a82c-dd1f3cb614af-kube-api-access-rrkld\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.984779 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.984652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-home\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.984779 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.984706    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d248342-46db-4e44-a82c-dd1f3cb614af-tls-certs\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.985031 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.985011    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-tmp-dir\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.985087 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.985020    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-home\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.985087 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.985045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-model-cache\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.987234 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.987211    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-dshm\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.987390 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.987374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d248342-46db-4e44-a82c-dd1f3cb614af-tls-certs\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:11.992206 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:11.992183    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrkld\" (UniqueName: \"kubernetes.io/projected/3d248342-46db-4e44-a82c-dd1f3cb614af-kube-api-access-rrkld\") pod \"sub-test-model-37692b-kserve-776b9d79d9-fkqs2\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") " pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:12.141948 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:12.141867    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:12.417489 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:12.417464    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"]
Sep 11 00:00:12.418474 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:00:12.418446    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d248342_46db_4e44_a82c_dd1f3cb614af.slice/crio-500929b22999c68e84f14f150499c9bec15d230a21a669153aa08ef1a983fb1c WatchSource:0}: Error finding container 500929b22999c68e84f14f150499c9bec15d230a21a669153aa08ef1a983fb1c: Status 404 returned error can't find the container with id 500929b22999c68e84f14f150499c9bec15d230a21a669153aa08ef1a983fb1c
Sep 11 00:00:12.833918 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:12.833886    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2" event={"ID":"3d248342-46db-4e44-a82c-dd1f3cb614af","Type":"ContainerStarted","Data":"cf3d039b17c476f63ac67be2900b6024f88c6ee79277f09bed41b192ea55327e"}
Sep 11 00:00:12.834294 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:12.833927    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2" event={"ID":"3d248342-46db-4e44-a82c-dd1f3cb614af","Type":"ContainerStarted","Data":"500929b22999c68e84f14f150499c9bec15d230a21a669153aa08ef1a983fb1c"}
Sep 11 00:00:12.853122 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:12.853062    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2" podStartSLOduration=1.8530458730000001 podStartE2EDuration="1.853045873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:00:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:00:12.850458686 +0000 UTC m=+1412.891327990" watchObservedRunningTime="2026-09-11 00:00:12.853045873 +0000 UTC m=+1412.893915177"
Sep 11 00:00:16.316278 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:16.316232    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:00:17.690125 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:17.690077    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk" podUID="1b4411ac-c3d7-489f-b58a-8c6a27e710e9" containerName="main" containerID="cri-o://f9c292f8f9e3fe164aa7f30e46e22d0f20586cc645659323cc0b1b521f0973ac" gracePeriod=45
Sep 11 00:00:17.875107 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:17.875067    2581 generic.go:356] "Generic (PLEG): container finished" podID="1b4411ac-c3d7-489f-b58a-8c6a27e710e9" containerID="f9c292f8f9e3fe164aa7f30e46e22d0f20586cc645659323cc0b1b521f0973ac" exitCode=0
Sep 11 00:00:17.875328 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:17.875131    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk" event={"ID":"1b4411ac-c3d7-489f-b58a-8c6a27e710e9","Type":"ContainerDied","Data":"f9c292f8f9e3fe164aa7f30e46e22d0f20586cc645659323cc0b1b521f0973ac"}
Sep 11 00:00:17.946276 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:17.946214    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 11 00:00:18.043656 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.043626    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-tls-certs\") pod \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") "
Sep 11 00:00:18.043656 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.043660    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-model-cache\") pod \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") "
Sep 11 00:00:18.043903 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.043717    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-dshm\") pod \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") "
Sep 11 00:00:18.043903 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.043737    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-tmp-dir\") pod \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") "
Sep 11 00:00:18.043903 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.043775    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-home\") pod \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") "
Sep 11 00:00:18.043903 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.043807    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqlbn\" (UniqueName: \"kubernetes.io/projected/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-kube-api-access-mqlbn\") pod \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\" (UID: \"1b4411ac-c3d7-489f-b58a-8c6a27e710e9\") "
Sep 11 00:00:18.044141 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.044010    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-model-cache" (OuterVolumeSpecName: "model-cache") pod "1b4411ac-c3d7-489f-b58a-8c6a27e710e9" (UID: "1b4411ac-c3d7-489f-b58a-8c6a27e710e9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:00:18.044141 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.044031    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1b4411ac-c3d7-489f-b58a-8c6a27e710e9" (UID: "1b4411ac-c3d7-489f-b58a-8c6a27e710e9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:00:18.044141 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.044048    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-home" (OuterVolumeSpecName: "home") pod "1b4411ac-c3d7-489f-b58a-8c6a27e710e9" (UID: "1b4411ac-c3d7-489f-b58a-8c6a27e710e9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:00:18.044296 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.044250    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-model-cache\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:00:18.044296 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.044263    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-tmp-dir\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:00:18.044296 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.044271    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-home\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:00:18.046231 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.046206    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-dshm" (OuterVolumeSpecName: "dshm") pod "1b4411ac-c3d7-489f-b58a-8c6a27e710e9" (UID: "1b4411ac-c3d7-489f-b58a-8c6a27e710e9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:00:18.046352 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.046260    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-kube-api-access-mqlbn" (OuterVolumeSpecName: "kube-api-access-mqlbn") pod "1b4411ac-c3d7-489f-b58a-8c6a27e710e9" (UID: "1b4411ac-c3d7-489f-b58a-8c6a27e710e9"). InnerVolumeSpecName "kube-api-access-mqlbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:00:18.046444 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.046422    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1b4411ac-c3d7-489f-b58a-8c6a27e710e9" (UID: "1b4411ac-c3d7-489f-b58a-8c6a27e710e9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:00:18.145434 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.145393    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-tls-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:00:18.145434 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.145423    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-dshm\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:00:18.145434 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.145433    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqlbn\" (UniqueName: \"kubernetes.io/projected/1b4411ac-c3d7-489f-b58a-8c6a27e710e9-kube-api-access-mqlbn\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:00:18.883733 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.883649    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"
Sep 11 00:00:18.883733 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.883704    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk" event={"ID":"1b4411ac-c3d7-489f-b58a-8c6a27e710e9","Type":"ContainerDied","Data":"de131eb7f02158485c4ad0fb6c36bac4b69b56eb484612685e6b126c7075e2db"}
Sep 11 00:00:18.884206 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.883755    2581 scope.go:117] "RemoveContainer" containerID="f9c292f8f9e3fe164aa7f30e46e22d0f20586cc645659323cc0b1b521f0973ac"
Sep 11 00:00:18.900638 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.900616    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"]
Sep 11 00:00:18.904507 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:18.904486    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/auth-test-model-37692b-kserve-746b9bc6bc-bljmk"]
Sep 11 00:00:19.987364 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:19.987329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:20.483862 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:20.483829    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b4411ac-c3d7-489f-b58a-8c6a27e710e9" path="/var/lib/kubelet/pods/1b4411ac-c3d7-489f-b58a-8c6a27e710e9/volumes"
Sep 11 00:00:22.142229 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:22.142186    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:22.142643 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:22.142249    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:22.154965 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:22.154935    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:22.920817 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:22.920791    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:00:25.886508 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:25.886468    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:26.529644 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.529615    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"]
Sep 11 00:00:26.530043 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.530030    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b4411ac-c3d7-489f-b58a-8c6a27e710e9" containerName="main"
Sep 11 00:00:26.530118 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.530045    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b4411ac-c3d7-489f-b58a-8c6a27e710e9" containerName="main"
Sep 11 00:00:26.530158 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.530123    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b4411ac-c3d7-489f-b58a-8c6a27e710e9" containerName="main"
Sep 11 00:00:26.534382 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.534365    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.537474 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.537448    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-aef6df-openshift-default-dockercfg-h4trn\""
Sep 11 00:00:26.547645 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.547620    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"]
Sep 11 00:00:26.628553 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.628515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzcrp\" (UniqueName: \"kubernetes.io/projected/71ef4693-b60b-4382-83bb-8bc5aaca4930-kube-api-access-tzcrp\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.628811 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.628569    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-credential-socket\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.628811 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.628764    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ef4693-b60b-4382-83bb-8bc5aaca4930-istiod-ca-cert\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.628934 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.628827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-podinfo\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.628934 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.628854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-workload-certs\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.628934 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.628891    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-workload-socket\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.628934 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.628915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-data\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.629158 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.628950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-token\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.629158 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.629023    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-envoy\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.701703 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.701643    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:26.730628 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.730590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-envoy\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.730628 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.730630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzcrp\" (UniqueName: \"kubernetes.io/projected/71ef4693-b60b-4382-83bb-8bc5aaca4930-kube-api-access-tzcrp\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.730874 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.730654    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-credential-socket\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.730874 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.730767    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ef4693-b60b-4382-83bb-8bc5aaca4930-istiod-ca-cert\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.730874 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.730796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-podinfo\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.731040 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.730935    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-workload-certs\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.731040 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.730997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-workload-socket\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.731140 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.731025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-data\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.731198 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.731139    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-credential-socket\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.731198 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.731186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-token\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.731466 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.731433    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-workload-certs\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.731591 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.731543    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-workload-socket\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.731591 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.731557    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ef4693-b60b-4382-83bb-8bc5aaca4930-istiod-ca-cert\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.731706 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.731591    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-data\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.733300 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.733276    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-envoy\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.733452 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.733437    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-podinfo\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.739375 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.739352    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzcrp\" (UniqueName: \"kubernetes.io/projected/71ef4693-b60b-4382-83bb-8bc5aaca4930-kube-api-access-tzcrp\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.739515 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.739498    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-token\") pod \"e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") " pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:26.845512 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:26.845403    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:27.129281 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:27.129248    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"]
Sep 11 00:00:27.130048 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:00:27.130022    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ef4693_b60b_4382_83bb_8bc5aaca4930.slice/crio-954b62f470dbc6c540e8f445c276a9ff8efd8140be60bb8dd4cd48b40b64975a WatchSource:0}: Error finding container 954b62f470dbc6c540e8f445c276a9ff8efd8140be60bb8dd4cd48b40b64975a: Status 404 returned error can't find the container with id 954b62f470dbc6c540e8f445c276a9ff8efd8140be60bb8dd4cd48b40b64975a
Sep 11 00:00:27.132486 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:27.132449    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:00:27.132560 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:27.132521    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:00:27.132603 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:27.132571    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:00:27.204760 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:27.204729    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:27.303993 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:27.303947    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:27.945944 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:27.945907    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j" event={"ID":"71ef4693-b60b-4382-83bb-8bc5aaca4930","Type":"ContainerStarted","Data":"2e6f0b30d9306ac1e5f71043903b975565ef80a6aa17cac192f6599f4169dcb3"}
Sep 11 00:00:27.946147 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:27.945971    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j" event={"ID":"71ef4693-b60b-4382-83bb-8bc5aaca4930","Type":"ContainerStarted","Data":"954b62f470dbc6c540e8f445c276a9ff8efd8140be60bb8dd4cd48b40b64975a"}
Sep 11 00:00:27.969725 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:27.969647    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j" podStartSLOduration=1.9696247690000002 podStartE2EDuration="1.969624769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:00:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:00:27.967067508 +0000 UTC m=+1428.007936814" watchObservedRunningTime="2026-09-11 00:00:27.969624769 +0000 UTC m=+1428.010494078"
Sep 11 00:00:28.845695 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:28.845636    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:28.850768 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:28.850744    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:28.952548 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:28.952524    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:28.953441 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:28.953421    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:29.953522 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:29.953485    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:30.048778 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:30.048748    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:31.760009 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:31.759930    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"]
Sep 11 00:00:31.763846 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:31.763827    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"
Sep 11 00:00:31.766658 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:31.766629    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-aef6df\""
Sep 11 00:00:31.766827 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:31.766758    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-aef6df-dockercfg-msm6t\""
Sep 11 00:00:31.774012 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:31.773981    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"]
Sep 11 00:00:31.885153 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:31.885094    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnpc4\" (UniqueName: \"kubernetes.io/projected/e15c7be4-35a2-4bfe-9a66-ed4d5913388f-kube-api-access-qnpc4\") pod \"payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9\" (UID: \"e15c7be4-35a2-4bfe-9a66-ed4d5913388f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"
Sep 11 00:00:31.885402 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:31.885332    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15c7be4-35a2-4bfe-9a66-ed4d5913388f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9\" (UID: \"e15c7be4-35a2-4bfe-9a66-ed4d5913388f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"
Sep 11 00:00:31.885804 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:31.885778    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:31.985866 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:31.985835    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:31.986029 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:31.985985    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15c7be4-35a2-4bfe-9a66-ed4d5913388f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9\" (UID: \"e15c7be4-35a2-4bfe-9a66-ed4d5913388f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"
Sep 11 00:00:31.986029 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:31.986025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnpc4\" (UniqueName: \"kubernetes.io/projected/e15c7be4-35a2-4bfe-9a66-ed4d5913388f-kube-api-access-qnpc4\") pod \"payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9\" (UID: \"e15c7be4-35a2-4bfe-9a66-ed4d5913388f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"
Sep 11 00:00:31.986778 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:31.986759    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15c7be4-35a2-4bfe-9a66-ed4d5913388f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9\" (UID: \"e15c7be4-35a2-4bfe-9a66-ed4d5913388f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"
Sep 11 00:00:31.995301 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:31.995282    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnpc4\" (UniqueName: \"kubernetes.io/projected/e15c7be4-35a2-4bfe-9a66-ed4d5913388f-kube-api-access-qnpc4\") pod \"payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9\" (UID: \"e15c7be4-35a2-4bfe-9a66-ed4d5913388f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"
Sep 11 00:00:32.083599 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:32.083509    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"
Sep 11 00:00:32.361123 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:32.361096    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"]
Sep 11 00:00:32.362393 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:00:32.362362    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15c7be4_35a2_4bfe_9a66_ed4d5913388f.slice/crio-f724f885ff6bf0c5aea333430a98f76ab12e2d6d8863b6c34f6cd2ef2df0be45 WatchSource:0}: Error finding container f724f885ff6bf0c5aea333430a98f76ab12e2d6d8863b6c34f6cd2ef2df0be45: Status 404 returned error can't find the container with id f724f885ff6bf0c5aea333430a98f76ab12e2d6d8863b6c34f6cd2ef2df0be45
Sep 11 00:00:32.982179 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:32.982146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9" event={"ID":"e15c7be4-35a2-4bfe-9a66-ed4d5913388f","Type":"ContainerStarted","Data":"db38e4db72591108e121a52b865fcef22b2275f3707fdcf8f3196fbbe35556ae"}
Sep 11 00:00:32.982711 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:32.982208    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9" event={"ID":"e15c7be4-35a2-4bfe-9a66-ed4d5913388f","Type":"ContainerStarted","Data":"f724f885ff6bf0c5aea333430a98f76ab12e2d6d8863b6c34f6cd2ef2df0be45"}
Sep 11 00:00:32.982711 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:32.982343    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"
Sep 11 00:00:32.999232 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:32.999181    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9" podStartSLOduration=1.999164196 podStartE2EDuration="1.999164196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:00:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:00:32.997303805 +0000 UTC m=+1433.038173113" watchObservedRunningTime="2026-09-11 00:00:32.999164196 +0000 UTC m=+1433.040033500"
Sep 11 00:00:40.724589 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:40.724539    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:00:43.992832 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:43.992791    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"
Sep 11 00:00:53.128392 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:53.128353    2581 generic.go:356] "Generic (PLEG): container finished" podID="71ef4693-b60b-4382-83bb-8bc5aaca4930" containerID="2e6f0b30d9306ac1e5f71043903b975565ef80a6aa17cac192f6599f4169dcb3" exitCode=0
Sep 11 00:00:53.128984 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:53.128432    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j" event={"ID":"71ef4693-b60b-4382-83bb-8bc5aaca4930","Type":"ContainerDied","Data":"2e6f0b30d9306ac1e5f71043903b975565ef80a6aa17cac192f6599f4169dcb3"}
Sep 11 00:00:53.129059 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:53.128980    2581 scope.go:117] "RemoveContainer" containerID="2e6f0b30d9306ac1e5f71043903b975565ef80a6aa17cac192f6599f4169dcb3"
Sep 11 00:00:53.130206 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:53.130180    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:00:53.130271 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:53.130246    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:00:53.130311 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:53.130279    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:00:54.143624 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:54.143583    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j" event={"ID":"71ef4693-b60b-4382-83bb-8bc5aaca4930","Type":"ContainerStarted","Data":"49373f8be45c8bd7dc428fc02a4cf5e1914e1fc8703f5f124e117728ac3fa90b"}
Sep 11 00:00:54.805352 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:54.805319    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:54.846391 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:54.846351    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:54.847599 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:54.847572    2581 patch_prober.go:28] interesting pod/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 11 00:00:54.847756 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:54.847623    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j" podUID="71ef4693-b60b-4382-83bb-8bc5aaca4930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 11 00:00:55.258269 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.258237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:55.536292 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.536210    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"]
Sep 11 00:00:55.539279 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.539254    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.542401 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.542381    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5ee885-openshift-default-dockercfg-j2d4f\""
Sep 11 00:00:55.554208 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.554181    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"]
Sep 11 00:00:55.578695 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.575243    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:55.617878 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.617834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-credential-socket\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.617878 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.617873    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-envoy\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.618149 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.617973    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-podinfo\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.618149 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.618016    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-token\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.618149 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.618038    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istiod-ca-cert\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.618149 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.618099    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-data\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.618149 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.618152    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-workload-certs\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.618434 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.618272    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjhdx\" (UniqueName: \"kubernetes.io/projected/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-kube-api-access-sjhdx\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.618434 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.618365    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-workload-socket\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.719303 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.719263    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjhdx\" (UniqueName: \"kubernetes.io/projected/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-kube-api-access-sjhdx\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.719481 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.719320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-workload-socket\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.719481 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.719367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-credential-socket\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.719481 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.719394    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-envoy\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.719481 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.719427    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-podinfo\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.719625 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.719546    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-token\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.719625 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.719587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istiod-ca-cert\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.719730 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.719636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-data\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.719765 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.719723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-workload-certs\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.720033 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.719864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-credential-socket\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.720314 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.720077    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-workload-certs\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.720314 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.720284    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-workload-socket\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.720314 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.720251    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-data\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.720486 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.720329    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istiod-ca-cert\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.721951 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.721923    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-envoy\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.722286 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.722268    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-podinfo\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.727986 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.727963    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-token\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.728157 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.728139    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjhdx\" (UniqueName: \"kubernetes.io/projected/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-kube-api-access-sjhdx\") pod \"e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") " pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.846434 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.846328    2581 patch_prober.go:28] interesting pod/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 11 00:00:55.846434 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.846405    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j" podUID="71ef4693-b60b-4382-83bb-8bc5aaca4930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 11 00:00:55.850118 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.850095    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:55.951126 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:55.951097    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:56.162740 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:56.162704    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"]
Sep 11 00:00:56.163813 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:00:56.163774    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bbfeaa8_65ec_4f58_b950_bb02bd46d8d5.slice/crio-0de6d696163d2625eb7f3cb70ad0f5474977129a950885b47c704107bd09eca9 WatchSource:0}: Error finding container 0de6d696163d2625eb7f3cb70ad0f5474977129a950885b47c704107bd09eca9: Status 404 returned error can't find the container with id 0de6d696163d2625eb7f3cb70ad0f5474977129a950885b47c704107bd09eca9
Sep 11 00:00:56.168971 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:56.168924    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:00:56.169104 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:56.169018    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:00:56.169104 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:56.169066    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:00:56.846102 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:56.846071    2581 patch_prober.go:28] interesting pod/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 11 00:00:56.846542 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:56.846128    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j" podUID="71ef4693-b60b-4382-83bb-8bc5aaca4930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 11 00:00:57.166661 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:57.166557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr" event={"ID":"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5","Type":"ContainerStarted","Data":"e88f3203b9789b42908b3e65dbe72f8721b33511a1b0f09865a04d8f829c812f"}
Sep 11 00:00:57.166661 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:57.166629    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr" event={"ID":"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5","Type":"ContainerStarted","Data":"0de6d696163d2625eb7f3cb70ad0f5474977129a950885b47c704107bd09eca9"}
Sep 11 00:00:57.193312 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:57.193241    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr" podStartSLOduration=2.193219211 podStartE2EDuration="2.193219211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:00:57.187920019 +0000 UTC m=+1457.228789348" watchObservedRunningTime="2026-09-11 00:00:57.193219211 +0000 UTC m=+1457.234088516"
Sep 11 00:00:57.845790 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:57.845753    2581 patch_prober.go:28] interesting pod/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 11 00:00:57.845972 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:57.845808    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j" podUID="71ef4693-b60b-4382-83bb-8bc5aaca4930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 11 00:00:57.851046 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:57.851024    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:57.856587 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:57.856564    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:58.177222 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:58.177136    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:58.184468 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:58.184439    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:00:58.846411 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:58.846377    2581 patch_prober.go:28] interesting pod/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 11 00:00:58.846597 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:58.846449    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j" podUID="71ef4693-b60b-4382-83bb-8bc5aaca4930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 11 00:00:58.953155 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:58.953120    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:00:59.204876 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:59.204841    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:59.300196 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:59.300165    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:00:59.846117 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:59.846079    2581 patch_prober.go:28] interesting pod/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 11 00:00:59.846329 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:00:59.846161    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j" podUID="71ef4693-b60b-4382-83bb-8bc5aaca4930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 11 00:01:00.380136 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:00.380098    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:00.473013 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:00.472981    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:00.850660 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:00.850630    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:01:00.851774 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:00.851753    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:01:00.955079 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:00.955040    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:01.057988 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:01.057936    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:02.105977 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:02.105944    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:02.979830 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:02.979793    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:03.714167 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:03.714136    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:06.126603 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:06.126570    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:01:17.331716 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:17.331641    2581 generic.go:356] "Generic (PLEG): container finished" podID="5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" containerID="e88f3203b9789b42908b3e65dbe72f8721b33511a1b0f09865a04d8f829c812f" exitCode=0
Sep 11 00:01:17.332140 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:17.331716    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr" event={"ID":"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5","Type":"ContainerDied","Data":"e88f3203b9789b42908b3e65dbe72f8721b33511a1b0f09865a04d8f829c812f"}
Sep 11 00:01:17.332184 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:17.332140    2581 scope.go:117] "RemoveContainer" containerID="e88f3203b9789b42908b3e65dbe72f8721b33511a1b0f09865a04d8f829c812f"
Sep 11 00:01:17.333440 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:17.333409    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:01:17.333506 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:17.333486    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:01:17.333541 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:17.333526    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:01:18.340301 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:18.340263    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr" event={"ID":"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5","Type":"ContainerStarted","Data":"04e6c020a920a98f46de166370e9ad0f44ce6bc83333f885a06f6f1cf872a1a1"}
Sep 11 00:01:18.851066 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:18.851028    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:01:18.851278 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:18.851257    2581 patch_prober.go:28] interesting pod/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 11 00:01:18.851327 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:18.851303    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr" podUID="5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 11 00:01:19.850920 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:19.850890    2581 patch_prober.go:28] interesting pod/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 11 00:01:19.851321 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:19.850944    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr" podUID="5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 11 00:01:20.850937 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:20.850892    2581 patch_prober.go:28] interesting pod/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 11 00:01:20.851368 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:20.850961    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr" podUID="5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 11 00:01:21.851287 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:21.851253    2581 patch_prober.go:28] interesting pod/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 11 00:01:21.851727 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:21.851308    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr" podUID="5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 11 00:01:22.851116 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:22.851079    2581 patch_prober.go:28] interesting pod/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 11 00:01:22.851313 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:22.851136    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr" podUID="5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 11 00:01:23.668155 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:23.668113    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:23.851063 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:23.851028    2581 patch_prober.go:28] interesting pod/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 11 00:01:23.851245 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:23.851080    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr" podUID="5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 11 00:01:24.021453 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:24.021416    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:24.341589 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:24.341473    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7841-dd83c9"]
Sep 11 00:01:24.344402 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:24.344376    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7841-dd83c9"
Sep 11 00:01:24.347737 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:24.347713    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k9g2h\""
Sep 11 00:01:24.352731 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:24.352684    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7841-dd83c9"]
Sep 11 00:01:24.417857 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:24.417815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq5c8\" (UniqueName: \"kubernetes.io/projected/38ca5532-5c87-4227-86ba-200ac449253d-kube-api-access-tq5c8\") pod \"test-curl-7841-dd83c9\" (UID: \"38ca5532-5c87-4227-86ba-200ac449253d\") " pod="opendatahub/test-curl-7841-dd83c9"
Sep 11 00:01:24.519218 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:24.519177    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq5c8\" (UniqueName: \"kubernetes.io/projected/38ca5532-5c87-4227-86ba-200ac449253d-kube-api-access-tq5c8\") pod \"test-curl-7841-dd83c9\" (UID: \"38ca5532-5c87-4227-86ba-200ac449253d\") " pod="opendatahub/test-curl-7841-dd83c9"
Sep 11 00:01:24.529219 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:24.529195    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq5c8\" (UniqueName: \"kubernetes.io/projected/38ca5532-5c87-4227-86ba-200ac449253d-kube-api-access-tq5c8\") pod \"test-curl-7841-dd83c9\" (UID: \"38ca5532-5c87-4227-86ba-200ac449253d\") " pod="opendatahub/test-curl-7841-dd83c9"
Sep 11 00:01:24.655114 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:24.654997    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7841-dd83c9"
Sep 11 00:01:24.855681 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:24.855649    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:01:24.856038 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:24.856019    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:01:24.856640 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:24.856626    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:01:24.931304 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:24.931281    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7841-dd83c9"]
Sep 11 00:01:24.933756 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:01:24.933726    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38ca5532_5c87_4227_86ba_200ac449253d.slice/crio-be2d5c03649559ba370a9e82e839b6b1824f74548896cfaa72771923693df77b WatchSource:0}: Error finding container be2d5c03649559ba370a9e82e839b6b1824f74548896cfaa72771923693df77b: Status 404 returned error can't find the container with id be2d5c03649559ba370a9e82e839b6b1824f74548896cfaa72771923693df77b
Sep 11 00:01:25.399228 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:25.399159    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7841-dd83c9" event={"ID":"38ca5532-5c87-4227-86ba-200ac449253d","Type":"ContainerStarted","Data":"f0b3e79a31f6915695d0cf62cc09660b9c47cb3421c6a376ea7fb8d0edea0d90"}
Sep 11 00:01:25.399228 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:25.399228    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7841-dd83c9" event={"ID":"38ca5532-5c87-4227-86ba-200ac449253d","Type":"ContainerStarted","Data":"be2d5c03649559ba370a9e82e839b6b1824f74548896cfaa72771923693df77b"}
Sep 11 00:01:25.415296 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:25.415252    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7841-dd83c9" podStartSLOduration=1.41523404 podStartE2EDuration="1.41523404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:01:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:01:25.412757271 +0000 UTC m=+1485.453626576" watchObservedRunningTime="2026-09-11 00:01:25.41523404 +0000 UTC m=+1485.456103346"
Sep 11 00:01:26.029173 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:26.029130    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7841-dd83c9"]
Sep 11 00:01:26.033131 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:26.033088    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7841-dd83c9"]
Sep 11 00:01:26.158918 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:26.158836    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7841-b07066"]
Sep 11 00:01:26.159303 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:26.159288    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38ca5532-5c87-4227-86ba-200ac449253d" containerName="test-curl-7841-dd83c9"
Sep 11 00:01:26.159303 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:26.159304    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ca5532-5c87-4227-86ba-200ac449253d" containerName="test-curl-7841-dd83c9"
Sep 11 00:01:26.159387 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:26.159381    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="38ca5532-5c87-4227-86ba-200ac449253d" containerName="test-curl-7841-dd83c9"
Sep 11 00:01:26.161511 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:26.161495    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7841-b07066"
Sep 11 00:01:26.167302 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:26.167017    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7841-b07066"]
Sep 11 00:01:26.237838 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:26.237805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8cgt\" (UniqueName: \"kubernetes.io/projected/75785b3f-6a0b-4309-940b-a0c085d46797-kube-api-access-c8cgt\") pod \"test-curl-7841-b07066\" (UID: \"75785b3f-6a0b-4309-940b-a0c085d46797\") " pod="opendatahub/test-curl-7841-b07066"
Sep 11 00:01:26.339085 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:26.339050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8cgt\" (UniqueName: \"kubernetes.io/projected/75785b3f-6a0b-4309-940b-a0c085d46797-kube-api-access-c8cgt\") pod \"test-curl-7841-b07066\" (UID: \"75785b3f-6a0b-4309-940b-a0c085d46797\") " pod="opendatahub/test-curl-7841-b07066"
Sep 11 00:01:26.348798 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:26.348765    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8cgt\" (UniqueName: \"kubernetes.io/projected/75785b3f-6a0b-4309-940b-a0c085d46797-kube-api-access-c8cgt\") pod \"test-curl-7841-b07066\" (UID: \"75785b3f-6a0b-4309-940b-a0c085d46797\") " pod="opendatahub/test-curl-7841-b07066"
Sep 11 00:01:26.405564 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:01:26.405530    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7841-dd83c9" container="test-curl-7841-dd83c9"
Sep 11 00:01:26.472884 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:26.472851    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7841-b07066"
Sep 11 00:01:26.748865 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:26.748835    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7841-b07066"]
Sep 11 00:01:26.750344 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:01:26.750320    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75785b3f_6a0b_4309_940b_a0c085d46797.slice/crio-15321f7b43e5eb2fc50b5389bce07bc6412f548cb969d821837ff6bf92d82216 WatchSource:0}: Error finding container 15321f7b43e5eb2fc50b5389bce07bc6412f548cb969d821837ff6bf92d82216: Status 404 returned error can't find the container with id 15321f7b43e5eb2fc50b5389bce07bc6412f548cb969d821837ff6bf92d82216
Sep 11 00:01:27.413099 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:27.413058    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7841-b07066" event={"ID":"75785b3f-6a0b-4309-940b-a0c085d46797","Type":"ContainerStarted","Data":"6a5f22206194d96c6e93000c8cb1a7c918d5015587b4187f653c50e28ad1c41c"}
Sep 11 00:01:27.413571 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:27.413105    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7841-b07066" event={"ID":"75785b3f-6a0b-4309-940b-a0c085d46797","Type":"ContainerStarted","Data":"15321f7b43e5eb2fc50b5389bce07bc6412f548cb969d821837ff6bf92d82216"}
Sep 11 00:01:27.413571 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:27.413143    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7841-dd83c9" podUID="38ca5532-5c87-4227-86ba-200ac449253d" containerName="test-curl-7841-dd83c9" containerID="cri-o://f0b3e79a31f6915695d0cf62cc09660b9c47cb3421c6a376ea7fb8d0edea0d90" gracePeriod=2
Sep 11 00:01:27.429442 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:27.429392    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7841-b07066" podStartSLOduration=1.429374229 podStartE2EDuration="1.429374229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:01:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:01:27.426635692 +0000 UTC m=+1487.467505009" watchObservedRunningTime="2026-09-11 00:01:27.429374229 +0000 UTC m=+1487.470243533"
Sep 11 00:01:28.040941 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:28.040907    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7841-b07066"]
Sep 11 00:01:28.045038 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:28.045005    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7841-b07066"]
Sep 11 00:01:28.419948 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:01:28.419915    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7841-b07066" container="test-curl-7841-b07066"
Sep 11 00:01:28.945758 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:28.945719    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:01:29.358408 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:29.358374    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:29.434310 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:29.434261    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7841-b07066" podUID="75785b3f-6a0b-4309-940b-a0c085d46797" containerName="test-curl-7841-b07066" containerID="cri-o://6a5f22206194d96c6e93000c8cb1a7c918d5015587b4187f653c50e28ad1c41c" gracePeriod=2
Sep 11 00:01:29.602704 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:29.602664    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7841-dd83c9"
Sep 11 00:01:29.671892 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:29.671800    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq5c8\" (UniqueName: \"kubernetes.io/projected/38ca5532-5c87-4227-86ba-200ac449253d-kube-api-access-tq5c8\") pod \"38ca5532-5c87-4227-86ba-200ac449253d\" (UID: \"38ca5532-5c87-4227-86ba-200ac449253d\") "
Sep 11 00:01:29.674207 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:29.674175    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ca5532-5c87-4227-86ba-200ac449253d-kube-api-access-tq5c8" (OuterVolumeSpecName: "kube-api-access-tq5c8") pod "38ca5532-5c87-4227-86ba-200ac449253d" (UID: "38ca5532-5c87-4227-86ba-200ac449253d"). InnerVolumeSpecName "kube-api-access-tq5c8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:01:29.772815 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:29.772766    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq5c8\" (UniqueName: \"kubernetes.io/projected/38ca5532-5c87-4227-86ba-200ac449253d-kube-api-access-tq5c8\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:30.170839 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:30.170798    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"]
Sep 11 00:01:30.191877 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:30.191848    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:30.442205 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:30.442108    2581 generic.go:356] "Generic (PLEG): container finished" podID="38ca5532-5c87-4227-86ba-200ac449253d" containerID="f0b3e79a31f6915695d0cf62cc09660b9c47cb3421c6a376ea7fb8d0edea0d90" exitCode=137
Sep 11 00:01:30.442205 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:30.442153    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7841-dd83c9"
Sep 11 00:01:30.442659 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:30.442220    2581 scope.go:117] "RemoveContainer" containerID="f0b3e79a31f6915695d0cf62cc09660b9c47cb3421c6a376ea7fb8d0edea0d90"
Sep 11 00:01:30.452682 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:01:30.452612    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7841-dd83c9\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="38ca5532-5c87-4227-86ba-200ac449253d" pod="opendatahub/test-curl-7841-dd83c9"
Sep 11 00:01:30.452758 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:30.452734    2581 scope.go:117] "RemoveContainer" containerID="f0b3e79a31f6915695d0cf62cc09660b9c47cb3421c6a376ea7fb8d0edea0d90"
Sep 11 00:01:30.453043 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:01:30.453027    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0b3e79a31f6915695d0cf62cc09660b9c47cb3421c6a376ea7fb8d0edea0d90\": container with ID starting with f0b3e79a31f6915695d0cf62cc09660b9c47cb3421c6a376ea7fb8d0edea0d90 not found: ID does not exist" containerID="f0b3e79a31f6915695d0cf62cc09660b9c47cb3421c6a376ea7fb8d0edea0d90"
Sep 11 00:01:30.453084 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:30.453053    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0b3e79a31f6915695d0cf62cc09660b9c47cb3421c6a376ea7fb8d0edea0d90"} err="failed to get container status \"f0b3e79a31f6915695d0cf62cc09660b9c47cb3421c6a376ea7fb8d0edea0d90\": rpc error: code = NotFound desc = could not find container \"f0b3e79a31f6915695d0cf62cc09660b9c47cb3421c6a376ea7fb8d0edea0d90\": container with ID starting with f0b3e79a31f6915695d0cf62cc09660b9c47cb3421c6a376ea7fb8d0edea0d90 not found: ID does not exist"
Sep 11 00:01:30.482853 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:01:30.482811    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7841-dd83c9\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="38ca5532-5c87-4227-86ba-200ac449253d" pod="opendatahub/test-curl-7841-dd83c9"
Sep 11 00:01:30.484822 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:30.484792    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38ca5532-5c87-4227-86ba-200ac449253d" path="/var/lib/kubelet/pods/38ca5532-5c87-4227-86ba-200ac449253d/volumes"
Sep 11 00:01:31.206404 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:31.206352    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:31.304554 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:31.304521    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:31.629429 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:31.629406    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7841-b07066"
Sep 11 00:01:31.692775 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:31.692742    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8cgt\" (UniqueName: \"kubernetes.io/projected/75785b3f-6a0b-4309-940b-a0c085d46797-kube-api-access-c8cgt\") pod \"75785b3f-6a0b-4309-940b-a0c085d46797\" (UID: \"75785b3f-6a0b-4309-940b-a0c085d46797\") "
Sep 11 00:01:31.695011 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:31.694975    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75785b3f-6a0b-4309-940b-a0c085d46797-kube-api-access-c8cgt" (OuterVolumeSpecName: "kube-api-access-c8cgt") pod "75785b3f-6a0b-4309-940b-a0c085d46797" (UID: "75785b3f-6a0b-4309-940b-a0c085d46797"). InnerVolumeSpecName "kube-api-access-c8cgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:01:31.793896 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:31.793811    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8cgt\" (UniqueName: \"kubernetes.io/projected/75785b3f-6a0b-4309-940b-a0c085d46797-kube-api-access-c8cgt\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:32.306583 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.306548    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv"]
Sep 11 00:01:32.307018 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.307005    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75785b3f-6a0b-4309-940b-a0c085d46797" containerName="test-curl-7841-b07066"
Sep 11 00:01:32.307067 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.307020    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="75785b3f-6a0b-4309-940b-a0c085d46797" containerName="test-curl-7841-b07066"
Sep 11 00:01:32.307108 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.307104    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="75785b3f-6a0b-4309-940b-a0c085d46797" containerName="test-curl-7841-b07066"
Sep 11 00:01:32.309102 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.309087    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv"
Sep 11 00:01:32.311713 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.311694    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 00:01:32.311985 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.311971    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22lrj\""
Sep 11 00:01:32.319558 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.319534    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv"]
Sep 11 00:01:32.399285 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.399253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/138f3e29-a988-4fe3-aab4-b10d93d42b7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv\" (UID: \"138f3e29-a988-4fe3-aab4-b10d93d42b7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv"
Sep 11 00:01:32.426936 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.426904    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:32.457522 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.457490    2581 generic.go:356] "Generic (PLEG): container finished" podID="75785b3f-6a0b-4309-940b-a0c085d46797" containerID="6a5f22206194d96c6e93000c8cb1a7c918d5015587b4187f653c50e28ad1c41c" exitCode=137
Sep 11 00:01:32.457711 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.457539    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7841-b07066"
Sep 11 00:01:32.457711 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.457590    2581 scope.go:117] "RemoveContainer" containerID="6a5f22206194d96c6e93000c8cb1a7c918d5015587b4187f653c50e28ad1c41c"
Sep 11 00:01:32.467541 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:01:32.467498    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7841-b07066\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="75785b3f-6a0b-4309-940b-a0c085d46797" pod="opendatahub/test-curl-7841-b07066"
Sep 11 00:01:32.468132 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.468109    2581 scope.go:117] "RemoveContainer" containerID="6a5f22206194d96c6e93000c8cb1a7c918d5015587b4187f653c50e28ad1c41c"
Sep 11 00:01:32.468419 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:01:32.468398    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a5f22206194d96c6e93000c8cb1a7c918d5015587b4187f653c50e28ad1c41c\": container with ID starting with 6a5f22206194d96c6e93000c8cb1a7c918d5015587b4187f653c50e28ad1c41c not found: ID does not exist" containerID="6a5f22206194d96c6e93000c8cb1a7c918d5015587b4187f653c50e28ad1c41c"
Sep 11 00:01:32.468483 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.468428    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a5f22206194d96c6e93000c8cb1a7c918d5015587b4187f653c50e28ad1c41c"} err="failed to get container status \"6a5f22206194d96c6e93000c8cb1a7c918d5015587b4187f653c50e28ad1c41c\": rpc error: code = NotFound desc = could not find container \"6a5f22206194d96c6e93000c8cb1a7c918d5015587b4187f653c50e28ad1c41c\": container with ID starting with 6a5f22206194d96c6e93000c8cb1a7c918d5015587b4187f653c50e28ad1c41c not found: ID does not exist"
Sep 11 00:01:32.483656 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.483626    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75785b3f-6a0b-4309-940b-a0c085d46797" path="/var/lib/kubelet/pods/75785b3f-6a0b-4309-940b-a0c085d46797/volumes"
Sep 11 00:01:32.500343 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.500307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/138f3e29-a988-4fe3-aab4-b10d93d42b7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv\" (UID: \"138f3e29-a988-4fe3-aab4-b10d93d42b7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv"
Sep 11 00:01:32.501166 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.501141    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/138f3e29-a988-4fe3-aab4-b10d93d42b7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv\" (UID: \"138f3e29-a988-4fe3-aab4-b10d93d42b7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv"
Sep 11 00:01:32.621662 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.621577    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv"
Sep 11 00:01:32.903708 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:32.903681    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv"]
Sep 11 00:01:32.905151 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:01:32.905125    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138f3e29_a988_4fe3_aab4_b10d93d42b7c.slice/crio-f2f1afc0e269b3efa9702d6d5c1d9885c6b4aa5cd7118a43550fe746432f4944 WatchSource:0}: Error finding container f2f1afc0e269b3efa9702d6d5c1d9885c6b4aa5cd7118a43550fe746432f4944: Status 404 returned error can't find the container with id f2f1afc0e269b3efa9702d6d5c1d9885c6b4aa5cd7118a43550fe746432f4944
Sep 11 00:01:33.330946 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:33.330911    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:33.466212 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:33.466182    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv" event={"ID":"138f3e29-a988-4fe3-aab4-b10d93d42b7c","Type":"ContainerStarted","Data":"71cfda8e5093c7837d2369bd1cf2ad44bfab541ffdbf8fb4da266350fc774591"}
Sep 11 00:01:33.466471 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:33.466455    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv" event={"ID":"138f3e29-a988-4fe3-aab4-b10d93d42b7c","Type":"ContainerStarted","Data":"f2f1afc0e269b3efa9702d6d5c1d9885c6b4aa5cd7118a43550fe746432f4944"}
Sep 11 00:01:33.484279 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:33.484228    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv" podStartSLOduration=1.48421262 podStartE2EDuration="1.48421262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:01:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:01:33.48152 +0000 UTC m=+1493.522389305" watchObservedRunningTime="2026-09-11 00:01:33.48421262 +0000 UTC m=+1493.525081925"
Sep 11 00:01:34.478326 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:34.478288    2581 generic.go:356] "Generic (PLEG): container finished" podID="138f3e29-a988-4fe3-aab4-b10d93d42b7c" containerID="71cfda8e5093c7837d2369bd1cf2ad44bfab541ffdbf8fb4da266350fc774591" exitCode=0
Sep 11 00:01:34.484163 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:34.484133    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv" event={"ID":"138f3e29-a988-4fe3-aab4-b10d93d42b7c","Type":"ContainerDied","Data":"71cfda8e5093c7837d2369bd1cf2ad44bfab541ffdbf8fb4da266350fc774591"}
Sep 11 00:01:34.501126 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:34.501089    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:35.491858 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:35.491828    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:35.592923 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:35.592891    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:35.625134 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:35.625105    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv"
Sep 11 00:01:35.733306 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:35.733272    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/138f3e29-a988-4fe3-aab4-b10d93d42b7c-maas-api-service-ca\") pod \"138f3e29-a988-4fe3-aab4-b10d93d42b7c\" (UID: \"138f3e29-a988-4fe3-aab4-b10d93d42b7c\") "
Sep 11 00:01:35.733703 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:35.733659    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/138f3e29-a988-4fe3-aab4-b10d93d42b7c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "138f3e29-a988-4fe3-aab4-b10d93d42b7c" (UID: "138f3e29-a988-4fe3-aab4-b10d93d42b7c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:01:35.835021 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:35.834924    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/138f3e29-a988-4fe3-aab4-b10d93d42b7c-maas-api-service-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:36.493007 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:36.492966    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv"
Sep 11 00:01:36.493371 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:36.492969    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv" event={"ID":"138f3e29-a988-4fe3-aab4-b10d93d42b7c","Type":"ContainerDied","Data":"f2f1afc0e269b3efa9702d6d5c1d9885c6b4aa5cd7118a43550fe746432f4944"}
Sep 11 00:01:36.493371 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:36.493088    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2f1afc0e269b3efa9702d6d5c1d9885c6b4aa5cd7118a43550fe746432f4944"
Sep 11 00:01:40.229919 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.229874    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"]
Sep 11 00:01:40.230513 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.230492    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="138f3e29-a988-4fe3-aab4-b10d93d42b7c" containerName="revoke-keys"
Sep 11 00:01:40.230617 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.230516    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="138f3e29-a988-4fe3-aab4-b10d93d42b7c" containerName="revoke-keys"
Sep 11 00:01:40.230701 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.230633    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="138f3e29-a988-4fe3-aab4-b10d93d42b7c" containerName="revoke-keys"
Sep 11 00:01:40.232889 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.232867    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.235432 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.235407    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-37692b\"/\"rate-test-model-37692b-kserve-self-signed-certs\""
Sep 11 00:01:40.243974 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.243938    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"]
Sep 11 00:01:40.258327 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.258289    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:40.284376 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.284341    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-dshm\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.284376 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.284375    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-model-cache\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.284580 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.284472    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-tmp-dir\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.284580 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.284517    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-home\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.284580 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.284541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flj49\" (UniqueName: \"kubernetes.io/projected/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-kube-api-access-flj49\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.284580 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.284576    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-tls-certs\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.385816 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.385773    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-tmp-dir\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.385979 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.385836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-home\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.385979 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.385866    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flj49\" (UniqueName: \"kubernetes.io/projected/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-kube-api-access-flj49\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.385979 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.385910    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-tls-certs\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.385979 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.385965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-dshm\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.386208 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.385990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-model-cache\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.386275 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.386257    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-tmp-dir\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.386328 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.386302    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-home\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.386369 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.386324    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-model-cache\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.388314 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.388289    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-37692b\"/\"rate-test-model-37692b-kserve-self-signed-certs\""
Sep 11 00:01:40.388467 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.388362    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-dshm\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.393790 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.393760    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flj49\" (UniqueName: \"kubernetes.io/projected/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-kube-api-access-flj49\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.399123 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.399095    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-tls-certs\") pod \"rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") " pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.544458 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.544361    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:40.808320 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.808234    2581 scope.go:117] "RemoveContainer" containerID="953ca40cd9b4cf74f93d957fa2e9218be4ed89938bd4984593cd1c2c87b575e6"
Sep 11 00:01:40.818107 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.818082    2581 scope.go:117] "RemoveContainer" containerID="aa265116d0a72fb3115779ab042a1ee02f393e023a123070924051e2f87918f8"
Sep 11 00:01:40.827067 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.827044    2581 scope.go:117] "RemoveContainer" containerID="e5a5ebe92f03295414a756852eed6789bd2cc14800879a7ab3b5a133a9b57285"
Sep 11 00:01:40.830224 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:40.830199    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"]
Sep 11 00:01:40.831965 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:01:40.831934    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaeaa8b73_4f2b_4c3e_aba2_9c7560e09f0e.slice/crio-4460d82044a6eef84967a3e6b2d4bed8393bf3dc53af7d03754bf7e13013430a WatchSource:0}: Error finding container 4460d82044a6eef84967a3e6b2d4bed8393bf3dc53af7d03754bf7e13013430a: Status 404 returned error can't find the container with id 4460d82044a6eef84967a3e6b2d4bed8393bf3dc53af7d03754bf7e13013430a
Sep 11 00:01:41.526551 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:41.526513    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb" event={"ID":"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e","Type":"ContainerStarted","Data":"f025c966a6c30883b73ccaee1eda840a7ef73b7bf9898cc88d48374882078993"}
Sep 11 00:01:41.526551 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:41.526557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb" event={"ID":"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e","Type":"ContainerStarted","Data":"4460d82044a6eef84967a3e6b2d4bed8393bf3dc53af7d03754bf7e13013430a"}
Sep 11 00:01:41.545127 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:41.545076    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb" podStartSLOduration=1.545057424 podStartE2EDuration="1.545057424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:01:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:01:41.542962254 +0000 UTC m=+1501.583831558" watchObservedRunningTime="2026-09-11 00:01:41.545057424 +0000 UTC m=+1501.585926769"
Sep 11 00:01:45.192929 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.192887    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2" podUID="3d248342-46db-4e44-a82c-dd1f3cb614af" containerName="main" containerID="cri-o://cf3d039b17c476f63ac67be2900b6024f88c6ee79277f09bed41b192ea55327e" gracePeriod=45
Sep 11 00:01:45.458562 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.458538    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:01:45.541254 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.541219    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d248342-46db-4e44-a82c-dd1f3cb614af-tls-certs\") pod \"3d248342-46db-4e44-a82c-dd1f3cb614af\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") "
Sep 11 00:01:45.541254 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.541261    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-tmp-dir\") pod \"3d248342-46db-4e44-a82c-dd1f3cb614af\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") "
Sep 11 00:01:45.541527 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.541318    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-model-cache\") pod \"3d248342-46db-4e44-a82c-dd1f3cb614af\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") "
Sep 11 00:01:45.541527 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.541347    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-dshm\") pod \"3d248342-46db-4e44-a82c-dd1f3cb614af\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") "
Sep 11 00:01:45.541527 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.541383    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-home\") pod \"3d248342-46db-4e44-a82c-dd1f3cb614af\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") "
Sep 11 00:01:45.541527 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.541461    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrkld\" (UniqueName: \"kubernetes.io/projected/3d248342-46db-4e44-a82c-dd1f3cb614af-kube-api-access-rrkld\") pod \"3d248342-46db-4e44-a82c-dd1f3cb614af\" (UID: \"3d248342-46db-4e44-a82c-dd1f3cb614af\") "
Sep 11 00:01:45.541791 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.541622    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-model-cache" (OuterVolumeSpecName: "model-cache") pod "3d248342-46db-4e44-a82c-dd1f3cb614af" (UID: "3d248342-46db-4e44-a82c-dd1f3cb614af"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:45.541791 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.541635    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3d248342-46db-4e44-a82c-dd1f3cb614af" (UID: "3d248342-46db-4e44-a82c-dd1f3cb614af"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:45.541791 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.541761    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-home" (OuterVolumeSpecName: "home") pod "3d248342-46db-4e44-a82c-dd1f3cb614af" (UID: "3d248342-46db-4e44-a82c-dd1f3cb614af"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:45.542173 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.541941    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-model-cache\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:45.542173 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.541969    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-home\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:45.542173 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.541983    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-tmp-dir\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:45.543729 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.543704    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-dshm" (OuterVolumeSpecName: "dshm") pod "3d248342-46db-4e44-a82c-dd1f3cb614af" (UID: "3d248342-46db-4e44-a82c-dd1f3cb614af"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:45.543868 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.543762    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d248342-46db-4e44-a82c-dd1f3cb614af-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3d248342-46db-4e44-a82c-dd1f3cb614af" (UID: "3d248342-46db-4e44-a82c-dd1f3cb614af"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:01:45.543868 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.543863    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d248342-46db-4e44-a82c-dd1f3cb614af-kube-api-access-rrkld" (OuterVolumeSpecName: "kube-api-access-rrkld") pod "3d248342-46db-4e44-a82c-dd1f3cb614af" (UID: "3d248342-46db-4e44-a82c-dd1f3cb614af"). InnerVolumeSpecName "kube-api-access-rrkld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:01:45.554293 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.554269    2581 generic.go:356] "Generic (PLEG): container finished" podID="3d248342-46db-4e44-a82c-dd1f3cb614af" containerID="cf3d039b17c476f63ac67be2900b6024f88c6ee79277f09bed41b192ea55327e" exitCode=0
Sep 11 00:01:45.554417 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.554377    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"
Sep 11 00:01:45.554486 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.554413    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2" event={"ID":"3d248342-46db-4e44-a82c-dd1f3cb614af","Type":"ContainerDied","Data":"cf3d039b17c476f63ac67be2900b6024f88c6ee79277f09bed41b192ea55327e"}
Sep 11 00:01:45.554486 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.554469    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2" event={"ID":"3d248342-46db-4e44-a82c-dd1f3cb614af","Type":"ContainerDied","Data":"500929b22999c68e84f14f150499c9bec15d230a21a669153aa08ef1a983fb1c"}
Sep 11 00:01:45.554588 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.554495    2581 scope.go:117] "RemoveContainer" containerID="cf3d039b17c476f63ac67be2900b6024f88c6ee79277f09bed41b192ea55327e"
Sep 11 00:01:45.565521 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.565499    2581 scope.go:117] "RemoveContainer" containerID="cf3d039b17c476f63ac67be2900b6024f88c6ee79277f09bed41b192ea55327e"
Sep 11 00:01:45.565861 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:01:45.565839    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf3d039b17c476f63ac67be2900b6024f88c6ee79277f09bed41b192ea55327e\": container with ID starting with cf3d039b17c476f63ac67be2900b6024f88c6ee79277f09bed41b192ea55327e not found: ID does not exist" containerID="cf3d039b17c476f63ac67be2900b6024f88c6ee79277f09bed41b192ea55327e"
Sep 11 00:01:45.565955 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.565874    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3d039b17c476f63ac67be2900b6024f88c6ee79277f09bed41b192ea55327e"} err="failed to get container status \"cf3d039b17c476f63ac67be2900b6024f88c6ee79277f09bed41b192ea55327e\": rpc error: code = NotFound desc = could not find container \"cf3d039b17c476f63ac67be2900b6024f88c6ee79277f09bed41b192ea55327e\": container with ID starting with cf3d039b17c476f63ac67be2900b6024f88c6ee79277f09bed41b192ea55327e not found: ID does not exist"
Sep 11 00:01:45.580440 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.580417    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"]
Sep 11 00:01:45.582966 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.582935    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/sub-test-model-37692b-kserve-776b9d79d9-fkqs2"]
Sep 11 00:01:45.591869 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:01:45.591847    2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d248342_46db_4e44_a82c_dd1f3cb614af.slice/crio-500929b22999c68e84f14f150499c9bec15d230a21a669153aa08ef1a983fb1c\": RecentStats: unable to find data in memory cache]"
Sep 11 00:01:45.643308 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.643268    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrkld\" (UniqueName: \"kubernetes.io/projected/3d248342-46db-4e44-a82c-dd1f3cb614af-kube-api-access-rrkld\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:45.643308 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.643301    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d248342-46db-4e44-a82c-dd1f3cb614af-tls-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:45.643308 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.643310    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d248342-46db-4e44-a82c-dd1f3cb614af-dshm\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:45.828001 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:45.827916    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:01:46.483874 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:46.483843    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d248342-46db-4e44-a82c-dd1f3cb614af" path="/var/lib/kubelet/pods/3d248342-46db-4e44-a82c-dd1f3cb614af/volumes"
Sep 11 00:01:47.886464 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:47.886431    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"]
Sep 11 00:01:47.886932 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:47.886731    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9" podUID="e15c7be4-35a2-4bfe-9a66-ed4d5913388f" containerName="payload-pre-processing" containerID="cri-o://db38e4db72591108e121a52b865fcef22b2275f3707fdcf8f3196fbbe35556ae" gracePeriod=30
Sep 11 00:01:48.062630 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.062599    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv"]
Sep 11 00:01:48.066557 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.066526    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-aef6df-gnvxv"]
Sep 11 00:01:48.161352 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.161323    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"
Sep 11 00:01:48.272737 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.272693    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnpc4\" (UniqueName: \"kubernetes.io/projected/e15c7be4-35a2-4bfe-9a66-ed4d5913388f-kube-api-access-qnpc4\") pod \"e15c7be4-35a2-4bfe-9a66-ed4d5913388f\" (UID: \"e15c7be4-35a2-4bfe-9a66-ed4d5913388f\") "
Sep 11 00:01:48.272737 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.272746    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15c7be4-35a2-4bfe-9a66-ed4d5913388f-plugins-config-volume\") pod \"e15c7be4-35a2-4bfe-9a66-ed4d5913388f\" (UID: \"e15c7be4-35a2-4bfe-9a66-ed4d5913388f\") "
Sep 11 00:01:48.273275 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.273241    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e15c7be4-35a2-4bfe-9a66-ed4d5913388f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e15c7be4-35a2-4bfe-9a66-ed4d5913388f" (UID: "e15c7be4-35a2-4bfe-9a66-ed4d5913388f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:01:48.275021 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.274994    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e15c7be4-35a2-4bfe-9a66-ed4d5913388f-kube-api-access-qnpc4" (OuterVolumeSpecName: "kube-api-access-qnpc4") pod "e15c7be4-35a2-4bfe-9a66-ed4d5913388f" (UID: "e15c7be4-35a2-4bfe-9a66-ed4d5913388f"). InnerVolumeSpecName "kube-api-access-qnpc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:01:48.374132 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.374080    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnpc4\" (UniqueName: \"kubernetes.io/projected/e15c7be4-35a2-4bfe-9a66-ed4d5913388f-kube-api-access-qnpc4\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:48.374132 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.374129    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15c7be4-35a2-4bfe-9a66-ed4d5913388f-plugins-config-volume\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:48.484482 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.484450    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="138f3e29-a988-4fe3-aab4-b10d93d42b7c" path="/var/lib/kubelet/pods/138f3e29-a988-4fe3-aab4-b10d93d42b7c/volumes"
Sep 11 00:01:48.583200 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.583162    2581 generic.go:356] "Generic (PLEG): container finished" podID="e15c7be4-35a2-4bfe-9a66-ed4d5913388f" containerID="db38e4db72591108e121a52b865fcef22b2275f3707fdcf8f3196fbbe35556ae" exitCode=0
Sep 11 00:01:48.583375 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.583208    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"
Sep 11 00:01:48.583375 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.583240    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9" event={"ID":"e15c7be4-35a2-4bfe-9a66-ed4d5913388f","Type":"ContainerDied","Data":"db38e4db72591108e121a52b865fcef22b2275f3707fdcf8f3196fbbe35556ae"}
Sep 11 00:01:48.583375 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.583295    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9" event={"ID":"e15c7be4-35a2-4bfe-9a66-ed4d5913388f","Type":"ContainerDied","Data":"f724f885ff6bf0c5aea333430a98f76ab12e2d6d8863b6c34f6cd2ef2df0be45"}
Sep 11 00:01:48.583375 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.583322    2581 scope.go:117] "RemoveContainer" containerID="db38e4db72591108e121a52b865fcef22b2275f3707fdcf8f3196fbbe35556ae"
Sep 11 00:01:48.592477 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.592457    2581 scope.go:117] "RemoveContainer" containerID="db38e4db72591108e121a52b865fcef22b2275f3707fdcf8f3196fbbe35556ae"
Sep 11 00:01:48.592798 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:01:48.592778    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db38e4db72591108e121a52b865fcef22b2275f3707fdcf8f3196fbbe35556ae\": container with ID starting with db38e4db72591108e121a52b865fcef22b2275f3707fdcf8f3196fbbe35556ae not found: ID does not exist" containerID="db38e4db72591108e121a52b865fcef22b2275f3707fdcf8f3196fbbe35556ae"
Sep 11 00:01:48.592880 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.592810    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db38e4db72591108e121a52b865fcef22b2275f3707fdcf8f3196fbbe35556ae"} err="failed to get container status \"db38e4db72591108e121a52b865fcef22b2275f3707fdcf8f3196fbbe35556ae\": rpc error: code = NotFound desc = could not find container \"db38e4db72591108e121a52b865fcef22b2275f3707fdcf8f3196fbbe35556ae\": container with ID starting with db38e4db72591108e121a52b865fcef22b2275f3707fdcf8f3196fbbe35556ae not found: ID does not exist"
Sep 11 00:01:48.600812 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.600786    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"]
Sep 11 00:01:48.605151 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:48.605128    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9"]
Sep 11 00:01:49.391570 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:49.391538    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:49.492249 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:49.492214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:50.484360 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:50.484329    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e15c7be4-35a2-4bfe-9a66-ed4d5913388f" path="/var/lib/kubelet/pods/e15c7be4-35a2-4bfe-9a66-ed4d5913388f/volumes"
Sep 11 00:01:50.544775 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:50.544738    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:50.544979 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:50.544794    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:50.557815 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:50.557789    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:50.608619 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:50.608594    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:01:54.218549 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:54.218514    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:54.368634 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:54.368603    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:54.467446 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:54.467410    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"]
Sep 11 00:01:54.467757 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:54.467726    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j" podUID="71ef4693-b60b-4382-83bb-8bc5aaca4930" containerName="istio-proxy" containerID="cri-o://49373f8be45c8bd7dc428fc02a4cf5e1914e1fc8703f5f124e117728ac3fa90b" gracePeriod=30
Sep 11 00:01:54.482984 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:54.482893    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:55.051542 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:55.051504    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:01:59.663614 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.663582    2581 generic.go:356] "Generic (PLEG): container finished" podID="71ef4693-b60b-4382-83bb-8bc5aaca4930" containerID="49373f8be45c8bd7dc428fc02a4cf5e1914e1fc8703f5f124e117728ac3fa90b" exitCode=0
Sep 11 00:01:59.664079 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.663635    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j" event={"ID":"71ef4693-b60b-4382-83bb-8bc5aaca4930","Type":"ContainerDied","Data":"49373f8be45c8bd7dc428fc02a4cf5e1914e1fc8703f5f124e117728ac3fa90b"}
Sep 11 00:01:59.664079 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.663722    2581 scope.go:117] "RemoveContainer" containerID="2e6f0b30d9306ac1e5f71043903b975565ef80a6aa17cac192f6599f4169dcb3"
Sep 11 00:01:59.734945 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.734918    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:01:59.785615 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.785529    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-envoy\") pod \"71ef4693-b60b-4382-83bb-8bc5aaca4930\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") "
Sep 11 00:01:59.785615 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.785572    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-workload-certs\") pod \"71ef4693-b60b-4382-83bb-8bc5aaca4930\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") "
Sep 11 00:01:59.785615 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.785601    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-credential-socket\") pod \"71ef4693-b60b-4382-83bb-8bc5aaca4930\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") "
Sep 11 00:01:59.785953 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.785627    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-token\") pod \"71ef4693-b60b-4382-83bb-8bc5aaca4930\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") "
Sep 11 00:01:59.785953 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.785662    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-workload-socket\") pod \"71ef4693-b60b-4382-83bb-8bc5aaca4930\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") "
Sep 11 00:01:59.785953 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.785722    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-data\") pod \"71ef4693-b60b-4382-83bb-8bc5aaca4930\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") "
Sep 11 00:01:59.785953 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.785737    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzcrp\" (UniqueName: \"kubernetes.io/projected/71ef4693-b60b-4382-83bb-8bc5aaca4930-kube-api-access-tzcrp\") pod \"71ef4693-b60b-4382-83bb-8bc5aaca4930\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") "
Sep 11 00:01:59.785953 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.785783    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-podinfo\") pod \"71ef4693-b60b-4382-83bb-8bc5aaca4930\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") "
Sep 11 00:01:59.785953 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.785817    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ef4693-b60b-4382-83bb-8bc5aaca4930-istiod-ca-cert\") pod \"71ef4693-b60b-4382-83bb-8bc5aaca4930\" (UID: \"71ef4693-b60b-4382-83bb-8bc5aaca4930\") "
Sep 11 00:01:59.785953 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.785874    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "71ef4693-b60b-4382-83bb-8bc5aaca4930" (UID: "71ef4693-b60b-4382-83bb-8bc5aaca4930"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:59.786340 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.785970    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "71ef4693-b60b-4382-83bb-8bc5aaca4930" (UID: "71ef4693-b60b-4382-83bb-8bc5aaca4930"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:59.786340 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.786236    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-workload-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:59.786340 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.786256    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-credential-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:59.786340 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.786344    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71ef4693-b60b-4382-83bb-8bc5aaca4930-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "71ef4693-b60b-4382-83bb-8bc5aaca4930" (UID: "71ef4693-b60b-4382-83bb-8bc5aaca4930"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:01:59.786729 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.786415    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "71ef4693-b60b-4382-83bb-8bc5aaca4930" (UID: "71ef4693-b60b-4382-83bb-8bc5aaca4930"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:59.786729 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.786471    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-data" (OuterVolumeSpecName: "istio-data") pod "71ef4693-b60b-4382-83bb-8bc5aaca4930" (UID: "71ef4693-b60b-4382-83bb-8bc5aaca4930"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:59.788064 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.788038    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "71ef4693-b60b-4382-83bb-8bc5aaca4930" (UID: "71ef4693-b60b-4382-83bb-8bc5aaca4930"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:59.788280 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.788260    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "71ef4693-b60b-4382-83bb-8bc5aaca4930" (UID: "71ef4693-b60b-4382-83bb-8bc5aaca4930"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 00:01:59.788496 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.788475    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-token" (OuterVolumeSpecName: "istio-token") pod "71ef4693-b60b-4382-83bb-8bc5aaca4930" (UID: "71ef4693-b60b-4382-83bb-8bc5aaca4930"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:01:59.788496 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.788488    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ef4693-b60b-4382-83bb-8bc5aaca4930-kube-api-access-tzcrp" (OuterVolumeSpecName: "kube-api-access-tzcrp") pod "71ef4693-b60b-4382-83bb-8bc5aaca4930" (UID: "71ef4693-b60b-4382-83bb-8bc5aaca4930"). InnerVolumeSpecName "kube-api-access-tzcrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:01:59.887026 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.886986    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-envoy\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:59.887026 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.887019    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-token\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:59.887026 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.887031    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-workload-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:59.887327 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.887043    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-data\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:59.887327 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.887055    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzcrp\" (UniqueName: \"kubernetes.io/projected/71ef4693-b60b-4382-83bb-8bc5aaca4930-kube-api-access-tzcrp\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:59.887327 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.887069    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ef4693-b60b-4382-83bb-8bc5aaca4930-istio-podinfo\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:01:59.887327 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:01:59.887080    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ef4693-b60b-4382-83bb-8bc5aaca4930-istiod-ca-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:00.673565 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:00.673535    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"
Sep 11 00:02:00.674024 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:00.673570    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j" event={"ID":"71ef4693-b60b-4382-83bb-8bc5aaca4930","Type":"ContainerDied","Data":"954b62f470dbc6c540e8f445c276a9ff8efd8140be60bb8dd4cd48b40b64975a"}
Sep 11 00:02:00.674024 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:00.673645    2581 scope.go:117] "RemoveContainer" containerID="49373f8be45c8bd7dc428fc02a4cf5e1914e1fc8703f5f124e117728ac3fa90b"
Sep 11 00:02:00.691699 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:00.691651    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"]
Sep 11 00:02:00.697828 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:00.697806    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j"]
Sep 11 00:02:01.807191 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.807098    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"]
Sep 11 00:02:01.807640 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.807565    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d248342-46db-4e44-a82c-dd1f3cb614af" containerName="main"
Sep 11 00:02:01.807640 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.807579    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d248342-46db-4e44-a82c-dd1f3cb614af" containerName="main"
Sep 11 00:02:01.807640 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.807590    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ef4693-b60b-4382-83bb-8bc5aaca4930" containerName="istio-proxy"
Sep 11 00:02:01.807640 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.807595    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ef4693-b60b-4382-83bb-8bc5aaca4930" containerName="istio-proxy"
Sep 11 00:02:01.807640 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.807605    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ef4693-b60b-4382-83bb-8bc5aaca4930" containerName="istio-proxy"
Sep 11 00:02:01.807640 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.807611    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ef4693-b60b-4382-83bb-8bc5aaca4930" containerName="istio-proxy"
Sep 11 00:02:01.807640 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.807627    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e15c7be4-35a2-4bfe-9a66-ed4d5913388f" containerName="payload-pre-processing"
Sep 11 00:02:01.807640 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.807632    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e15c7be4-35a2-4bfe-9a66-ed4d5913388f" containerName="payload-pre-processing"
Sep 11 00:02:01.808132 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.807711    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e15c7be4-35a2-4bfe-9a66-ed4d5913388f" containerName="payload-pre-processing"
Sep 11 00:02:01.808132 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.807722    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d248342-46db-4e44-a82c-dd1f3cb614af" containerName="main"
Sep 11 00:02:01.808132 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.807728    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ef4693-b60b-4382-83bb-8bc5aaca4930" containerName="istio-proxy"
Sep 11 00:02:01.808132 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.807733    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ef4693-b60b-4382-83bb-8bc5aaca4930" containerName="istio-proxy"
Sep 11 00:02:01.812208 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.812191    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:01.815760 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.815734    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e96d4c\"/\"kube-root-ca.crt\""
Sep 11 00:02:01.815894 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.815799    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e96d4c\"/\"openshift-service-ca.crt\""
Sep 11 00:02:01.815965 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.815892    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e96d4c\"/\"default-dockercfg-czf62\""
Sep 11 00:02:01.815965 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.815734    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e96d4c\"/\"rate-test-model-e96d4c-kserve-self-signed-certs\""
Sep 11 00:02:01.820066 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.820043    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"]
Sep 11 00:02:01.829693 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.829614    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:01.911614 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.911584    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-home\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:01.911831 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.911623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-tmp-dir\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:01.911831 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.911649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-dshm\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:01.911935 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.911823    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-model-cache\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:01.911935 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.911861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5f7x\" (UniqueName: \"kubernetes.io/projected/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-kube-api-access-w5f7x\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:01.912008 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:01.911958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-tls-certs\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:02.013136 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.013098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-model-cache\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:02.013136 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.013145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5f7x\" (UniqueName: \"kubernetes.io/projected/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-kube-api-access-w5f7x\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:02.013423 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.013215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-tls-certs\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:02.013423 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.013244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-home\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:02.013423 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.013280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-tmp-dir\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:02.013423 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.013307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-dshm\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:02.013655 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.013583    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-model-cache\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:02.013655 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.013612    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-home\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:02.013655 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.013635    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-tmp-dir\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:02.015778 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.015757    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-dshm\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:02.015865 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.015846    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-tls-certs\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:02.022077 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.022052    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5f7x\" (UniqueName: \"kubernetes.io/projected/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-kube-api-access-w5f7x\") pod \"rate-test-model-e96d4c-kserve-749b88c955-vpqnd\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") " pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:02.124643 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.124552    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:02.327186 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.327153    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:02:02.403402 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.403373    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"]
Sep 11 00:02:02.404973 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:02:02.404939    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c3f56e9_8fbe_4c30_abdc_0f333d46c91b.slice/crio-16fd00e7fceea2723f302689ef05afc0d64d768709fcbfba76d5348971514b5a WatchSource:0}: Error finding container 16fd00e7fceea2723f302689ef05afc0d64d768709fcbfba76d5348971514b5a: Status 404 returned error can't find the container with id 16fd00e7fceea2723f302689ef05afc0d64d768709fcbfba76d5348971514b5a
Sep 11 00:02:02.486550 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.486514    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71ef4693-b60b-4382-83bb-8bc5aaca4930" path="/var/lib/kubelet/pods/71ef4693-b60b-4382-83bb-8bc5aaca4930/volumes"
Sep 11 00:02:02.689963 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.689862    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd" event={"ID":"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b","Type":"ContainerStarted","Data":"6b0d62167139a3d97cdf07689b0cf6c9fedc80bb79687cff09c6bd8b22b6171a"}
Sep 11 00:02:02.689963 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.689902    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd" event={"ID":"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b","Type":"ContainerStarted","Data":"16fd00e7fceea2723f302689ef05afc0d64d768709fcbfba76d5348971514b5a"}
Sep 11 00:02:02.708698 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:02.708618    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd" podStartSLOduration=1.708601926 podStartE2EDuration="1.708601926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:02:02.706313262 +0000 UTC m=+1522.747182566" watchObservedRunningTime="2026-09-11 00:02:02.708601926 +0000 UTC m=+1522.749471369"
Sep 11 00:02:10.375007 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:10.374973    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:10.435047 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:10.435015    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:10.494523 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:10.494490    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:10.862888 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:10.862856    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:10.964915 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:10.964880    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:11.024362 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:11.024326    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:12.124815 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:12.124777    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:12.125280 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:12.124830    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:12.138415 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:12.138382    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:12.781645 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:12.781614    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:02:16.120051 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:16.120013    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:02:16.784736 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:16.784698    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:16.847397 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:16.847361    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:17.010659 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:17.010622    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"]
Sep 11 00:02:17.010928 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:17.010900    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr" podUID="5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" containerName="istio-proxy" containerID="cri-o://04e6c020a920a98f46de166370e9ad0f44ce6bc83333f885a06f6f1cf872a1a1" gracePeriod=30
Sep 11 00:02:17.301780 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:17.301744    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:17.527169 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:17.527131    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:22.261443 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.261418    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:02:22.424779 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.424691    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-credential-socket\") pod \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") "
Sep 11 00:02:22.424779 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.424741    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-podinfo\") pod \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") "
Sep 11 00:02:22.424779 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.424767    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-workload-certs\") pod \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") "
Sep 11 00:02:22.425082 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.424800    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-envoy\") pod \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") "
Sep 11 00:02:22.425082 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.424852    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istiod-ca-cert\") pod \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") "
Sep 11 00:02:22.425082 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.424882    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-data\") pod \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") "
Sep 11 00:02:22.425082 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.424899    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjhdx\" (UniqueName: \"kubernetes.io/projected/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-kube-api-access-sjhdx\") pod \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") "
Sep 11 00:02:22.425082 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.424925    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-workload-socket\") pod \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") "
Sep 11 00:02:22.425082 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.424946    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" (UID: "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:02:22.425082 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.424968    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-token\") pod \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\" (UID: \"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5\") "
Sep 11 00:02:22.425082 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.425061    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" (UID: "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:02:22.425524 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.425340    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-credential-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.425524 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.425342    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" (UID: "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:02:22.425524 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.425361    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-workload-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.425524 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.425357    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-data" (OuterVolumeSpecName: "istio-data") pod "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" (UID: "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:02:22.425524 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.425388    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" (UID: "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:02:22.427332 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.427277    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" (UID: "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:02:22.427332 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.427294    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" (UID: "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 00:02:22.427473 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.427375    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" (UID: "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:02:22.427473 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.427401    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-kube-api-access-sjhdx" (OuterVolumeSpecName: "kube-api-access-sjhdx") pod "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" (UID: "5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5"). InnerVolumeSpecName "kube-api-access-sjhdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:02:22.525865 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.525836    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-envoy\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.525865 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.525859    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istiod-ca-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.525865 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.525868    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-data\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.526094 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.525876    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjhdx\" (UniqueName: \"kubernetes.io/projected/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-kube-api-access-sjhdx\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.526094 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.525886    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-workload-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.526094 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.525898    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-token\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.526094 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.525905    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5-istio-podinfo\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:22.834165 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.834126    2581 generic.go:356] "Generic (PLEG): container finished" podID="5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" containerID="04e6c020a920a98f46de166370e9ad0f44ce6bc83333f885a06f6f1cf872a1a1" exitCode=0
Sep 11 00:02:22.834383 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.834182    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"
Sep 11 00:02:22.834383 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.834219    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr" event={"ID":"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5","Type":"ContainerDied","Data":"04e6c020a920a98f46de166370e9ad0f44ce6bc83333f885a06f6f1cf872a1a1"}
Sep 11 00:02:22.834383 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.834290    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr" event={"ID":"5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5","Type":"ContainerDied","Data":"0de6d696163d2625eb7f3cb70ad0f5474977129a950885b47c704107bd09eca9"}
Sep 11 00:02:22.834383 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.834323    2581 scope.go:117] "RemoveContainer" containerID="04e6c020a920a98f46de166370e9ad0f44ce6bc83333f885a06f6f1cf872a1a1"
Sep 11 00:02:22.844497 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.844474    2581 scope.go:117] "RemoveContainer" containerID="e88f3203b9789b42908b3e65dbe72f8721b33511a1b0f09865a04d8f829c812f"
Sep 11 00:02:22.851756 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.851724    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"]
Sep 11 00:02:22.854694 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.854647    2581 scope.go:117] "RemoveContainer" containerID="04e6c020a920a98f46de166370e9ad0f44ce6bc83333f885a06f6f1cf872a1a1"
Sep 11 00:02:22.855142 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:02:22.855120    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04e6c020a920a98f46de166370e9ad0f44ce6bc83333f885a06f6f1cf872a1a1\": container with ID starting with 04e6c020a920a98f46de166370e9ad0f44ce6bc83333f885a06f6f1cf872a1a1 not found: ID does not exist" containerID="04e6c020a920a98f46de166370e9ad0f44ce6bc83333f885a06f6f1cf872a1a1"
Sep 11 00:02:22.855198 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.855153    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04e6c020a920a98f46de166370e9ad0f44ce6bc83333f885a06f6f1cf872a1a1"} err="failed to get container status \"04e6c020a920a98f46de166370e9ad0f44ce6bc83333f885a06f6f1cf872a1a1\": rpc error: code = NotFound desc = could not find container \"04e6c020a920a98f46de166370e9ad0f44ce6bc83333f885a06f6f1cf872a1a1\": container with ID starting with 04e6c020a920a98f46de166370e9ad0f44ce6bc83333f885a06f6f1cf872a1a1 not found: ID does not exist"
Sep 11 00:02:22.855198 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.855171    2581 scope.go:117] "RemoveContainer" containerID="e88f3203b9789b42908b3e65dbe72f8721b33511a1b0f09865a04d8f829c812f"
Sep 11 00:02:22.855485 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:02:22.855467    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e88f3203b9789b42908b3e65dbe72f8721b33511a1b0f09865a04d8f829c812f\": container with ID starting with e88f3203b9789b42908b3e65dbe72f8721b33511a1b0f09865a04d8f829c812f not found: ID does not exist" containerID="e88f3203b9789b42908b3e65dbe72f8721b33511a1b0f09865a04d8f829c812f"
Sep 11 00:02:22.855542 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.855491    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e88f3203b9789b42908b3e65dbe72f8721b33511a1b0f09865a04d8f829c812f"} err="failed to get container status \"e88f3203b9789b42908b3e65dbe72f8721b33511a1b0f09865a04d8f829c812f\": rpc error: code = NotFound desc = could not find container \"e88f3203b9789b42908b3e65dbe72f8721b33511a1b0f09865a04d8f829c812f\": container with ID starting with e88f3203b9789b42908b3e65dbe72f8721b33511a1b0f09865a04d8f829c812f not found: ID does not exist"
Sep 11 00:02:22.856055 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:22.856037    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr"]
Sep 11 00:02:24.484248 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:24.484219    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" path="/var/lib/kubelet/pods/5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5/volumes"
Sep 11 00:02:26.592810 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:26.592776    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:28.846138 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:28.846100    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:28.979993 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:28.979957    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:33.025479 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:33.025436    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:02:34.324189 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:34.324152    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:34.424404 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:34.424366    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:34.593700 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:34.593587    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:35.017069 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:35.017037    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:45.401411 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:45.401376    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-dd5958-29818080-jxh7q"]
Sep 11 00:02:45.403077 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:45.403048    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:45.404187 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:45.404165    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-dd5958-29818080-jxh7q"]
Sep 11 00:02:45.470270 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:45.470228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:45.537041 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:45.537011    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:46.081421 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:46.081380    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:46.135809 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:46.135782    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:46.485603 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:46.485567    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f08de44-6052-4125-bf55-84aa59bb4556" path="/var/lib/kubelet/pods/9f08de44-6052-4125-bf55-84aa59bb4556/volumes"
Sep 11 00:02:47.158799 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:47.158762    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:02:52.224594 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:52.224553    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"]
Sep 11 00:02:52.225069 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:52.224895    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg" podUID="1c1a686a-f3a6-4d53-87d7-0ebd54610009" containerName="istio-proxy" containerID="cri-o://b97a2fd04f5ecee5266c3c4cb167a1f7f3a7a45bb1bf96c1975113c20248f056" gracePeriod=30
Sep 11 00:02:52.447026 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:52.446988    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:52.545868 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:52.545771    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:02:57.497115 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.497041    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 11 00:02:57.565635 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.565590    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-workload-socket\") pod \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") "
Sep 11 00:02:57.565822 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.565718    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-workload-certs\") pod \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") "
Sep 11 00:02:57.565822 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.565769    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-podinfo\") pod \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") "
Sep 11 00:02:57.565822 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.565794    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-credential-socket\") pod \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") "
Sep 11 00:02:57.565992 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.565822    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istiod-ca-cert\") pod \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") "
Sep 11 00:02:57.565992 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.565870    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45njz\" (UniqueName: \"kubernetes.io/projected/1c1a686a-f3a6-4d53-87d7-0ebd54610009-kube-api-access-45njz\") pod \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") "
Sep 11 00:02:57.565992 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.565896    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-data\") pod \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") "
Sep 11 00:02:57.565992 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.565910    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1c1a686a-f3a6-4d53-87d7-0ebd54610009" (UID: "1c1a686a-f3a6-4d53-87d7-0ebd54610009"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:02:57.565992 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.565955    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-token\") pod \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") "
Sep 11 00:02:57.566260 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.565997    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-envoy\") pod \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\" (UID: \"1c1a686a-f3a6-4d53-87d7-0ebd54610009\") "
Sep 11 00:02:57.566260 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.566050    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1c1a686a-f3a6-4d53-87d7-0ebd54610009" (UID: "1c1a686a-f3a6-4d53-87d7-0ebd54610009"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:02:57.566260 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.566115    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1c1a686a-f3a6-4d53-87d7-0ebd54610009" (UID: "1c1a686a-f3a6-4d53-87d7-0ebd54610009"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:02:57.566418 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.566338    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-workload-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:57.566418 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.566359    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-workload-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:57.566418 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.566373    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-credential-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:57.566418 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.566372    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-data" (OuterVolumeSpecName: "istio-data") pod "1c1a686a-f3a6-4d53-87d7-0ebd54610009" (UID: "1c1a686a-f3a6-4d53-87d7-0ebd54610009"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:02:57.566418 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.566300    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1c1a686a-f3a6-4d53-87d7-0ebd54610009" (UID: "1c1a686a-f3a6-4d53-87d7-0ebd54610009"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:02:57.568522 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.568493    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c1a686a-f3a6-4d53-87d7-0ebd54610009" (UID: "1c1a686a-f3a6-4d53-87d7-0ebd54610009"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:02:57.568522 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.568514    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c1a686a-f3a6-4d53-87d7-0ebd54610009-kube-api-access-45njz" (OuterVolumeSpecName: "kube-api-access-45njz") pod "1c1a686a-f3a6-4d53-87d7-0ebd54610009" (UID: "1c1a686a-f3a6-4d53-87d7-0ebd54610009"). InnerVolumeSpecName "kube-api-access-45njz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:02:57.568763 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.568633    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1c1a686a-f3a6-4d53-87d7-0ebd54610009" (UID: "1c1a686a-f3a6-4d53-87d7-0ebd54610009"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 00:02:57.568763 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.568691    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1c1a686a-f3a6-4d53-87d7-0ebd54610009" (UID: "1c1a686a-f3a6-4d53-87d7-0ebd54610009"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:02:57.667002 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.666965    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-podinfo\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:57.667002 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.666994    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istiod-ca-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:57.667002 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.667006    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45njz\" (UniqueName: \"kubernetes.io/projected/1c1a686a-f3a6-4d53-87d7-0ebd54610009-kube-api-access-45njz\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:57.667251 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.667016    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-data\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:57.667251 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.667023    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-token\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:57.667251 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:57.667031    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c1a686a-f3a6-4d53-87d7-0ebd54610009-istio-envoy\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:02:58.049745 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:58.049711    2581 generic.go:356] "Generic (PLEG): container finished" podID="1c1a686a-f3a6-4d53-87d7-0ebd54610009" containerID="b97a2fd04f5ecee5266c3c4cb167a1f7f3a7a45bb1bf96c1975113c20248f056" exitCode=0
Sep 11 00:02:58.049971 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:58.049762    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"
Sep 11 00:02:58.049971 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:58.049804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg" event={"ID":"1c1a686a-f3a6-4d53-87d7-0ebd54610009","Type":"ContainerDied","Data":"b97a2fd04f5ecee5266c3c4cb167a1f7f3a7a45bb1bf96c1975113c20248f056"}
Sep 11 00:02:58.049971 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:58.049902    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg" event={"ID":"1c1a686a-f3a6-4d53-87d7-0ebd54610009","Type":"ContainerDied","Data":"02840ac93f67c7c370c919ba357ec34394a43c97af853b7288053db9871e8ef8"}
Sep 11 00:02:58.049971 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:58.049933    2581 scope.go:117] "RemoveContainer" containerID="b97a2fd04f5ecee5266c3c4cb167a1f7f3a7a45bb1bf96c1975113c20248f056"
Sep 11 00:02:58.060618 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:58.060598    2581 scope.go:117] "RemoveContainer" containerID="03dfd2b01214c2e4a23a0b673bd2320da94cd764379aeaeb27f60c5db468f354"
Sep 11 00:02:58.071569 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:58.071545    2581 scope.go:117] "RemoveContainer" containerID="b97a2fd04f5ecee5266c3c4cb167a1f7f3a7a45bb1bf96c1975113c20248f056"
Sep 11 00:02:58.072040 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:02:58.072017    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b97a2fd04f5ecee5266c3c4cb167a1f7f3a7a45bb1bf96c1975113c20248f056\": container with ID starting with b97a2fd04f5ecee5266c3c4cb167a1f7f3a7a45bb1bf96c1975113c20248f056 not found: ID does not exist" containerID="b97a2fd04f5ecee5266c3c4cb167a1f7f3a7a45bb1bf96c1975113c20248f056"
Sep 11 00:02:58.072116 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:58.072051    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b97a2fd04f5ecee5266c3c4cb167a1f7f3a7a45bb1bf96c1975113c20248f056"} err="failed to get container status \"b97a2fd04f5ecee5266c3c4cb167a1f7f3a7a45bb1bf96c1975113c20248f056\": rpc error: code = NotFound desc = could not find container \"b97a2fd04f5ecee5266c3c4cb167a1f7f3a7a45bb1bf96c1975113c20248f056\": container with ID starting with b97a2fd04f5ecee5266c3c4cb167a1f7f3a7a45bb1bf96c1975113c20248f056 not found: ID does not exist"
Sep 11 00:02:58.072116 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:58.072073    2581 scope.go:117] "RemoveContainer" containerID="03dfd2b01214c2e4a23a0b673bd2320da94cd764379aeaeb27f60c5db468f354"
Sep 11 00:02:58.072385 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:02:58.072365    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03dfd2b01214c2e4a23a0b673bd2320da94cd764379aeaeb27f60c5db468f354\": container with ID starting with 03dfd2b01214c2e4a23a0b673bd2320da94cd764379aeaeb27f60c5db468f354 not found: ID does not exist" containerID="03dfd2b01214c2e4a23a0b673bd2320da94cd764379aeaeb27f60c5db468f354"
Sep 11 00:02:58.072441 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:58.072391    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03dfd2b01214c2e4a23a0b673bd2320da94cd764379aeaeb27f60c5db468f354"} err="failed to get container status \"03dfd2b01214c2e4a23a0b673bd2320da94cd764379aeaeb27f60c5db468f354\": rpc error: code = NotFound desc = could not find container \"03dfd2b01214c2e4a23a0b673bd2320da94cd764379aeaeb27f60c5db468f354\": container with ID starting with 03dfd2b01214c2e4a23a0b673bd2320da94cd764379aeaeb27f60c5db468f354 not found: ID does not exist"
Sep 11 00:02:58.073955 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:58.073932    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"]
Sep 11 00:02:58.079643 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:58.079603    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg"]
Sep 11 00:02:58.485604 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:02:58.485571    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c1a686a-f3a6-4d53-87d7-0ebd54610009" path="/var/lib/kubelet/pods/1c1a686a-f3a6-4d53-87d7-0ebd54610009/volumes"
Sep 11 00:03:01.315634 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:01.315599    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:03:03.956313 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:03.956283    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:04.057309 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:04.057251    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:08.351653 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:08.351618    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"]
Sep 11 00:03:08.365002 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:08.364941    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:09.432016 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:09.431977    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"]
Sep 11 00:03:09.449632 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:09.449593    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:09.882236 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:09.882202    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:10.158456 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:10.158367    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:10.440438 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:10.440354    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:12.425935 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:12.425885    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:03:13.256022 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:13.255971    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:13.355970 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:13.355937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:14.410081 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:14.410047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:14.511271 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:14.511237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:14.921420 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:14.921366    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:15.019281 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:15.019247    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:15.111009 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:15.110956    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:23.372452 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.372385    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb" podUID="aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e" containerName="main" containerID="cri-o://f025c966a6c30883b73ccaee1eda840a7ef73b7bf9898cc88d48374882078993" gracePeriod=45
Sep 11 00:03:23.633117 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.633057    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:03:23.734113 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.734062    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-tmp-dir\") pod \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") "
Sep 11 00:03:23.734314 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.734137    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-dshm\") pod \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") "
Sep 11 00:03:23.734314 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.734199    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-tls-certs\") pod \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") "
Sep 11 00:03:23.734314 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.734225    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-model-cache\") pod \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") "
Sep 11 00:03:23.734314 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.734275    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-home\") pod \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") "
Sep 11 00:03:23.734314 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.734308    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flj49\" (UniqueName: \"kubernetes.io/projected/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-kube-api-access-flj49\") pod \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\" (UID: \"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e\") "
Sep 11 00:03:23.734599 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.734373    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e" (UID: "aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:03:23.734599 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.734563    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-home" (OuterVolumeSpecName: "home") pod "aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e" (UID: "aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:03:23.734599 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.734583    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-model-cache" (OuterVolumeSpecName: "model-cache") pod "aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e" (UID: "aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:03:23.734798 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.734788    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-model-cache\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:03:23.734905 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.734808    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-home\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:03:23.734905 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.734822    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-tmp-dir\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:03:23.736481 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.736459    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-dshm" (OuterVolumeSpecName: "dshm") pod "aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e" (UID: "aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:03:23.736590 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.736475    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-kube-api-access-flj49" (OuterVolumeSpecName: "kube-api-access-flj49") pod "aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e" (UID: "aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e"). InnerVolumeSpecName "kube-api-access-flj49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:03:23.736590 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.736490    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e" (UID: "aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:03:23.835711 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.835652    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-dshm\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:03:23.835711 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.835709    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-tls-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:03:23.835711 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:23.835720    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flj49\" (UniqueName: \"kubernetes.io/projected/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e-kube-api-access-flj49\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:03:24.224063 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.224032    2581 generic.go:356] "Generic (PLEG): container finished" podID="aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e" containerID="f025c966a6c30883b73ccaee1eda840a7ef73b7bf9898cc88d48374882078993" exitCode=0
Sep 11 00:03:24.224281 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.224085    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"
Sep 11 00:03:24.224281 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.224126    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb" event={"ID":"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e","Type":"ContainerDied","Data":"f025c966a6c30883b73ccaee1eda840a7ef73b7bf9898cc88d48374882078993"}
Sep 11 00:03:24.224281 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.224170    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb" event={"ID":"aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e","Type":"ContainerDied","Data":"4460d82044a6eef84967a3e6b2d4bed8393bf3dc53af7d03754bf7e13013430a"}
Sep 11 00:03:24.224281 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.224190    2581 scope.go:117] "RemoveContainer" containerID="f025c966a6c30883b73ccaee1eda840a7ef73b7bf9898cc88d48374882078993"
Sep 11 00:03:24.234747 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.234727    2581 scope.go:117] "RemoveContainer" containerID="f025c966a6c30883b73ccaee1eda840a7ef73b7bf9898cc88d48374882078993"
Sep 11 00:03:24.235031 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:03:24.235013    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f025c966a6c30883b73ccaee1eda840a7ef73b7bf9898cc88d48374882078993\": container with ID starting with f025c966a6c30883b73ccaee1eda840a7ef73b7bf9898cc88d48374882078993 not found: ID does not exist" containerID="f025c966a6c30883b73ccaee1eda840a7ef73b7bf9898cc88d48374882078993"
Sep 11 00:03:24.235073 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.235041    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f025c966a6c30883b73ccaee1eda840a7ef73b7bf9898cc88d48374882078993"} err="failed to get container status \"f025c966a6c30883b73ccaee1eda840a7ef73b7bf9898cc88d48374882078993\": rpc error: code = NotFound desc = could not find container \"f025c966a6c30883b73ccaee1eda840a7ef73b7bf9898cc88d48374882078993\": container with ID starting with f025c966a6c30883b73ccaee1eda840a7ef73b7bf9898cc88d48374882078993 not found: ID does not exist"
Sep 11 00:03:24.245870 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.245845    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"]
Sep 11 00:03:24.249866 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.249845    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-37692b/rate-test-model-37692b-kserve-7d4d7f6c6c-nmxlb"]
Sep 11 00:03:24.452821 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.452785    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd" podUID="7c3f56e9-8fbe-4c30-abdc-0f333d46c91b" containerName="main" containerID="cri-o://6b0d62167139a3d97cdf07689b0cf6c9fedc80bb79687cff09c6bd8b22b6171a" gracePeriod=45
Sep 11 00:03:24.484519 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.484445    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e" path="/var/lib/kubelet/pods/aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e/volumes"
Sep 11 00:03:24.715270 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.715244    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:03:24.845169 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.845075    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-home\") pod \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") "
Sep 11 00:03:24.845169 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.845111    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-dshm\") pod \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") "
Sep 11 00:03:24.845169 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.845142    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-tmp-dir\") pod \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") "
Sep 11 00:03:24.845471 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.845198    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5f7x\" (UniqueName: \"kubernetes.io/projected/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-kube-api-access-w5f7x\") pod \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") "
Sep 11 00:03:24.845471 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.845232    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-tls-certs\") pod \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") "
Sep 11 00:03:24.845471 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.845257    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-model-cache\") pod \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\" (UID: \"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b\") "
Sep 11 00:03:24.845471 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.845389    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-home" (OuterVolumeSpecName: "home") pod "7c3f56e9-8fbe-4c30-abdc-0f333d46c91b" (UID: "7c3f56e9-8fbe-4c30-abdc-0f333d46c91b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:03:24.845471 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.845444    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7c3f56e9-8fbe-4c30-abdc-0f333d46c91b" (UID: "7c3f56e9-8fbe-4c30-abdc-0f333d46c91b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:03:24.845710 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.845582    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-tmp-dir\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:03:24.845710 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.845584    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-model-cache" (OuterVolumeSpecName: "model-cache") pod "7c3f56e9-8fbe-4c30-abdc-0f333d46c91b" (UID: "7c3f56e9-8fbe-4c30-abdc-0f333d46c91b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:03:24.845710 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.845596    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-home\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:03:24.847468 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.847438    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-dshm" (OuterVolumeSpecName: "dshm") pod "7c3f56e9-8fbe-4c30-abdc-0f333d46c91b" (UID: "7c3f56e9-8fbe-4c30-abdc-0f333d46c91b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:03:24.847590 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.847533    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c3f56e9-8fbe-4c30-abdc-0f333d46c91b" (UID: "7c3f56e9-8fbe-4c30-abdc-0f333d46c91b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:03:24.847640 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.847586    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-kube-api-access-w5f7x" (OuterVolumeSpecName: "kube-api-access-w5f7x") pod "7c3f56e9-8fbe-4c30-abdc-0f333d46c91b" (UID: "7c3f56e9-8fbe-4c30-abdc-0f333d46c91b"). InnerVolumeSpecName "kube-api-access-w5f7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:03:24.947024 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.946983    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-tls-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:03:24.947024 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.947015    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-model-cache\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:03:24.947024 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.947023    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-dshm\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:03:24.947024 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:24.947033    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5f7x\" (UniqueName: \"kubernetes.io/projected/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b-kube-api-access-w5f7x\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:03:25.231703 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:25.231648    2581 generic.go:356] "Generic (PLEG): container finished" podID="7c3f56e9-8fbe-4c30-abdc-0f333d46c91b" containerID="6b0d62167139a3d97cdf07689b0cf6c9fedc80bb79687cff09c6bd8b22b6171a" exitCode=0
Sep 11 00:03:25.231703 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:25.231696    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd" event={"ID":"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b","Type":"ContainerDied","Data":"6b0d62167139a3d97cdf07689b0cf6c9fedc80bb79687cff09c6bd8b22b6171a"}
Sep 11 00:03:25.231936 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:25.231709    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"
Sep 11 00:03:25.231936 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:25.231741    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd" event={"ID":"7c3f56e9-8fbe-4c30-abdc-0f333d46c91b","Type":"ContainerDied","Data":"16fd00e7fceea2723f302689ef05afc0d64d768709fcbfba76d5348971514b5a"}
Sep 11 00:03:25.231936 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:25.231757    2581 scope.go:117] "RemoveContainer" containerID="6b0d62167139a3d97cdf07689b0cf6c9fedc80bb79687cff09c6bd8b22b6171a"
Sep 11 00:03:25.241821 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:25.241797    2581 scope.go:117] "RemoveContainer" containerID="6b0d62167139a3d97cdf07689b0cf6c9fedc80bb79687cff09c6bd8b22b6171a"
Sep 11 00:03:25.242124 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:03:25.242102    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b0d62167139a3d97cdf07689b0cf6c9fedc80bb79687cff09c6bd8b22b6171a\": container with ID starting with 6b0d62167139a3d97cdf07689b0cf6c9fedc80bb79687cff09c6bd8b22b6171a not found: ID does not exist" containerID="6b0d62167139a3d97cdf07689b0cf6c9fedc80bb79687cff09c6bd8b22b6171a"
Sep 11 00:03:25.242200 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:25.242133    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b0d62167139a3d97cdf07689b0cf6c9fedc80bb79687cff09c6bd8b22b6171a"} err="failed to get container status \"6b0d62167139a3d97cdf07689b0cf6c9fedc80bb79687cff09c6bd8b22b6171a\": rpc error: code = NotFound desc = could not find container \"6b0d62167139a3d97cdf07689b0cf6c9fedc80bb79687cff09c6bd8b22b6171a\": container with ID starting with 6b0d62167139a3d97cdf07689b0cf6c9fedc80bb79687cff09c6bd8b22b6171a not found: ID does not exist"
Sep 11 00:03:25.254429 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:25.254405    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"]
Sep 11 00:03:25.257415 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:25.257393    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e96d4c/rate-test-model-e96d4c-kserve-749b88c955-vpqnd"]
Sep 11 00:03:25.521052 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:25.520969    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:03:26.483570 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:26.483525    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c3f56e9-8fbe-4c30-abdc-0f333d46c91b" path="/var/lib/kubelet/pods/7c3f56e9-8fbe-4c30-abdc-0f333d46c91b/volumes"
Sep 11 00:03:38.324897 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:38.324817    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:39.146502 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.146457    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:39.436310 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.436235    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"]
Sep 11 00:03:39.436876 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.436856    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c1a686a-f3a6-4d53-87d7-0ebd54610009" containerName="istio-proxy"
Sep 11 00:03:39.436876 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.436876    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c1a686a-f3a6-4d53-87d7-0ebd54610009" containerName="istio-proxy"
Sep 11 00:03:39.437063 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.436891    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" containerName="istio-proxy"
Sep 11 00:03:39.437063 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.436898    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" containerName="istio-proxy"
Sep 11 00:03:39.437063 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.436907    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c3f56e9-8fbe-4c30-abdc-0f333d46c91b" containerName="main"
Sep 11 00:03:39.437063 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.436913    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c3f56e9-8fbe-4c30-abdc-0f333d46c91b" containerName="main"
Sep 11 00:03:39.437063 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.436926    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e" containerName="main"
Sep 11 00:03:39.437063 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.436932    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e" containerName="main"
Sep 11 00:03:39.437063 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.436993    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" containerName="istio-proxy"
Sep 11 00:03:39.437063 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.437004    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeaa8b73-4f2b-4c3e-aba2-9c7560e09f0e" containerName="main"
Sep 11 00:03:39.437063 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.437013    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c1a686a-f3a6-4d53-87d7-0ebd54610009" containerName="istio-proxy"
Sep 11 00:03:39.437063 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.437021    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c3f56e9-8fbe-4c30-abdc-0f333d46c91b" containerName="main"
Sep 11 00:03:39.437063 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.437029    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c1a686a-f3a6-4d53-87d7-0ebd54610009" containerName="istio-proxy"
Sep 11 00:03:39.441655 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.441637    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.444070 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.444048    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-c416fa-openshift-default-dockercfg-fbsmm\""
Sep 11 00:03:39.452425 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.452403    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"]
Sep 11 00:03:39.475027 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.474991    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:39.588438 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.588403    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-podinfo\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.588619 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.588446    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-credential-socket\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.588619 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.588510    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-workload-socket\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.588619 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.588551    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-token\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.588619 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.588574    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-workload-certs\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.588619 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.588589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istiod-ca-cert\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.588619 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.588606    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-envoy\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.588847 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.588727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-data\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.588847 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.588767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-977nq\" (UniqueName: \"kubernetes.io/projected/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-kube-api-access-977nq\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.690068 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.689990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-workload-socket\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.690068 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.690031    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-token\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.690068 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.690052    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-workload-certs\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.690068 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.690066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istiod-ca-cert\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.690323 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.690188    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-envoy\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.690323 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.690275    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-data\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.690436 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.690324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-977nq\" (UniqueName: \"kubernetes.io/projected/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-kube-api-access-977nq\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.690436 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.690393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-podinfo\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.690608 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.690437    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-credential-socket\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.690608 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.690471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-workload-certs\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.690608 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.690495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-workload-socket\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.690867 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.690706    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-data\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.690867 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.690773    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-credential-socket\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.690867 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.690796    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istiod-ca-cert\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.693007 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.692979    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-envoy\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.693128 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.693111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-podinfo\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.697763 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.697741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-token\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.701588 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.701567    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-977nq\" (UniqueName: \"kubernetes.io/projected/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-kube-api-access-977nq\") pod \"e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") " pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.755282 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.755253    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:39.759841 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:39.759815    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:40.041703 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:40.041657    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"]
Sep 11 00:03:40.042731 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:03:40.042699    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8fdbb0e_5f41_44e0_b57e_d8acc9bf8f1b.slice/crio-d2c80f8c1589bab6fa932dc96497066f97311ba280cf3b4075cd3eb97b228182 WatchSource:0}: Error finding container d2c80f8c1589bab6fa932dc96497066f97311ba280cf3b4075cd3eb97b228182: Status 404 returned error can't find the container with id d2c80f8c1589bab6fa932dc96497066f97311ba280cf3b4075cd3eb97b228182
Sep 11 00:03:40.045127 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:40.045093    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:03:40.045216 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:40.045188    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:03:40.045267 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:40.045232    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:03:40.331801 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:40.331698    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw" event={"ID":"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b","Type":"ContainerStarted","Data":"7c7b10da9ba2c0b43ba87ba8eac24fee07ed87e12201f7835fc366cc5baa24c9"}
Sep 11 00:03:40.331984 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:40.331807    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw" event={"ID":"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b","Type":"ContainerStarted","Data":"d2c80f8c1589bab6fa932dc96497066f97311ba280cf3b4075cd3eb97b228182"}
Sep 11 00:03:40.374474 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:40.374407    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw" podStartSLOduration=1.374385464 podStartE2EDuration="1.374385464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:03:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:03:40.37324413 +0000 UTC m=+1620.414113439" watchObservedRunningTime="2026-09-11 00:03:40.374385464 +0000 UTC m=+1620.415254778"
Sep 11 00:03:40.756137 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:40.756101    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:41.761821 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:41.761788    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:42.344140 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:42.344108    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:42.345687 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:42.345646    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:03:42.436180 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:42.436147    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:42.530929 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:42.530900    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:43.594682 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:43.594646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:43.694404 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:43.694368    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:43.891551 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:43.891465    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:44.092895 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.092862    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:44.196643 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.196557    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"]
Sep 11 00:03:44.197019 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.197004    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c1a686a-f3a6-4d53-87d7-0ebd54610009" containerName="istio-proxy"
Sep 11 00:03:44.197072 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.197021    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c1a686a-f3a6-4d53-87d7-0ebd54610009" containerName="istio-proxy"
Sep 11 00:03:44.197072 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.197038    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" containerName="istio-proxy"
Sep 11 00:03:44.197072 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.197043    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" containerName="istio-proxy"
Sep 11 00:03:44.197175 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.197123    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bbfeaa8-65ec-4f58-b950-bb02bd46d8d5" containerName="istio-proxy"
Sep 11 00:03:44.201315 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.201298    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"
Sep 11 00:03:44.203948 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.203919    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:44.204191 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.204174    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-c416fa-dockercfg-74zd9\""
Sep 11 00:03:44.204279 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.204181    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-c416fa\""
Sep 11 00:03:44.213022 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.213001    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"]
Sep 11 00:03:44.335255 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.335220    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcwrl\" (UniqueName: \"kubernetes.io/projected/e5d0c7c8-274e-406b-9b1b-6ec1c256b86f-kube-api-access-rcwrl\") pod \"payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb\" (UID: \"e5d0c7c8-274e-406b-9b1b-6ec1c256b86f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"
Sep 11 00:03:44.335453 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.335274    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5d0c7c8-274e-406b-9b1b-6ec1c256b86f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb\" (UID: \"e5d0c7c8-274e-406b-9b1b-6ec1c256b86f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"
Sep 11 00:03:44.435964 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.435921    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcwrl\" (UniqueName: \"kubernetes.io/projected/e5d0c7c8-274e-406b-9b1b-6ec1c256b86f-kube-api-access-rcwrl\") pod \"payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb\" (UID: \"e5d0c7c8-274e-406b-9b1b-6ec1c256b86f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"
Sep 11 00:03:44.436131 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.436015    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5d0c7c8-274e-406b-9b1b-6ec1c256b86f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb\" (UID: \"e5d0c7c8-274e-406b-9b1b-6ec1c256b86f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"
Sep 11 00:03:44.436785 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.436763    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5d0c7c8-274e-406b-9b1b-6ec1c256b86f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb\" (UID: \"e5d0c7c8-274e-406b-9b1b-6ec1c256b86f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"
Sep 11 00:03:44.444849 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.444828    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcwrl\" (UniqueName: \"kubernetes.io/projected/e5d0c7c8-274e-406b-9b1b-6ec1c256b86f-kube-api-access-rcwrl\") pod \"payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb\" (UID: \"e5d0c7c8-274e-406b-9b1b-6ec1c256b86f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"
Sep 11 00:03:44.513709 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.513627    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"
Sep 11 00:03:44.795539 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:44.795510    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"]
Sep 11 00:03:44.797308 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:03:44.797271    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d0c7c8_274e_406b_9b1b_6ec1c256b86f.slice/crio-4d966ca684ba0ada89ae1911bdf70d6aa92bad992861f51bd5224754c7eadf52 WatchSource:0}: Error finding container 4d966ca684ba0ada89ae1911bdf70d6aa92bad992861f51bd5224754c7eadf52: Status 404 returned error can't find the container with id 4d966ca684ba0ada89ae1911bdf70d6aa92bad992861f51bd5224754c7eadf52
Sep 11 00:03:45.362629 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:45.362599    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb" event={"ID":"e5d0c7c8-274e-406b-9b1b-6ec1c256b86f","Type":"ContainerStarted","Data":"28b34728e26cb6c466902cd4758a9481142b1b4c43b8a4118cf570a87319ce2d"}
Sep 11 00:03:45.362843 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:45.362653    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb" event={"ID":"e5d0c7c8-274e-406b-9b1b-6ec1c256b86f","Type":"ContainerStarted","Data":"4d966ca684ba0ada89ae1911bdf70d6aa92bad992861f51bd5224754c7eadf52"}
Sep 11 00:03:45.362843 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:45.362702    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"
Sep 11 00:03:45.380889 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:45.380831    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb" podStartSLOduration=1.380815281 podStartE2EDuration="1.380815281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:03:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:03:45.378603215 +0000 UTC m=+1625.419472521" watchObservedRunningTime="2026-09-11 00:03:45.380815281 +0000 UTC m=+1625.421684586"
Sep 11 00:03:49.630800 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:49.630754    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:03:56.373120 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:56.373076    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"
Sep 11 00:03:58.690422 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:58.690380    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:03:58.750602 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:03:58.750569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:04:01.470131 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:01.470095    2581 generic.go:356] "Generic (PLEG): container finished" podID="b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" containerID="7c7b10da9ba2c0b43ba87ba8eac24fee07ed87e12201f7835fc366cc5baa24c9" exitCode=0
Sep 11 00:04:01.470575 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:01.470137    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw" event={"ID":"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b","Type":"ContainerDied","Data":"7c7b10da9ba2c0b43ba87ba8eac24fee07ed87e12201f7835fc366cc5baa24c9"}
Sep 11 00:04:01.470621 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:01.470590    2581 scope.go:117] "RemoveContainer" containerID="7c7b10da9ba2c0b43ba87ba8eac24fee07ed87e12201f7835fc366cc5baa24c9"
Sep 11 00:04:01.471829 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:01.471798    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:04:01.471957 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:01.471874    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:04:01.471957 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:01.471906    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 00:04:02.487989 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:02.487931    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw" event={"ID":"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b","Type":"ContainerStarted","Data":"1efebb2f3aae9b591000393426a2f686fe95ef1b569fd38ba5bc1a0b3339a24d"}
Sep 11 00:04:02.755746 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:02.755630    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:04:02.755959 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:02.755933    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Sep 11 00:04:02.756041 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:02.756006    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw" podUID="b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Sep 11 00:04:03.756704 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:03.756631    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Sep 11 00:04:03.757127 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:03.756734    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw" podUID="b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Sep 11 00:04:04.755895 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:04.755853    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Sep 11 00:04:04.756098 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:04.755928    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw" podUID="b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Sep 11 00:04:05.756742 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:05.756704    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Sep 11 00:04:05.757149 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:05.756762    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw" podUID="b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Sep 11 00:04:06.756637 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:06.756595    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Sep 11 00:04:06.756859 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:06.756652    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw" podUID="b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Sep 11 00:04:07.369129 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:07.369085    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:04:07.890087 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:07.890060    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:04:07.890567 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:07.890535    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:04:07.891278 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:07.891260    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:04:19.222287 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.222249    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"]
Sep 11 00:04:19.225936 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.225918    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.228304 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.228283    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-51d6fb\"/\"kube-root-ca.crt\""
Sep 11 00:04:19.229433 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.229414    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-51d6fb\"/\"openshift-service-ca.crt\""
Sep 11 00:04:19.229548 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.229418    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-51d6fb\"/\"default-dockercfg-9dxvz\""
Sep 11 00:04:19.229548 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.229419    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-51d6fb\"/\"ipp-route-51d6fb-kserve-self-signed-certs\""
Sep 11 00:04:19.236252 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.236226    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"]
Sep 11 00:04:19.242109 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.242069    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:04:19.359560 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.359534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-dshm\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.359706 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.359681    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-tmp-dir\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.359762 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.359733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f793533f-558b-4702-839e-54f7b36d9909-tls-certs\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.359762 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.359751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcb4c\" (UniqueName: \"kubernetes.io/projected/f793533f-558b-4702-839e-54f7b36d9909-kube-api-access-pcb4c\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.359874 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.359823    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-home\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.359923 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.359885    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-model-cache\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.460549 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.460507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-model-cache\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.460549 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.460553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-dshm\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.460871 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.460618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-tmp-dir\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.460871 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.460638    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f793533f-558b-4702-839e-54f7b36d9909-tls-certs\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.460871 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.460653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcb4c\" (UniqueName: \"kubernetes.io/projected/f793533f-558b-4702-839e-54f7b36d9909-kube-api-access-pcb4c\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.460871 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.460701    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-home\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.461077 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.461005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-model-cache\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.461077 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.461019    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-tmp-dir\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.461197 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.461178    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-home\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.463165 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.463141    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-dshm\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.463397 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.463383    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f793533f-558b-4702-839e-54f7b36d9909-tls-certs\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.469469 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.469445    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcb4c\" (UniqueName: \"kubernetes.io/projected/f793533f-558b-4702-839e-54f7b36d9909-kube-api-access-pcb4c\") pod \"ipp-route-51d6fb-kserve-575544899f-l2gnz\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") " pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.538269 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.538167    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:19.815616 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:19.815592    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"]
Sep 11 00:04:19.817005 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:04:19.816978    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf793533f_558b_4702_839e_54f7b36d9909.slice/crio-df99d1ee911e797cb8b8e60482a04ad95182e195e4ba6d2893121fb9ee14e0fc WatchSource:0}: Error finding container df99d1ee911e797cb8b8e60482a04ad95182e195e4ba6d2893121fb9ee14e0fc: Status 404 returned error can't find the container with id df99d1ee911e797cb8b8e60482a04ad95182e195e4ba6d2893121fb9ee14e0fc
Sep 11 00:04:20.612196 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:20.612140    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz" event={"ID":"f793533f-558b-4702-839e-54f7b36d9909","Type":"ContainerStarted","Data":"2714daa730def82d28f63d9827a0b7ff2865dedd85498850209168e1c9ec561d"}
Sep 11 00:04:20.612808 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:20.612784    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz" event={"ID":"f793533f-558b-4702-839e-54f7b36d9909","Type":"ContainerStarted","Data":"df99d1ee911e797cb8b8e60482a04ad95182e195e4ba6d2893121fb9ee14e0fc"}
Sep 11 00:04:20.633274 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:20.633223    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz" podStartSLOduration=1.633206548 podStartE2EDuration="1.633206548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:04:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:04:20.631488 +0000 UTC m=+1660.672357305" watchObservedRunningTime="2026-09-11 00:04:20.633206548 +0000 UTC m=+1660.674075852"
Sep 11 00:04:23.621611 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:23.621575    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:04:29.539035 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:29.538992    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:29.539558 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:29.539052    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:29.552099 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:29.552064    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:29.681386 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:29.681356    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:04:34.564313 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:34.564278    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:04:46.670185 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:46.670149    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:04:53.527812 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:53.527778    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:04:53.818259 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:53.818163    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:04:53.918571 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:53.918541    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:04:56.769991 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:56.769936    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:04:56.951619 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:56.951589    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:04:57.957427 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:57.957393    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:04:58.055787 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.055746    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:04:58.643608 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.643573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:04:58.674785 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.674751    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"]
Sep 11 00:04:58.678573 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.678557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"
Sep 11 00:04:58.681215 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.681192    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-da536f\""
Sep 11 00:04:58.681215 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.681202    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-da536f-dockercfg-mvz7b\""
Sep 11 00:04:58.686540 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.686509    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"]
Sep 11 00:04:58.728923 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.728882    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:04:58.736586 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.736549    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"]
Sep 11 00:04:58.741031 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.741009    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"
Sep 11 00:04:58.749805 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.749641    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"]
Sep 11 00:04:58.862644 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.862605    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd3d4b98-edcd-424d-b08e-82944876ef1f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77\" (UID: \"cd3d4b98-edcd-424d-b08e-82944876ef1f\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"
Sep 11 00:04:58.862878 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.862705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9eef2b37-ce4d-4e41-9ae3-3f6972a59368-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4\" (UID: \"9eef2b37-ce4d-4e41-9ae3-3f6972a59368\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"
Sep 11 00:04:58.862878 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.862832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-876hz\" (UniqueName: \"kubernetes.io/projected/cd3d4b98-edcd-424d-b08e-82944876ef1f-kube-api-access-876hz\") pod \"payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77\" (UID: \"cd3d4b98-edcd-424d-b08e-82944876ef1f\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"
Sep 11 00:04:58.862878 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.862858    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mhr4\" (UniqueName: \"kubernetes.io/projected/9eef2b37-ce4d-4e41-9ae3-3f6972a59368-kube-api-access-5mhr4\") pod \"payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4\" (UID: \"9eef2b37-ce4d-4e41-9ae3-3f6972a59368\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"
Sep 11 00:04:58.964099 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.964046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-876hz\" (UniqueName: \"kubernetes.io/projected/cd3d4b98-edcd-424d-b08e-82944876ef1f-kube-api-access-876hz\") pod \"payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77\" (UID: \"cd3d4b98-edcd-424d-b08e-82944876ef1f\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"
Sep 11 00:04:58.964099 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.964104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mhr4\" (UniqueName: \"kubernetes.io/projected/9eef2b37-ce4d-4e41-9ae3-3f6972a59368-kube-api-access-5mhr4\") pod \"payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4\" (UID: \"9eef2b37-ce4d-4e41-9ae3-3f6972a59368\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"
Sep 11 00:04:58.964803 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.964169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd3d4b98-edcd-424d-b08e-82944876ef1f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77\" (UID: \"cd3d4b98-edcd-424d-b08e-82944876ef1f\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"
Sep 11 00:04:58.964803 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.964233    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9eef2b37-ce4d-4e41-9ae3-3f6972a59368-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4\" (UID: \"9eef2b37-ce4d-4e41-9ae3-3f6972a59368\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"
Sep 11 00:04:58.965205 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.965172    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd3d4b98-edcd-424d-b08e-82944876ef1f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77\" (UID: \"cd3d4b98-edcd-424d-b08e-82944876ef1f\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"
Sep 11 00:04:58.965313 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.965209    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9eef2b37-ce4d-4e41-9ae3-3f6972a59368-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4\" (UID: \"9eef2b37-ce4d-4e41-9ae3-3f6972a59368\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"
Sep 11 00:04:58.972720 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.972695    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mhr4\" (UniqueName: \"kubernetes.io/projected/9eef2b37-ce4d-4e41-9ae3-3f6972a59368-kube-api-access-5mhr4\") pod \"payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4\" (UID: \"9eef2b37-ce4d-4e41-9ae3-3f6972a59368\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"
Sep 11 00:04:58.972903 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.972881    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-876hz\" (UniqueName: \"kubernetes.io/projected/cd3d4b98-edcd-424d-b08e-82944876ef1f-kube-api-access-876hz\") pod \"payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77\" (UID: \"cd3d4b98-edcd-424d-b08e-82944876ef1f\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"
Sep 11 00:04:58.989901 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:58.989875    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"
Sep 11 00:04:59.055413 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:59.055378    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"
Sep 11 00:04:59.263404 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:59.263377    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"]
Sep 11 00:04:59.266057 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:04:59.266027    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eef2b37_ce4d_4e41_9ae3_3f6972a59368.slice/crio-f50bf445acbc6e4e2778f2bbb39870b5bad01d403c1d20818b7f6b43a4a11d0d WatchSource:0}: Error finding container f50bf445acbc6e4e2778f2bbb39870b5bad01d403c1d20818b7f6b43a4a11d0d: Status 404 returned error can't find the container with id f50bf445acbc6e4e2778f2bbb39870b5bad01d403c1d20818b7f6b43a4a11d0d
Sep 11 00:04:59.340240 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:04:59.340214    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3d4b98_edcd_424d_b08e_82944876ef1f.slice/crio-9173f3b640c8163d21687053d381cb7ff350ea75145607da5fa1cf69ba097b76 WatchSource:0}: Error finding container 9173f3b640c8163d21687053d381cb7ff350ea75145607da5fa1cf69ba097b76: Status 404 returned error can't find the container with id 9173f3b640c8163d21687053d381cb7ff350ea75145607da5fa1cf69ba097b76
Sep 11 00:04:59.340750 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:59.340724    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"]
Sep 11 00:04:59.853489 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:59.853450    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77" event={"ID":"cd3d4b98-edcd-424d-b08e-82944876ef1f","Type":"ContainerStarted","Data":"cd1066fbdc8b793478ef1eeede148df8ad60da1ae887ebba26d6ed4dd8368c57"}
Sep 11 00:04:59.853762 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:59.853514    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77" event={"ID":"cd3d4b98-edcd-424d-b08e-82944876ef1f","Type":"ContainerStarted","Data":"9173f3b640c8163d21687053d381cb7ff350ea75145607da5fa1cf69ba097b76"}
Sep 11 00:04:59.853762 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:59.853615    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"
Sep 11 00:04:59.855284 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:59.855253    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4" event={"ID":"9eef2b37-ce4d-4e41-9ae3-3f6972a59368","Type":"ContainerStarted","Data":"7acdf31d878238480afec701b15f184383a67973e19f2fb7516381a2d8bfb0dd"}
Sep 11 00:04:59.855415 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:59.855304    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4" event={"ID":"9eef2b37-ce4d-4e41-9ae3-3f6972a59368","Type":"ContainerStarted","Data":"f50bf445acbc6e4e2778f2bbb39870b5bad01d403c1d20818b7f6b43a4a11d0d"}
Sep 11 00:04:59.855415 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:59.855360    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"
Sep 11 00:04:59.871072 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:59.871008    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77" podStartSLOduration=1.8709878039999999 podStartE2EDuration="1.870987804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:04:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:04:59.870158739 +0000 UTC m=+1699.911028043" watchObservedRunningTime="2026-09-11 00:04:59.870987804 +0000 UTC m=+1699.911857114"
Sep 11 00:04:59.889344 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:04:59.889288    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4" podStartSLOduration=1.889273834 podStartE2EDuration="1.889273834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:04:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:04:59.887008344 +0000 UTC m=+1699.927877660" watchObservedRunningTime="2026-09-11 00:04:59.889273834 +0000 UTC m=+1699.930143186"
Sep 11 00:05:07.230728 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:07.230628    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:05:10.864233 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:10.864196    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"
Sep 11 00:05:10.864716 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:10.864294    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"
Sep 11 00:05:21.724243 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:21.724199    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:05:28.500246 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.500215    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:05:28.522596 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.522561    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"]
Sep 11 00:05:28.522892 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.522861    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77" podUID="cd3d4b98-edcd-424d-b08e-82944876ef1f" containerName="payload-processing" containerID="cri-o://cd1066fbdc8b793478ef1eeede148df8ad60da1ae887ebba26d6ed4dd8368c57" gracePeriod=30
Sep 11 00:05:28.529899 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.529868    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"]
Sep 11 00:05:28.530328 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.530272    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4" podUID="9eef2b37-ce4d-4e41-9ae3-3f6972a59368" containerName="payload-pre-processing" containerID="cri-o://7acdf31d878238480afec701b15f184383a67973e19f2fb7516381a2d8bfb0dd" gracePeriod=30
Sep 11 00:05:28.600115 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.600086    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:05:28.693606 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.693573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:05:28.774106 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.774015    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:05:28.809791 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.809766    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"
Sep 11 00:05:28.812814 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.812790    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"
Sep 11 00:05:28.969943 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.969904    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9eef2b37-ce4d-4e41-9ae3-3f6972a59368-plugins-config-volume\") pod \"9eef2b37-ce4d-4e41-9ae3-3f6972a59368\" (UID: \"9eef2b37-ce4d-4e41-9ae3-3f6972a59368\") "
Sep 11 00:05:28.970117 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.970047    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-876hz\" (UniqueName: \"kubernetes.io/projected/cd3d4b98-edcd-424d-b08e-82944876ef1f-kube-api-access-876hz\") pod \"cd3d4b98-edcd-424d-b08e-82944876ef1f\" (UID: \"cd3d4b98-edcd-424d-b08e-82944876ef1f\") "
Sep 11 00:05:28.970117 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.970112    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd3d4b98-edcd-424d-b08e-82944876ef1f-plugins-config-volume\") pod \"cd3d4b98-edcd-424d-b08e-82944876ef1f\" (UID: \"cd3d4b98-edcd-424d-b08e-82944876ef1f\") "
Sep 11 00:05:28.970201 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.970172    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mhr4\" (UniqueName: \"kubernetes.io/projected/9eef2b37-ce4d-4e41-9ae3-3f6972a59368-kube-api-access-5mhr4\") pod \"9eef2b37-ce4d-4e41-9ae3-3f6972a59368\" (UID: \"9eef2b37-ce4d-4e41-9ae3-3f6972a59368\") "
Sep 11 00:05:28.970311 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.970280    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9eef2b37-ce4d-4e41-9ae3-3f6972a59368-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9eef2b37-ce4d-4e41-9ae3-3f6972a59368" (UID: "9eef2b37-ce4d-4e41-9ae3-3f6972a59368"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:05:28.970494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.970471    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd3d4b98-edcd-424d-b08e-82944876ef1f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cd3d4b98-edcd-424d-b08e-82944876ef1f" (UID: "cd3d4b98-edcd-424d-b08e-82944876ef1f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:05:28.970580 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.970528    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9eef2b37-ce4d-4e41-9ae3-3f6972a59368-plugins-config-volume\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:05:28.972443 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.972417    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd3d4b98-edcd-424d-b08e-82944876ef1f-kube-api-access-876hz" (OuterVolumeSpecName: "kube-api-access-876hz") pod "cd3d4b98-edcd-424d-b08e-82944876ef1f" (UID: "cd3d4b98-edcd-424d-b08e-82944876ef1f"). InnerVolumeSpecName "kube-api-access-876hz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:05:28.972554 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:28.972460    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eef2b37-ce4d-4e41-9ae3-3f6972a59368-kube-api-access-5mhr4" (OuterVolumeSpecName: "kube-api-access-5mhr4") pod "9eef2b37-ce4d-4e41-9ae3-3f6972a59368" (UID: "9eef2b37-ce4d-4e41-9ae3-3f6972a59368"). InnerVolumeSpecName "kube-api-access-5mhr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:05:29.043555 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.043454    2581 generic.go:356] "Generic (PLEG): container finished" podID="cd3d4b98-edcd-424d-b08e-82944876ef1f" containerID="cd1066fbdc8b793478ef1eeede148df8ad60da1ae887ebba26d6ed4dd8368c57" exitCode=0
Sep 11 00:05:29.043555 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.043513    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"
Sep 11 00:05:29.043555 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.043534    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77" event={"ID":"cd3d4b98-edcd-424d-b08e-82944876ef1f","Type":"ContainerDied","Data":"cd1066fbdc8b793478ef1eeede148df8ad60da1ae887ebba26d6ed4dd8368c57"}
Sep 11 00:05:29.043881 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.043617    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77" event={"ID":"cd3d4b98-edcd-424d-b08e-82944876ef1f","Type":"ContainerDied","Data":"9173f3b640c8163d21687053d381cb7ff350ea75145607da5fa1cf69ba097b76"}
Sep 11 00:05:29.043881 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.043648    2581 scope.go:117] "RemoveContainer" containerID="cd1066fbdc8b793478ef1eeede148df8ad60da1ae887ebba26d6ed4dd8368c57"
Sep 11 00:05:29.045003 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.044965    2581 generic.go:356] "Generic (PLEG): container finished" podID="9eef2b37-ce4d-4e41-9ae3-3f6972a59368" containerID="7acdf31d878238480afec701b15f184383a67973e19f2fb7516381a2d8bfb0dd" exitCode=0
Sep 11 00:05:29.045135 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.045021    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"
Sep 11 00:05:29.045135 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.045061    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4" event={"ID":"9eef2b37-ce4d-4e41-9ae3-3f6972a59368","Type":"ContainerDied","Data":"7acdf31d878238480afec701b15f184383a67973e19f2fb7516381a2d8bfb0dd"}
Sep 11 00:05:29.045135 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.045117    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4" event={"ID":"9eef2b37-ce4d-4e41-9ae3-3f6972a59368","Type":"ContainerDied","Data":"f50bf445acbc6e4e2778f2bbb39870b5bad01d403c1d20818b7f6b43a4a11d0d"}
Sep 11 00:05:29.054889 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.054871    2581 scope.go:117] "RemoveContainer" containerID="cd1066fbdc8b793478ef1eeede148df8ad60da1ae887ebba26d6ed4dd8368c57"
Sep 11 00:05:29.055231 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:05:29.055214    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd1066fbdc8b793478ef1eeede148df8ad60da1ae887ebba26d6ed4dd8368c57\": container with ID starting with cd1066fbdc8b793478ef1eeede148df8ad60da1ae887ebba26d6ed4dd8368c57 not found: ID does not exist" containerID="cd1066fbdc8b793478ef1eeede148df8ad60da1ae887ebba26d6ed4dd8368c57"
Sep 11 00:05:29.055289 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.055239    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd1066fbdc8b793478ef1eeede148df8ad60da1ae887ebba26d6ed4dd8368c57"} err="failed to get container status \"cd1066fbdc8b793478ef1eeede148df8ad60da1ae887ebba26d6ed4dd8368c57\": rpc error: code = NotFound desc = could not find container \"cd1066fbdc8b793478ef1eeede148df8ad60da1ae887ebba26d6ed4dd8368c57\": container with ID starting with cd1066fbdc8b793478ef1eeede148df8ad60da1ae887ebba26d6ed4dd8368c57 not found: ID does not exist"
Sep 11 00:05:29.055289 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.055256    2581 scope.go:117] "RemoveContainer" containerID="7acdf31d878238480afec701b15f184383a67973e19f2fb7516381a2d8bfb0dd"
Sep 11 00:05:29.065085 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.065033    2581 scope.go:117] "RemoveContainer" containerID="7acdf31d878238480afec701b15f184383a67973e19f2fb7516381a2d8bfb0dd"
Sep 11 00:05:29.065410 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:05:29.065384    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7acdf31d878238480afec701b15f184383a67973e19f2fb7516381a2d8bfb0dd\": container with ID starting with 7acdf31d878238480afec701b15f184383a67973e19f2fb7516381a2d8bfb0dd not found: ID does not exist" containerID="7acdf31d878238480afec701b15f184383a67973e19f2fb7516381a2d8bfb0dd"
Sep 11 00:05:29.065499 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.065421    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7acdf31d878238480afec701b15f184383a67973e19f2fb7516381a2d8bfb0dd"} err="failed to get container status \"7acdf31d878238480afec701b15f184383a67973e19f2fb7516381a2d8bfb0dd\": rpc error: code = NotFound desc = could not find container \"7acdf31d878238480afec701b15f184383a67973e19f2fb7516381a2d8bfb0dd\": container with ID starting with 7acdf31d878238480afec701b15f184383a67973e19f2fb7516381a2d8bfb0dd not found: ID does not exist"
Sep 11 00:05:29.066082 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.066061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:05:29.071561 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.071538    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"]
Sep 11 00:05:29.071893 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.071871    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mhr4\" (UniqueName: \"kubernetes.io/projected/9eef2b37-ce4d-4e41-9ae3-3f6972a59368-kube-api-access-5mhr4\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:05:29.071954 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.071899    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-876hz\" (UniqueName: \"kubernetes.io/projected/cd3d4b98-edcd-424d-b08e-82944876ef1f-kube-api-access-876hz\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:05:29.071954 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.071914    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd3d4b98-edcd-424d-b08e-82944876ef1f-plugins-config-volume\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:05:29.074041 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.074023    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77"]
Sep 11 00:05:29.083564 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.083543    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"]
Sep 11 00:05:29.087418 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:29.087397    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4"]
Sep 11 00:05:30.484465 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:30.484429    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9eef2b37-ce4d-4e41-9ae3-3f6972a59368" path="/var/lib/kubelet/pods/9eef2b37-ce4d-4e41-9ae3-3f6972a59368/volumes"
Sep 11 00:05:30.484914 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:30.484899    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd3d4b98-edcd-424d-b08e-82944876ef1f" path="/var/lib/kubelet/pods/cd3d4b98-edcd-424d-b08e-82944876ef1f/volumes"
Sep 11 00:05:32.927799 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:32.927763    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:05:34.766620 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:34.766584    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:05:34.867342 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:34.867314    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:05:35.007015 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:35.006984    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:05:38.467781 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:38.467745    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl"]
Sep 11 00:05:38.468173 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:38.468143    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eef2b37-ce4d-4e41-9ae3-3f6972a59368" containerName="payload-pre-processing"
Sep 11 00:05:38.468173 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:38.468156    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eef2b37-ce4d-4e41-9ae3-3f6972a59368" containerName="payload-pre-processing"
Sep 11 00:05:38.468173 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:38.468173    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd3d4b98-edcd-424d-b08e-82944876ef1f" containerName="payload-processing"
Sep 11 00:05:38.468287 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:38.468179    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd3d4b98-edcd-424d-b08e-82944876ef1f" containerName="payload-processing"
Sep 11 00:05:38.468287 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:38.468239    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd3d4b98-edcd-424d-b08e-82944876ef1f" containerName="payload-processing"
Sep 11 00:05:38.468287 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:38.468251    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9eef2b37-ce4d-4e41-9ae3-3f6972a59368" containerName="payload-pre-processing"
Sep 11 00:05:38.473377 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:38.473354    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl"
Sep 11 00:05:38.476863 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:38.476836    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 00:05:38.477018 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:38.476837    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-22lrj\""
Sep 11 00:05:38.486356 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:38.486329    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl"]
Sep 11 00:05:38.562398 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:38.562360    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f8221d9-db79-4306-a6ac-177f7e000254-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl\" (UID: \"2f8221d9-db79-4306-a6ac-177f7e000254\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl"
Sep 11 00:05:38.662947 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:38.662903    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f8221d9-db79-4306-a6ac-177f7e000254-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl\" (UID: \"2f8221d9-db79-4306-a6ac-177f7e000254\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl"
Sep 11 00:05:38.663524 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:38.663502    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f8221d9-db79-4306-a6ac-177f7e000254-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl\" (UID: \"2f8221d9-db79-4306-a6ac-177f7e000254\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl"
Sep 11 00:05:38.721078 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:38.721007    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:05:38.787172 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:38.787138    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl"
Sep 11 00:05:39.060681 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:39.060629    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl"]
Sep 11 00:05:39.062409 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:05:39.062385    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f8221d9_db79_4306_a6ac_177f7e000254.slice/crio-bae1845187236e7bf953e8ce50fccfca5ddfaca944a6dd46e44b82411481686c WatchSource:0}: Error finding container bae1845187236e7bf953e8ce50fccfca5ddfaca944a6dd46e44b82411481686c: Status 404 returned error can't find the container with id bae1845187236e7bf953e8ce50fccfca5ddfaca944a6dd46e44b82411481686c
Sep 11 00:05:39.112824 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:39.112794    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl" event={"ID":"2f8221d9-db79-4306-a6ac-177f7e000254","Type":"ContainerStarted","Data":"bae1845187236e7bf953e8ce50fccfca5ddfaca944a6dd46e44b82411481686c"}
Sep 11 00:05:40.121168 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:40.121080    2581 generic.go:356] "Generic (PLEG): container finished" podID="2f8221d9-db79-4306-a6ac-177f7e000254" containerID="d0e139c132a5999d337da94f82eba96cc9c232857e889ba078392f1372c264ac" exitCode=0
Sep 11 00:05:40.121168 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:40.121125    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl" event={"ID":"2f8221d9-db79-4306-a6ac-177f7e000254","Type":"ContainerDied","Data":"d0e139c132a5999d337da94f82eba96cc9c232857e889ba078392f1372c264ac"}
Sep 11 00:05:41.264692 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:41.264636    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl"
Sep 11 00:05:41.295905 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:41.295873    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f8221d9-db79-4306-a6ac-177f7e000254-maas-api-service-ca\") pod \"2f8221d9-db79-4306-a6ac-177f7e000254\" (UID: \"2f8221d9-db79-4306-a6ac-177f7e000254\") "
Sep 11 00:05:41.296226 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:41.296199    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f8221d9-db79-4306-a6ac-177f7e000254-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2f8221d9-db79-4306-a6ac-177f7e000254" (UID: "2f8221d9-db79-4306-a6ac-177f7e000254"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:05:41.397418 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:41.397379    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f8221d9-db79-4306-a6ac-177f7e000254-maas-api-service-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:05:42.134717 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:42.134654    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl"
Sep 11 00:05:42.134717 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:42.134701    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl" event={"ID":"2f8221d9-db79-4306-a6ac-177f7e000254","Type":"ContainerDied","Data":"bae1845187236e7bf953e8ce50fccfca5ddfaca944a6dd46e44b82411481686c"}
Sep 11 00:05:42.134945 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:42.134748    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bae1845187236e7bf953e8ce50fccfca5ddfaca944a6dd46e44b82411481686c"
Sep 11 00:05:51.922727 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:51.922685    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:05:54.088092 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:54.088053    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:05:54.193279 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:54.193241    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:05:54.229549 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:54.229515    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl"]
Sep 11 00:05:54.232093 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:54.232067    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-51d6fb-tmpkl"]
Sep 11 00:05:54.286391 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:54.286350    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:05:54.484460 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:54.484429    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f8221d9-db79-4306-a6ac-177f7e000254" path="/var/lib/kubelet/pods/2f8221d9-db79-4306-a6ac-177f7e000254/volumes"
Sep 11 00:05:54.619505 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:54.619471    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:05:59.578300 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:59.578262    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"]
Sep 11 00:05:59.673972 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:05:59.673938    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:06:04.086094 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:04.086041    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:06:04.721276 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:04.721247    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:06:14.599298 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:14.599252    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz" podUID="f793533f-558b-4702-839e-54f7b36d9909" containerName="main" containerID="cri-o://2714daa730def82d28f63d9827a0b7ff2865dedd85498850209168e1c9ec561d" gracePeriod=45
Sep 11 00:06:14.864916 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:14.864854    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:06:14.910091 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:14.910051    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-tmp-dir\") pod \"f793533f-558b-4702-839e-54f7b36d9909\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") "
Sep 11 00:06:14.910282 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:14.910115    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f793533f-558b-4702-839e-54f7b36d9909-tls-certs\") pod \"f793533f-558b-4702-839e-54f7b36d9909\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") "
Sep 11 00:06:14.910282 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:14.910153    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-dshm\") pod \"f793533f-558b-4702-839e-54f7b36d9909\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") "
Sep 11 00:06:14.910282 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:14.910184    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcb4c\" (UniqueName: \"kubernetes.io/projected/f793533f-558b-4702-839e-54f7b36d9909-kube-api-access-pcb4c\") pod \"f793533f-558b-4702-839e-54f7b36d9909\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") "
Sep 11 00:06:14.910282 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:14.910231    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-home\") pod \"f793533f-558b-4702-839e-54f7b36d9909\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") "
Sep 11 00:06:14.910282 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:14.910256    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-model-cache\") pod \"f793533f-558b-4702-839e-54f7b36d9909\" (UID: \"f793533f-558b-4702-839e-54f7b36d9909\") "
Sep 11 00:06:14.910879 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:14.910849    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f793533f-558b-4702-839e-54f7b36d9909" (UID: "f793533f-558b-4702-839e-54f7b36d9909"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:06:14.911071 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:14.910880    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-home" (OuterVolumeSpecName: "home") pod "f793533f-558b-4702-839e-54f7b36d9909" (UID: "f793533f-558b-4702-839e-54f7b36d9909"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:06:14.911197 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:14.911003    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-model-cache" (OuterVolumeSpecName: "model-cache") pod "f793533f-558b-4702-839e-54f7b36d9909" (UID: "f793533f-558b-4702-839e-54f7b36d9909"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:06:14.913129 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:14.913101    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f793533f-558b-4702-839e-54f7b36d9909-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f793533f-558b-4702-839e-54f7b36d9909" (UID: "f793533f-558b-4702-839e-54f7b36d9909"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:06:14.913776 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:14.913746    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-dshm" (OuterVolumeSpecName: "dshm") pod "f793533f-558b-4702-839e-54f7b36d9909" (UID: "f793533f-558b-4702-839e-54f7b36d9909"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:06:14.913891 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:14.913843    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f793533f-558b-4702-839e-54f7b36d9909-kube-api-access-pcb4c" (OuterVolumeSpecName: "kube-api-access-pcb4c") pod "f793533f-558b-4702-839e-54f7b36d9909" (UID: "f793533f-558b-4702-839e-54f7b36d9909"). InnerVolumeSpecName "kube-api-access-pcb4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:06:15.011066 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:15.011026    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-home\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:06:15.011066 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:15.011054    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-model-cache\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:06:15.011066 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:15.011065    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-tmp-dir\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:06:15.011066 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:15.011073    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f793533f-558b-4702-839e-54f7b36d9909-tls-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:06:15.011066 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:15.011080    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f793533f-558b-4702-839e-54f7b36d9909-dshm\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:06:15.011552 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:15.011089    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcb4c\" (UniqueName: \"kubernetes.io/projected/f793533f-558b-4702-839e-54f7b36d9909-kube-api-access-pcb4c\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:06:15.335209 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:15.335172    2581 generic.go:356] "Generic (PLEG): container finished" podID="f793533f-558b-4702-839e-54f7b36d9909" containerID="2714daa730def82d28f63d9827a0b7ff2865dedd85498850209168e1c9ec561d" exitCode=0
Sep 11 00:06:15.335397 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:15.335214    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"
Sep 11 00:06:15.335397 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:15.335269    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz" event={"ID":"f793533f-558b-4702-839e-54f7b36d9909","Type":"ContainerDied","Data":"2714daa730def82d28f63d9827a0b7ff2865dedd85498850209168e1c9ec561d"}
Sep 11 00:06:15.335397 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:15.335312    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz" event={"ID":"f793533f-558b-4702-839e-54f7b36d9909","Type":"ContainerDied","Data":"df99d1ee911e797cb8b8e60482a04ad95182e195e4ba6d2893121fb9ee14e0fc"}
Sep 11 00:06:15.335397 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:15.335332    2581 scope.go:117] "RemoveContainer" containerID="2714daa730def82d28f63d9827a0b7ff2865dedd85498850209168e1c9ec561d"
Sep 11 00:06:15.351934 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:15.351913    2581 scope.go:117] "RemoveContainer" containerID="2714daa730def82d28f63d9827a0b7ff2865dedd85498850209168e1c9ec561d"
Sep 11 00:06:15.352240 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:06:15.352221    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2714daa730def82d28f63d9827a0b7ff2865dedd85498850209168e1c9ec561d\": container with ID starting with 2714daa730def82d28f63d9827a0b7ff2865dedd85498850209168e1c9ec561d not found: ID does not exist" containerID="2714daa730def82d28f63d9827a0b7ff2865dedd85498850209168e1c9ec561d"
Sep 11 00:06:15.352280 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:15.352251    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2714daa730def82d28f63d9827a0b7ff2865dedd85498850209168e1c9ec561d"} err="failed to get container status \"2714daa730def82d28f63d9827a0b7ff2865dedd85498850209168e1c9ec561d\": rpc error: code = NotFound desc = could not find container \"2714daa730def82d28f63d9827a0b7ff2865dedd85498850209168e1c9ec561d\": container with ID starting with 2714daa730def82d28f63d9827a0b7ff2865dedd85498850209168e1c9ec561d not found: ID does not exist"
Sep 11 00:06:15.365195 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:15.365158    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"]
Sep 11 00:06:15.368479 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:15.368456    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-51d6fb/ipp-route-51d6fb-kserve-575544899f-l2gnz"]
Sep 11 00:06:16.483820 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:16.483788    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f793533f-558b-4702-839e-54f7b36d9909" path="/var/lib/kubelet/pods/f793533f-558b-4702-839e-54f7b36d9909/volumes"
Sep 11 00:06:23.924411 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:23.924365    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:06:34.224741 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:34.224620    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:06:36.288259 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:36.288232    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:06:36.698248 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:36.698160    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:06:39.935246 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:39.935189    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:06:40.035892 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:40.035860    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:06:40.955089 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:40.955051    2581 scope.go:117] "RemoveContainer" containerID="a0071643e95e20255d0e1873b9f1d884a0dd6808e6290acdf9b892c91fe6addd"
Sep 11 00:06:42.343727 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:06:42.343693    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:13.706561 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:13.706525    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:13.772924 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:13.772887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:14.014909 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:14.014795    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:14.528566 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:14.528515    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:25.009507 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.009470    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:25.047606 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.047574    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"]
Sep 11 00:07:25.047901 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.047868    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb" podUID="e5d0c7c8-274e-406b-9b1b-6ec1c256b86f" containerName="payload-pre-processing" containerID="cri-o://28b34728e26cb6c466902cd4758a9481142b1b4c43b8a4118cf570a87319ce2d" gracePeriod=30
Sep 11 00:07:25.109142 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.109100    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:25.308098 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.308071    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"
Sep 11 00:07:25.354475 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.354439    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:25.385098 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.385061    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5d0c7c8-274e-406b-9b1b-6ec1c256b86f-plugins-config-volume\") pod \"e5d0c7c8-274e-406b-9b1b-6ec1c256b86f\" (UID: \"e5d0c7c8-274e-406b-9b1b-6ec1c256b86f\") "
Sep 11 00:07:25.385310 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.385156    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcwrl\" (UniqueName: \"kubernetes.io/projected/e5d0c7c8-274e-406b-9b1b-6ec1c256b86f-kube-api-access-rcwrl\") pod \"e5d0c7c8-274e-406b-9b1b-6ec1c256b86f\" (UID: \"e5d0c7c8-274e-406b-9b1b-6ec1c256b86f\") "
Sep 11 00:07:25.385506 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.385484    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5d0c7c8-274e-406b-9b1b-6ec1c256b86f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e5d0c7c8-274e-406b-9b1b-6ec1c256b86f" (UID: "e5d0c7c8-274e-406b-9b1b-6ec1c256b86f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:07:25.387653 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.387620    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5d0c7c8-274e-406b-9b1b-6ec1c256b86f-kube-api-access-rcwrl" (OuterVolumeSpecName: "kube-api-access-rcwrl") pod "e5d0c7c8-274e-406b-9b1b-6ec1c256b86f" (UID: "e5d0c7c8-274e-406b-9b1b-6ec1c256b86f"). InnerVolumeSpecName "kube-api-access-rcwrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:07:25.486558 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.486522    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcwrl\" (UniqueName: \"kubernetes.io/projected/e5d0c7c8-274e-406b-9b1b-6ec1c256b86f-kube-api-access-rcwrl\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:25.486558 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.486550    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5d0c7c8-274e-406b-9b1b-6ec1c256b86f-plugins-config-volume\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:25.499251 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.499213    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:25.684391 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.684305    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:25.753094 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.753058    2581 generic.go:356] "Generic (PLEG): container finished" podID="e5d0c7c8-274e-406b-9b1b-6ec1c256b86f" containerID="28b34728e26cb6c466902cd4758a9481142b1b4c43b8a4118cf570a87319ce2d" exitCode=0
Sep 11 00:07:25.753296 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.753103    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"
Sep 11 00:07:25.753296 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.753148    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb" event={"ID":"e5d0c7c8-274e-406b-9b1b-6ec1c256b86f","Type":"ContainerDied","Data":"28b34728e26cb6c466902cd4758a9481142b1b4c43b8a4118cf570a87319ce2d"}
Sep 11 00:07:25.753296 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.753207    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb" event={"ID":"e5d0c7c8-274e-406b-9b1b-6ec1c256b86f","Type":"ContainerDied","Data":"4d966ca684ba0ada89ae1911bdf70d6aa92bad992861f51bd5224754c7eadf52"}
Sep 11 00:07:25.753296 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.753233    2581 scope.go:117] "RemoveContainer" containerID="28b34728e26cb6c466902cd4758a9481142b1b4c43b8a4118cf570a87319ce2d"
Sep 11 00:07:25.763368 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.763349    2581 scope.go:117] "RemoveContainer" containerID="28b34728e26cb6c466902cd4758a9481142b1b4c43b8a4118cf570a87319ce2d"
Sep 11 00:07:25.763650 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:07:25.763633    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28b34728e26cb6c466902cd4758a9481142b1b4c43b8a4118cf570a87319ce2d\": container with ID starting with 28b34728e26cb6c466902cd4758a9481142b1b4c43b8a4118cf570a87319ce2d not found: ID does not exist" containerID="28b34728e26cb6c466902cd4758a9481142b1b4c43b8a4118cf570a87319ce2d"
Sep 11 00:07:25.763712 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.763661    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b34728e26cb6c466902cd4758a9481142b1b4c43b8a4118cf570a87319ce2d"} err="failed to get container status \"28b34728e26cb6c466902cd4758a9481142b1b4c43b8a4118cf570a87319ce2d\": rpc error: code = NotFound desc = could not find container \"28b34728e26cb6c466902cd4758a9481142b1b4c43b8a4118cf570a87319ce2d\": container with ID starting with 28b34728e26cb6c466902cd4758a9481142b1b4c43b8a4118cf570a87319ce2d not found: ID does not exist"
Sep 11 00:07:25.774706 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.774683    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"]
Sep 11 00:07:25.778605 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:25.778584    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb"]
Sep 11 00:07:26.491885 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:26.491851    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5d0c7c8-274e-406b-9b1b-6ec1c256b86f" path="/var/lib/kubelet/pods/e5d0c7c8-274e-406b-9b1b-6ec1c256b86f/volumes"
Sep 11 00:07:28.617742 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:28.617705    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:07:31.428304 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:31.428248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:31.685572 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:31.685483    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"]
Sep 11 00:07:31.685802 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:31.685776    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw" podUID="b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" containerName="istio-proxy" containerID="cri-o://1efebb2f3aae9b591000393426a2f686fe95ef1b569fd38ba5bc1a0b3339a24d" gracePeriod=30
Sep 11 00:07:34.208340 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:34.208306    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:36.837821 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.837778    2581 generic.go:356] "Generic (PLEG): container finished" podID="b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" containerID="1efebb2f3aae9b591000393426a2f686fe95ef1b569fd38ba5bc1a0b3339a24d" exitCode=0
Sep 11 00:07:36.838207 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.837842    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw" event={"ID":"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b","Type":"ContainerDied","Data":"1efebb2f3aae9b591000393426a2f686fe95ef1b569fd38ba5bc1a0b3339a24d"}
Sep 11 00:07:36.838207 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.837905    2581 scope.go:117] "RemoveContainer" containerID="7c7b10da9ba2c0b43ba87ba8eac24fee07ed87e12201f7835fc366cc5baa24c9"
Sep 11 00:07:36.941930 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.941906    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:07:36.995494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.995461    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-podinfo\") pod \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") "
Sep 11 00:07:36.995715 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.995517    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-token\") pod \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") "
Sep 11 00:07:36.995715 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.995543    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-977nq\" (UniqueName: \"kubernetes.io/projected/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-kube-api-access-977nq\") pod \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") "
Sep 11 00:07:36.995715 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.995576    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-workload-certs\") pod \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") "
Sep 11 00:07:36.995715 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.995625    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istiod-ca-cert\") pod \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") "
Sep 11 00:07:36.995715 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.995661    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-envoy\") pod \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") "
Sep 11 00:07:36.995996 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.995724    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-workload-socket\") pod \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") "
Sep 11 00:07:36.995996 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.995768    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-credential-socket\") pod \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") "
Sep 11 00:07:36.995996 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.995792    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-data\") pod \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\" (UID: \"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b\") "
Sep 11 00:07:36.995996 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.995941    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" (UID: "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:07:36.996212 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.996154    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" (UID: "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:07:36.996212 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.996172    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-workload-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:36.996212 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.996187    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" (UID: "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:07:36.996546 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.996212    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" (UID: "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:07:36.996546 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.996361    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" (UID: "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:07:36.998056 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.998026    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-kube-api-access-977nq" (OuterVolumeSpecName: "kube-api-access-977nq") pod "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" (UID: "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b"). InnerVolumeSpecName "kube-api-access-977nq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:07:36.998174 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.998157    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" (UID: "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:07:36.998553 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.998526    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" (UID: "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 00:07:36.998553 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:36.998534    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" (UID: "b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:07:37.097224 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:37.097192    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-token\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:37.097224 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:37.097218    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-977nq\" (UniqueName: \"kubernetes.io/projected/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-kube-api-access-977nq\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:37.097224 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:37.097229    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istiod-ca-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:37.097456 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:37.097236    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-envoy\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:37.097456 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:37.097243    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-workload-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:37.097456 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:37.097252    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-credential-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:37.097456 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:37.097262    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-data\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:37.097456 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:37.097270    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b-istio-podinfo\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:37.845609 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:37.845567    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw" event={"ID":"b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b","Type":"ContainerDied","Data":"d2c80f8c1589bab6fa932dc96497066f97311ba280cf3b4075cd3eb97b228182"}
Sep 11 00:07:37.846081 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:37.845639    2581 scope.go:117] "RemoveContainer" containerID="1efebb2f3aae9b591000393426a2f686fe95ef1b569fd38ba5bc1a0b3339a24d"
Sep 11 00:07:37.846081 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:37.845577    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"
Sep 11 00:07:37.874694 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:37.873776    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"]
Sep 11 00:07:37.879035 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:37.879008    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw"]
Sep 11 00:07:38.483948 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:38.483916    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" path="/var/lib/kubelet/pods/b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b/volumes"
Sep 11 00:07:40.984535 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:40.984506    2581 scope.go:117] "RemoveContainer" containerID="71cfda8e5093c7837d2369bd1cf2ad44bfab541ffdbf8fb4da266350fc774591"
Sep 11 00:07:42.599604 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:42.599571    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:42.691733 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:42.691647    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:42.760310 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:42.760277    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:42.887103 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:42.887012    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:42.969512 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:42.969478    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:43.222790 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:43.222759    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:45.424316 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:45.424283    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:07:49.347250 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:49.347208    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:49.446608 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:49.446570    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:49.577512 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:49.577474    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"]
Sep 11 00:07:49.577781 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:49.577746    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b" podUID="dc4342e8-dd5d-48ef-96e2-f093cecdae6f" containerName="istio-proxy" containerID="cri-o://69b14a7861795d6767ca2c83f69b338b7ebb341fb452bf9a2031a84c23e0f69d" gracePeriod=30
Sep 11 00:07:49.603437 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:49.603363    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:50.128774 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:50.128743    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:07:54.822938 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.822908    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 11 00:07:54.945401 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.945304    2581 generic.go:356] "Generic (PLEG): container finished" podID="dc4342e8-dd5d-48ef-96e2-f093cecdae6f" containerID="69b14a7861795d6767ca2c83f69b338b7ebb341fb452bf9a2031a84c23e0f69d" exitCode=0
Sep 11 00:07:54.945401 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.945352    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"
Sep 11 00:07:54.945401 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.945388    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b" event={"ID":"dc4342e8-dd5d-48ef-96e2-f093cecdae6f","Type":"ContainerDied","Data":"69b14a7861795d6767ca2c83f69b338b7ebb341fb452bf9a2031a84c23e0f69d"}
Sep 11 00:07:54.945722 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.945448    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b" event={"ID":"dc4342e8-dd5d-48ef-96e2-f093cecdae6f","Type":"ContainerDied","Data":"b144acb47df2acdfc5caa20167805641893be7703676ef238eea0c67dd66b656"}
Sep 11 00:07:54.945722 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.945476    2581 scope.go:117] "RemoveContainer" containerID="69b14a7861795d6767ca2c83f69b338b7ebb341fb452bf9a2031a84c23e0f69d"
Sep 11 00:07:54.954485 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.954467    2581 scope.go:117] "RemoveContainer" containerID="be145786d2446181a3810c1fd7db658c8e4d9e2766d2d7afe814b2768b1b38b4"
Sep 11 00:07:54.959760 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.959735    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-credential-socket\") pod \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") "
Sep 11 00:07:54.959858 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.959773    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-envoy\") pod \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") "
Sep 11 00:07:54.959858 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.959800    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-workload-certs\") pod \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") "
Sep 11 00:07:54.959858 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.959828    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istiod-ca-cert\") pod \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") "
Sep 11 00:07:54.960024 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.959866    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t559f\" (UniqueName: \"kubernetes.io/projected/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-kube-api-access-t559f\") pod \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") "
Sep 11 00:07:54.960024 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.959935    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-data\") pod \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") "
Sep 11 00:07:54.960024 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.959995    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dc4342e8-dd5d-48ef-96e2-f093cecdae6f" (UID: "dc4342e8-dd5d-48ef-96e2-f093cecdae6f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:07:54.960024 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.960013    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-workload-socket\") pod \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") "
Sep 11 00:07:54.960239 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.960042    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-token\") pod \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") "
Sep 11 00:07:54.960239 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.960099    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-podinfo\") pod \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\" (UID: \"dc4342e8-dd5d-48ef-96e2-f093cecdae6f\") "
Sep 11 00:07:54.960239 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.960127    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dc4342e8-dd5d-48ef-96e2-f093cecdae6f" (UID: "dc4342e8-dd5d-48ef-96e2-f093cecdae6f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:07:54.960400 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.960286    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-data" (OuterVolumeSpecName: "istio-data") pod "dc4342e8-dd5d-48ef-96e2-f093cecdae6f" (UID: "dc4342e8-dd5d-48ef-96e2-f093cecdae6f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:07:54.960400 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.960361    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dc4342e8-dd5d-48ef-96e2-f093cecdae6f" (UID: "dc4342e8-dd5d-48ef-96e2-f093cecdae6f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:07:54.960696 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.960471    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-data\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:54.960696 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.960489    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-credential-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:54.960696 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.960504    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-workload-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:54.960696 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.960518    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istiod-ca-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:54.960920 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.960780    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dc4342e8-dd5d-48ef-96e2-f093cecdae6f" (UID: "dc4342e8-dd5d-48ef-96e2-f093cecdae6f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:07:54.962331 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.962291    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-kube-api-access-t559f" (OuterVolumeSpecName: "kube-api-access-t559f") pod "dc4342e8-dd5d-48ef-96e2-f093cecdae6f" (UID: "dc4342e8-dd5d-48ef-96e2-f093cecdae6f"). InnerVolumeSpecName "kube-api-access-t559f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:07:54.962439 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.962360    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dc4342e8-dd5d-48ef-96e2-f093cecdae6f" (UID: "dc4342e8-dd5d-48ef-96e2-f093cecdae6f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:07:54.962501 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.962439    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-token" (OuterVolumeSpecName: "istio-token") pod "dc4342e8-dd5d-48ef-96e2-f093cecdae6f" (UID: "dc4342e8-dd5d-48ef-96e2-f093cecdae6f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:07:54.962876 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.962856    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dc4342e8-dd5d-48ef-96e2-f093cecdae6f" (UID: "dc4342e8-dd5d-48ef-96e2-f093cecdae6f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 00:07:54.964475 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.964459    2581 scope.go:117] "RemoveContainer" containerID="69b14a7861795d6767ca2c83f69b338b7ebb341fb452bf9a2031a84c23e0f69d"
Sep 11 00:07:54.964855 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:07:54.964830    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69b14a7861795d6767ca2c83f69b338b7ebb341fb452bf9a2031a84c23e0f69d\": container with ID starting with 69b14a7861795d6767ca2c83f69b338b7ebb341fb452bf9a2031a84c23e0f69d not found: ID does not exist" containerID="69b14a7861795d6767ca2c83f69b338b7ebb341fb452bf9a2031a84c23e0f69d"
Sep 11 00:07:54.964975 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.964860    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69b14a7861795d6767ca2c83f69b338b7ebb341fb452bf9a2031a84c23e0f69d"} err="failed to get container status \"69b14a7861795d6767ca2c83f69b338b7ebb341fb452bf9a2031a84c23e0f69d\": rpc error: code = NotFound desc = could not find container \"69b14a7861795d6767ca2c83f69b338b7ebb341fb452bf9a2031a84c23e0f69d\": container with ID starting with 69b14a7861795d6767ca2c83f69b338b7ebb341fb452bf9a2031a84c23e0f69d not found: ID does not exist"
Sep 11 00:07:54.964975 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.964877    2581 scope.go:117] "RemoveContainer" containerID="be145786d2446181a3810c1fd7db658c8e4d9e2766d2d7afe814b2768b1b38b4"
Sep 11 00:07:54.965166 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:07:54.965152    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be145786d2446181a3810c1fd7db658c8e4d9e2766d2d7afe814b2768b1b38b4\": container with ID starting with be145786d2446181a3810c1fd7db658c8e4d9e2766d2d7afe814b2768b1b38b4 not found: ID does not exist" containerID="be145786d2446181a3810c1fd7db658c8e4d9e2766d2d7afe814b2768b1b38b4"
Sep 11 00:07:54.965225 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:54.965171    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be145786d2446181a3810c1fd7db658c8e4d9e2766d2d7afe814b2768b1b38b4"} err="failed to get container status \"be145786d2446181a3810c1fd7db658c8e4d9e2766d2d7afe814b2768b1b38b4\": rpc error: code = NotFound desc = could not find container \"be145786d2446181a3810c1fd7db658c8e4d9e2766d2d7afe814b2768b1b38b4\": container with ID starting with be145786d2446181a3810c1fd7db658c8e4d9e2766d2d7afe814b2768b1b38b4 not found: ID does not exist"
Sep 11 00:07:55.061957 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:55.061917    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-workload-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:55.061957 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:55.061951    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-token\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:55.061957 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:55.061965    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-podinfo\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:55.062206 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:55.061977    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-istio-envoy\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:55.062206 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:55.061988    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t559f\" (UniqueName: \"kubernetes.io/projected/dc4342e8-dd5d-48ef-96e2-f093cecdae6f-kube-api-access-t559f\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:07:55.276529 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:55.269998    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"]
Sep 11 00:07:55.276529 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:55.275853    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b"]
Sep 11 00:07:56.484288 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:07:56.484249    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc4342e8-dd5d-48ef-96e2-f093cecdae6f" path="/var/lib/kubelet/pods/dc4342e8-dd5d-48ef-96e2-f093cecdae6f/volumes"
Sep 11 00:08:00.423960 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.423865    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:08:00.424568 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.424538    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e96d4c-29818080-tzn8c"]
Sep 11 00:08:00.426795 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.426773    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e96d4c-29818080-tzn8c"]
Sep 11 00:08:00.449360 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.449330    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"]
Sep 11 00:08:00.449574 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.449548    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl" podUID="83f2a448-d6eb-4c60-b152-ff675ed63d64" containerName="payload-processing" containerID="cri-o://7a2054b406db293ec150c94875e591286317fb69e6e63a5d4c62d23f171b1b19" gracePeriod=30
Sep 11 00:08:00.485332 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.485301    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bad2802-eaad-4e58-baac-13a56b872b26" path="/var/lib/kubelet/pods/6bad2802-eaad-4e58-baac-13a56b872b26/volumes"
Sep 11 00:08:00.521146 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.521108    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:08:00.621611 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.621578    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:08:00.699590 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.699567    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"
Sep 11 00:08:00.723072 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.723037    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:08:00.811240 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.811205    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwsnq\" (UniqueName: \"kubernetes.io/projected/83f2a448-d6eb-4c60-b152-ff675ed63d64-kube-api-access-rwsnq\") pod \"83f2a448-d6eb-4c60-b152-ff675ed63d64\" (UID: \"83f2a448-d6eb-4c60-b152-ff675ed63d64\") "
Sep 11 00:08:00.811240 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.811239    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83f2a448-d6eb-4c60-b152-ff675ed63d64-plugins-config-volume\") pod \"83f2a448-d6eb-4c60-b152-ff675ed63d64\" (UID: \"83f2a448-d6eb-4c60-b152-ff675ed63d64\") "
Sep 11 00:08:00.811706 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.811656    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83f2a448-d6eb-4c60-b152-ff675ed63d64-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "83f2a448-d6eb-4c60-b152-ff675ed63d64" (UID: "83f2a448-d6eb-4c60-b152-ff675ed63d64"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:08:00.813661 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.813635    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83f2a448-d6eb-4c60-b152-ff675ed63d64-kube-api-access-rwsnq" (OuterVolumeSpecName: "kube-api-access-rwsnq") pod "83f2a448-d6eb-4c60-b152-ff675ed63d64" (UID: "83f2a448-d6eb-4c60-b152-ff675ed63d64"). InnerVolumeSpecName "kube-api-access-rwsnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:08:00.912278 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.912239    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwsnq\" (UniqueName: \"kubernetes.io/projected/83f2a448-d6eb-4c60-b152-ff675ed63d64-kube-api-access-rwsnq\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:08:00.912278 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.912270    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83f2a448-d6eb-4c60-b152-ff675ed63d64-plugins-config-volume\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:08:00.981979 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.981948    2581 generic.go:356] "Generic (PLEG): container finished" podID="83f2a448-d6eb-4c60-b152-ff675ed63d64" containerID="7a2054b406db293ec150c94875e591286317fb69e6e63a5d4c62d23f171b1b19" exitCode=0
Sep 11 00:08:00.982162 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.981992    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"
Sep 11 00:08:00.982162 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.982024    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl" event={"ID":"83f2a448-d6eb-4c60-b152-ff675ed63d64","Type":"ContainerDied","Data":"7a2054b406db293ec150c94875e591286317fb69e6e63a5d4c62d23f171b1b19"}
Sep 11 00:08:00.982162 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.982066    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl" event={"ID":"83f2a448-d6eb-4c60-b152-ff675ed63d64","Type":"ContainerDied","Data":"b38391cfa5ccd7874ed7f4eabf311f76cb2f3c52d9ffe7ba218e7022021ef15e"}
Sep 11 00:08:00.982162 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.982087    2581 scope.go:117] "RemoveContainer" containerID="7a2054b406db293ec150c94875e591286317fb69e6e63a5d4c62d23f171b1b19"
Sep 11 00:08:00.992053 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.992035    2581 scope.go:117] "RemoveContainer" containerID="7a2054b406db293ec150c94875e591286317fb69e6e63a5d4c62d23f171b1b19"
Sep 11 00:08:00.992318 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:08:00.992298    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a2054b406db293ec150c94875e591286317fb69e6e63a5d4c62d23f171b1b19\": container with ID starting with 7a2054b406db293ec150c94875e591286317fb69e6e63a5d4c62d23f171b1b19 not found: ID does not exist" containerID="7a2054b406db293ec150c94875e591286317fb69e6e63a5d4c62d23f171b1b19"
Sep 11 00:08:00.992389 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:00.992328    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a2054b406db293ec150c94875e591286317fb69e6e63a5d4c62d23f171b1b19"} err="failed to get container status \"7a2054b406db293ec150c94875e591286317fb69e6e63a5d4c62d23f171b1b19\": rpc error: code = NotFound desc = could not find container \"7a2054b406db293ec150c94875e591286317fb69e6e63a5d4c62d23f171b1b19\": container with ID starting with 7a2054b406db293ec150c94875e591286317fb69e6e63a5d4c62d23f171b1b19 not found: ID does not exist"
Sep 11 00:08:01.011616 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:01.011588    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"]
Sep 11 00:08:01.012432 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:01.012371    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:08:01.014431 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:01.014401    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl"]
Sep 11 00:08:02.483428 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:02.483333    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83f2a448-d6eb-4c60-b152-ff675ed63d64" path="/var/lib/kubelet/pods/83f2a448-d6eb-4c60-b152-ff675ed63d64/volumes"
Sep 11 00:08:03.025895 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:03.025860    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:08:07.039461 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:07.039430    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:08:07.106317 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:07.106290    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:08:07.273441 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:07.273401    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"]
Sep 11 00:08:07.273741 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:07.273711    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78" podUID="862f5684-5473-4af1-a90d-25205f186e45" containerName="istio-proxy" containerID="cri-o://6afaf849cab11982aa9f0b8a95b43f3dc17861a3f53bbcac43c4a9e1759873fa" gracePeriod=30
Sep 11 00:08:07.297014 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:07.296899    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:08:12.121520 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.121486    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:08:12.524429 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.524404    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 11 00:08:12.615485 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.615452    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/862f5684-5473-4af1-a90d-25205f186e45-istio-token\") pod \"862f5684-5473-4af1-a90d-25205f186e45\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") "
Sep 11 00:08:12.615697 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.615498    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/862f5684-5473-4af1-a90d-25205f186e45-istio-podinfo\") pod \"862f5684-5473-4af1-a90d-25205f186e45\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") "
Sep 11 00:08:12.615697 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.615521    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-istio-envoy\") pod \"862f5684-5473-4af1-a90d-25205f186e45\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") "
Sep 11 00:08:12.615697 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.615545    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-workload-certs\") pod \"862f5684-5473-4af1-a90d-25205f186e45\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") "
Sep 11 00:08:12.615697 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.615603    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/862f5684-5473-4af1-a90d-25205f186e45-istiod-ca-cert\") pod \"862f5684-5473-4af1-a90d-25205f186e45\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") "
Sep 11 00:08:12.615697 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.615659    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-workload-socket\") pod \"862f5684-5473-4af1-a90d-25205f186e45\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") "
Sep 11 00:08:12.615992 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.615731    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-credential-socket\") pod \"862f5684-5473-4af1-a90d-25205f186e45\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") "
Sep 11 00:08:12.615992 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.615789    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8s9wz\" (UniqueName: \"kubernetes.io/projected/862f5684-5473-4af1-a90d-25205f186e45-kube-api-access-8s9wz\") pod \"862f5684-5473-4af1-a90d-25205f186e45\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") "
Sep 11 00:08:12.615992 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.615814    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-istio-data\") pod \"862f5684-5473-4af1-a90d-25205f186e45\" (UID: \"862f5684-5473-4af1-a90d-25205f186e45\") "
Sep 11 00:08:12.615992 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.615926    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "862f5684-5473-4af1-a90d-25205f186e45" (UID: "862f5684-5473-4af1-a90d-25205f186e45"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:08:12.616187 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.616016    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "862f5684-5473-4af1-a90d-25205f186e45" (UID: "862f5684-5473-4af1-a90d-25205f186e45"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:08:12.616187 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.616038    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "862f5684-5473-4af1-a90d-25205f186e45" (UID: "862f5684-5473-4af1-a90d-25205f186e45"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:08:12.616461 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.616257    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-istio-data" (OuterVolumeSpecName: "istio-data") pod "862f5684-5473-4af1-a90d-25205f186e45" (UID: "862f5684-5473-4af1-a90d-25205f186e45"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:08:12.616461 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.616349    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/862f5684-5473-4af1-a90d-25205f186e45-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "862f5684-5473-4af1-a90d-25205f186e45" (UID: "862f5684-5473-4af1-a90d-25205f186e45"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:08:12.616461 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.616446    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-workload-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:08:12.616620 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.616465    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-workload-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:08:12.616620 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.616480    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-credential-socket\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:08:12.618034 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.618004    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/862f5684-5473-4af1-a90d-25205f186e45-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "862f5684-5473-4af1-a90d-25205f186e45" (UID: "862f5684-5473-4af1-a90d-25205f186e45"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 00:08:12.618034 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.618020    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "862f5684-5473-4af1-a90d-25205f186e45" (UID: "862f5684-5473-4af1-a90d-25205f186e45"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:08:12.618200 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.618055    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/862f5684-5473-4af1-a90d-25205f186e45-istio-token" (OuterVolumeSpecName: "istio-token") pod "862f5684-5473-4af1-a90d-25205f186e45" (UID: "862f5684-5473-4af1-a90d-25205f186e45"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:08:12.618200 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.618089    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/862f5684-5473-4af1-a90d-25205f186e45-kube-api-access-8s9wz" (OuterVolumeSpecName: "kube-api-access-8s9wz") pod "862f5684-5473-4af1-a90d-25205f186e45" (UID: "862f5684-5473-4af1-a90d-25205f186e45"). InnerVolumeSpecName "kube-api-access-8s9wz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:08:12.717793 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.717752    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8s9wz\" (UniqueName: \"kubernetes.io/projected/862f5684-5473-4af1-a90d-25205f186e45-kube-api-access-8s9wz\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:08:12.717793 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.717777    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-istio-data\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:08:12.717793 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.717786    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/862f5684-5473-4af1-a90d-25205f186e45-istio-token\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:08:12.717793 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.717795    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/862f5684-5473-4af1-a90d-25205f186e45-istio-podinfo\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:08:12.717793 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.717804    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/862f5684-5473-4af1-a90d-25205f186e45-istio-envoy\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:08:12.718280 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:12.717813    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/862f5684-5473-4af1-a90d-25205f186e45-istiod-ca-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:08:13.052946 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:13.052843    2581 generic.go:356] "Generic (PLEG): container finished" podID="862f5684-5473-4af1-a90d-25205f186e45" containerID="6afaf849cab11982aa9f0b8a95b43f3dc17861a3f53bbcac43c4a9e1759873fa" exitCode=0
Sep 11 00:08:13.052946 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:13.052917    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"
Sep 11 00:08:13.053211 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:13.052944    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78" event={"ID":"862f5684-5473-4af1-a90d-25205f186e45","Type":"ContainerDied","Data":"6afaf849cab11982aa9f0b8a95b43f3dc17861a3f53bbcac43c4a9e1759873fa"}
Sep 11 00:08:13.053211 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:13.053032    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78" event={"ID":"862f5684-5473-4af1-a90d-25205f186e45","Type":"ContainerDied","Data":"d434009687fcd14af48e2fa744ea77b069bc8c3640616f70c2a66d68905e641f"}
Sep 11 00:08:13.053211 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:13.053083    2581 scope.go:117] "RemoveContainer" containerID="6afaf849cab11982aa9f0b8a95b43f3dc17861a3f53bbcac43c4a9e1759873fa"
Sep 11 00:08:13.064948 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:13.064927    2581 scope.go:117] "RemoveContainer" containerID="2f31dfacc3093c86fe9d16a82318a38fead2365129d08a9d2ead540b239cde82"
Sep 11 00:08:13.074618 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:13.074601    2581 scope.go:117] "RemoveContainer" containerID="6afaf849cab11982aa9f0b8a95b43f3dc17861a3f53bbcac43c4a9e1759873fa"
Sep 11 00:08:13.074906 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:08:13.074884    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6afaf849cab11982aa9f0b8a95b43f3dc17861a3f53bbcac43c4a9e1759873fa\": container with ID starting with 6afaf849cab11982aa9f0b8a95b43f3dc17861a3f53bbcac43c4a9e1759873fa not found: ID does not exist" containerID="6afaf849cab11982aa9f0b8a95b43f3dc17861a3f53bbcac43c4a9e1759873fa"
Sep 11 00:08:13.074988 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:13.074914    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6afaf849cab11982aa9f0b8a95b43f3dc17861a3f53bbcac43c4a9e1759873fa"} err="failed to get container status \"6afaf849cab11982aa9f0b8a95b43f3dc17861a3f53bbcac43c4a9e1759873fa\": rpc error: code = NotFound desc = could not find container \"6afaf849cab11982aa9f0b8a95b43f3dc17861a3f53bbcac43c4a9e1759873fa\": container with ID starting with 6afaf849cab11982aa9f0b8a95b43f3dc17861a3f53bbcac43c4a9e1759873fa not found: ID does not exist"
Sep 11 00:08:13.074988 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:13.074931    2581 scope.go:117] "RemoveContainer" containerID="2f31dfacc3093c86fe9d16a82318a38fead2365129d08a9d2ead540b239cde82"
Sep 11 00:08:13.075234 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:08:13.075219    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f31dfacc3093c86fe9d16a82318a38fead2365129d08a9d2ead540b239cde82\": container with ID starting with 2f31dfacc3093c86fe9d16a82318a38fead2365129d08a9d2ead540b239cde82 not found: ID does not exist" containerID="2f31dfacc3093c86fe9d16a82318a38fead2365129d08a9d2ead540b239cde82"
Sep 11 00:08:13.075295 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:13.075237    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f31dfacc3093c86fe9d16a82318a38fead2365129d08a9d2ead540b239cde82"} err="failed to get container status \"2f31dfacc3093c86fe9d16a82318a38fead2365129d08a9d2ead540b239cde82\": rpc error: code = NotFound desc = could not find container \"2f31dfacc3093c86fe9d16a82318a38fead2365129d08a9d2ead540b239cde82\": container with ID starting with 2f31dfacc3093c86fe9d16a82318a38fead2365129d08a9d2ead540b239cde82 not found: ID does not exist"
Sep 11 00:08:13.075470 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:13.075451    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"]
Sep 11 00:08:13.079610 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:13.079591    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78"]
Sep 11 00:08:14.483786 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:14.483753    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="862f5684-5473-4af1-a90d-25205f186e45" path="/var/lib/kubelet/pods/862f5684-5473-4af1-a90d-25205f186e45/volumes"
Sep 11 00:08:41.017775 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:08:41.017745    2581 scope.go:117] "RemoveContainer" containerID="721966823c98019f2b4ad40875bce27caf0a32ba8cfcf7934887e657b9d54a3c"
Sep 11 00:09:34.224290 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:09:34.224187    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:09:35.025634 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:09:35.025590    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:09:35.722987 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:09:35.722947    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:09:37.198968 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:09:37.198934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:10:01.323164 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:01.323129    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:10:09.723945 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:09.723913    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:10:19.624598 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:19.624560    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:10:34.123760 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:34.123726    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:10:46.441231 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:46.441196    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:10:46.721863 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:46.721832    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:10:49.057526 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:49.057493    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"]
Sep 11 00:10:49.057970 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:49.057734    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps" podUID="20b7692c-ed7d-4be2-9c8d-f2223313b6a6" containerName="manager" containerID="cri-o://5a8fa28d9d1c629fdd718d14102b4a9da2e09f7a81b754cd130da07fce1c6603" gracePeriod=10
Sep 11 00:10:49.682549 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:49.682517    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps" podUID="20b7692c-ed7d-4be2-9c8d-f2223313b6a6" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.44:8081/readyz\": dial tcp 10.133.0.44:8081: connect: connection refused"
Sep 11 00:10:49.908486 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:49.908447    2581 generic.go:356] "Generic (PLEG): container finished" podID="20b7692c-ed7d-4be2-9c8d-f2223313b6a6" containerID="5a8fa28d9d1c629fdd718d14102b4a9da2e09f7a81b754cd130da07fce1c6603" exitCode=0
Sep 11 00:10:49.908699 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:49.908524    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps" event={"ID":"20b7692c-ed7d-4be2-9c8d-f2223313b6a6","Type":"ContainerDied","Data":"5a8fa28d9d1c629fdd718d14102b4a9da2e09f7a81b754cd130da07fce1c6603"}
Sep 11 00:10:50.299547 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:50.299524    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"
Sep 11 00:10:50.423237 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:50.423154    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20b7692c-ed7d-4be2-9c8d-f2223313b6a6-extensions-socket-volume\") pod \"20b7692c-ed7d-4be2-9c8d-f2223313b6a6\" (UID: \"20b7692c-ed7d-4be2-9c8d-f2223313b6a6\") "
Sep 11 00:10:50.423237 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:50.423223    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt6jq\" (UniqueName: \"kubernetes.io/projected/20b7692c-ed7d-4be2-9c8d-f2223313b6a6-kube-api-access-dt6jq\") pod \"20b7692c-ed7d-4be2-9c8d-f2223313b6a6\" (UID: \"20b7692c-ed7d-4be2-9c8d-f2223313b6a6\") "
Sep 11 00:10:50.423516 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:50.423491    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20b7692c-ed7d-4be2-9c8d-f2223313b6a6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "20b7692c-ed7d-4be2-9c8d-f2223313b6a6" (UID: "20b7692c-ed7d-4be2-9c8d-f2223313b6a6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:10:50.425325 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:50.425303    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20b7692c-ed7d-4be2-9c8d-f2223313b6a6-kube-api-access-dt6jq" (OuterVolumeSpecName: "kube-api-access-dt6jq") pod "20b7692c-ed7d-4be2-9c8d-f2223313b6a6" (UID: "20b7692c-ed7d-4be2-9c8d-f2223313b6a6"). InnerVolumeSpecName "kube-api-access-dt6jq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:10:50.524471 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:50.524440    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20b7692c-ed7d-4be2-9c8d-f2223313b6a6-extensions-socket-volume\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:10:50.524471 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:50.524463    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt6jq\" (UniqueName: \"kubernetes.io/projected/20b7692c-ed7d-4be2-9c8d-f2223313b6a6-kube-api-access-dt6jq\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:10:50.915350 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:50.915321    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"
Sep 11 00:10:50.915543 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:50.915359    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps" event={"ID":"20b7692c-ed7d-4be2-9c8d-f2223313b6a6","Type":"ContainerDied","Data":"968b695b098d52572d1f6c1b2699079dca1ea78d3cab3ecab255ab80fbea855b"}
Sep 11 00:10:50.915543 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:50.915416    2581 scope.go:117] "RemoveContainer" containerID="5a8fa28d9d1c629fdd718d14102b4a9da2e09f7a81b754cd130da07fce1c6603"
Sep 11 00:10:50.935742 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:50.935698    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"]
Sep 11 00:10:50.938637 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:50.938616    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8gxps"]
Sep 11 00:10:52.483410 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:10:52.483376    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20b7692c-ed7d-4be2-9c8d-f2223313b6a6" path="/var/lib/kubelet/pods/20b7692c-ed7d-4be2-9c8d-f2223313b6a6/volumes"
Sep 11 00:11:07.051773 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:07.051689    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:11:41.068111 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:41.068076    2581 scope.go:117] "RemoveContainer" containerID="d0e139c132a5999d337da94f82eba96cc9c232857e889ba078392f1372c264ac"
Sep 11 00:11:49.735814 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.735780    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xtlgw"]
Sep 11 00:11:49.736176 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736114    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20b7692c-ed7d-4be2-9c8d-f2223313b6a6" containerName="manager"
Sep 11 00:11:49.736176 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736125    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="20b7692c-ed7d-4be2-9c8d-f2223313b6a6" containerName="manager"
Sep 11 00:11:49.736176 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736137    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc4342e8-dd5d-48ef-96e2-f093cecdae6f" containerName="istio-proxy"
Sep 11 00:11:49.736176 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736142    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc4342e8-dd5d-48ef-96e2-f093cecdae6f" containerName="istio-proxy"
Sep 11 00:11:49.736176 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736149    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="862f5684-5473-4af1-a90d-25205f186e45" containerName="istio-proxy"
Sep 11 00:11:49.736176 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736154    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="862f5684-5473-4af1-a90d-25205f186e45" containerName="istio-proxy"
Sep 11 00:11:49.736176 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736160    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83f2a448-d6eb-4c60-b152-ff675ed63d64" containerName="payload-processing"
Sep 11 00:11:49.736176 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736166    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="83f2a448-d6eb-4c60-b152-ff675ed63d64" containerName="payload-processing"
Sep 11 00:11:49.736176 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736176    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc4342e8-dd5d-48ef-96e2-f093cecdae6f" containerName="istio-proxy"
Sep 11 00:11:49.736176 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736181    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc4342e8-dd5d-48ef-96e2-f093cecdae6f" containerName="istio-proxy"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736187    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f8221d9-db79-4306-a6ac-177f7e000254" containerName="revoke-keys"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736192    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f8221d9-db79-4306-a6ac-177f7e000254" containerName="revoke-keys"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736200    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" containerName="istio-proxy"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736205    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" containerName="istio-proxy"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736212    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5d0c7c8-274e-406b-9b1b-6ec1c256b86f" containerName="payload-pre-processing"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736218    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5d0c7c8-274e-406b-9b1b-6ec1c256b86f" containerName="payload-pre-processing"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736224    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="862f5684-5473-4af1-a90d-25205f186e45" containerName="istio-proxy"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736228    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="862f5684-5473-4af1-a90d-25205f186e45" containerName="istio-proxy"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736234    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f793533f-558b-4702-839e-54f7b36d9909" containerName="main"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736240    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f793533f-558b-4702-839e-54f7b36d9909" containerName="main"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736293    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc4342e8-dd5d-48ef-96e2-f093cecdae6f" containerName="istio-proxy"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736300    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f8221d9-db79-4306-a6ac-177f7e000254" containerName="revoke-keys"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736307    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="862f5684-5473-4af1-a90d-25205f186e45" containerName="istio-proxy"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736313    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="20b7692c-ed7d-4be2-9c8d-f2223313b6a6" containerName="manager"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736320    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="862f5684-5473-4af1-a90d-25205f186e45" containerName="istio-proxy"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736325    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5d0c7c8-274e-406b-9b1b-6ec1c256b86f" containerName="payload-pre-processing"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736330    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f793533f-558b-4702-839e-54f7b36d9909" containerName="main"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736336    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" containerName="istio-proxy"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736341    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="83f2a448-d6eb-4c60-b152-ff675ed63d64" containerName="payload-processing"
Sep 11 00:11:49.736494 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.736347    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" containerName="istio-proxy"
Sep 11 00:11:49.739312 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.739297    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xtlgw"
Sep 11 00:11:49.742840 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.742821    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-55njz\""
Sep 11 00:11:49.750120 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.750099    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xtlgw"]
Sep 11 00:11:49.810144 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.810120    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwhsk\" (UniqueName: \"kubernetes.io/projected/d80c497b-6957-46e9-98f8-ae6ba9a1abe1-kube-api-access-zwhsk\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xtlgw\" (UID: \"d80c497b-6957-46e9-98f8-ae6ba9a1abe1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xtlgw"
Sep 11 00:11:49.810274 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.810218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d80c497b-6957-46e9-98f8-ae6ba9a1abe1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xtlgw\" (UID: \"d80c497b-6957-46e9-98f8-ae6ba9a1abe1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xtlgw"
Sep 11 00:11:49.910975 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.910921    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d80c497b-6957-46e9-98f8-ae6ba9a1abe1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xtlgw\" (UID: \"d80c497b-6957-46e9-98f8-ae6ba9a1abe1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xtlgw"
Sep 11 00:11:49.911127 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.910998    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwhsk\" (UniqueName: \"kubernetes.io/projected/d80c497b-6957-46e9-98f8-ae6ba9a1abe1-kube-api-access-zwhsk\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xtlgw\" (UID: \"d80c497b-6957-46e9-98f8-ae6ba9a1abe1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xtlgw"
Sep 11 00:11:49.911274 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.911253    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d80c497b-6957-46e9-98f8-ae6ba9a1abe1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xtlgw\" (UID: \"d80c497b-6957-46e9-98f8-ae6ba9a1abe1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xtlgw"
Sep 11 00:11:49.919631 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:49.919607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwhsk\" (UniqueName: \"kubernetes.io/projected/d80c497b-6957-46e9-98f8-ae6ba9a1abe1-kube-api-access-zwhsk\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xtlgw\" (UID: \"d80c497b-6957-46e9-98f8-ae6ba9a1abe1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xtlgw"
Sep 11 00:11:50.049635 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:50.049565    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xtlgw"
Sep 11 00:11:50.331925 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:50.331898    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xtlgw"]
Sep 11 00:11:50.332278 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:11:50.332251    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd80c497b_6957_46e9_98f8_ae6ba9a1abe1.slice/crio-978dfd11c39a84c8af323718af6f71e9e03cb0c8010224ba9bfebd2ba94611d2 WatchSource:0}: Error finding container 978dfd11c39a84c8af323718af6f71e9e03cb0c8010224ba9bfebd2ba94611d2: Status 404 returned error can't find the container with id 978dfd11c39a84c8af323718af6f71e9e03cb0c8010224ba9bfebd2ba94611d2
Sep 11 00:11:51.237420 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:51.237380    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xtlgw" event={"ID":"d80c497b-6957-46e9-98f8-ae6ba9a1abe1","Type":"ContainerStarted","Data":"e60a0704c4f9462d88dc95d7313f1e9292e7fad420e7438e364d9f0ce367c6b6"}
Sep 11 00:11:51.237827 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:51.237429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xtlgw" event={"ID":"d80c497b-6957-46e9-98f8-ae6ba9a1abe1","Type":"ContainerStarted","Data":"978dfd11c39a84c8af323718af6f71e9e03cb0c8010224ba9bfebd2ba94611d2"}
Sep 11 00:11:51.237827 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:51.237477    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xtlgw"
Sep 11 00:11:51.260895 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:11:51.260857    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xtlgw" podStartSLOduration=2.260843924 podStartE2EDuration="2.260843924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:11:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:11:51.259055473 +0000 UTC m=+2111.299924777" watchObservedRunningTime="2026-09-11 00:11:51.260843924 +0000 UTC m=+2111.301713229"
Sep 11 00:12:02.245415 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:02.245380    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xtlgw"
Sep 11 00:12:18.116871 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:18.116837    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:12:24.516015 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:24.515974    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:12:37.731379 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.731292    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"]
Sep 11 00:12:37.731809 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.731791    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" containerName="istio-proxy"
Sep 11 00:12:37.731855 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.731811    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8fdbb0e-5f41-44e0-b57e-d8acc9bf8f1b" containerName="istio-proxy"
Sep 11 00:12:37.731890 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.731884    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc4342e8-dd5d-48ef-96e2-f093cecdae6f" containerName="istio-proxy"
Sep 11 00:12:37.735075 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.735053    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.737628 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.737611    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-f44b3dab-kserve-self-signed-certs\""
Sep 11 00:12:37.742929 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.742906    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"]
Sep 11 00:12:37.832176 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.832142    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38405480-9bc5-41c6-8ddd-e44b415eddd7-tls-certs\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.832176 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.832183    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-dshm\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.832406 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.832200    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-model-cache\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.832406 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.832329    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-home\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.832406 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.832385    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-tmp-dir\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.832406 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.832403    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gljt\" (UniqueName: \"kubernetes.io/projected/38405480-9bc5-41c6-8ddd-e44b415eddd7-kube-api-access-6gljt\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.854643 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.854611    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:12:37.933572 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.933541    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-home\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.933794 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.933594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-tmp-dir\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.933794 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.933615    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gljt\" (UniqueName: \"kubernetes.io/projected/38405480-9bc5-41c6-8ddd-e44b415eddd7-kube-api-access-6gljt\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.933794 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.933651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38405480-9bc5-41c6-8ddd-e44b415eddd7-tls-certs\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.933794 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.933702    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-dshm\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.933794 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.933725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-model-cache\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.934077 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.934058    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-tmp-dir\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.934139 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.934061    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-home\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.934139 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.934114    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-model-cache\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.936210 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.936181    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-dshm\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.936378 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.936362    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38405480-9bc5-41c6-8ddd-e44b415eddd7-tls-certs\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:37.941415 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:37.941391    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gljt\" (UniqueName: \"kubernetes.io/projected/38405480-9bc5-41c6-8ddd-e44b415eddd7-kube-api-access-6gljt\") pod \"e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") " pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:38.045717 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:38.045613    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:38.323317 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:38.323290    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"]
Sep 11 00:12:38.325063 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:12:38.325036    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38405480_9bc5_41c6_8ddd_e44b415eddd7.slice/crio-05c4acf59ae12d9af069a235d9b0a19da1c67456fe9808334230b1e6f3c5882b WatchSource:0}: Error finding container 05c4acf59ae12d9af069a235d9b0a19da1c67456fe9808334230b1e6f3c5882b: Status 404 returned error can't find the container with id 05c4acf59ae12d9af069a235d9b0a19da1c67456fe9808334230b1e6f3c5882b
Sep 11 00:12:38.497335 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:38.497304    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt" event={"ID":"38405480-9bc5-41c6-8ddd-e44b415eddd7","Type":"ContainerStarted","Data":"94e2ad5ca7515a7c27af436ee6f0d7a96799ea41b8797fb2e230fabd2ef52364"}
Sep 11 00:12:38.497335 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:38.497345    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt" event={"ID":"38405480-9bc5-41c6-8ddd-e44b415eddd7","Type":"ContainerStarted","Data":"05c4acf59ae12d9af069a235d9b0a19da1c67456fe9808334230b1e6f3c5882b"}
Sep 11 00:12:38.514547 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:38.514489    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt" podStartSLOduration=1.5144707880000001 podStartE2EDuration="1.514470788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:12:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:12:38.512877677 +0000 UTC m=+2158.553746978" watchObservedRunningTime="2026-09-11 00:12:38.514470788 +0000 UTC m=+2158.555340097"
Sep 11 00:12:40.426029 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:40.425997    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:12:46.651091 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:46.651056    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:12:48.046585 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:48.046546    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:48.047000 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:48.046895    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:48.059600 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:48.059576    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:48.564526 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:48.564496    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:12:50.526939 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:12:50.526903    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:13:01.276545 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:01.276507    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"]
Sep 11 00:13:01.297904 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:01.297870    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:13:02.327315 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:02.327281    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:13:04.921981 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:04.921943    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:13:14.814754 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:14.814720    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:13:16.296614 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.296570    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt" podUID="38405480-9bc5-41c6-8ddd-e44b415eddd7" containerName="main" containerID="cri-o://94e2ad5ca7515a7c27af436ee6f0d7a96799ea41b8797fb2e230fabd2ef52364" gracePeriod=45
Sep 11 00:13:16.546021 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.545994    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:13:16.574958 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.574866    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-home\") pod \"38405480-9bc5-41c6-8ddd-e44b415eddd7\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") "
Sep 11 00:13:16.574958 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.574924    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-model-cache\") pod \"38405480-9bc5-41c6-8ddd-e44b415eddd7\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") "
Sep 11 00:13:16.574958 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.574956    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-dshm\") pod \"38405480-9bc5-41c6-8ddd-e44b415eddd7\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") "
Sep 11 00:13:16.575177 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.574981    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38405480-9bc5-41c6-8ddd-e44b415eddd7-tls-certs\") pod \"38405480-9bc5-41c6-8ddd-e44b415eddd7\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") "
Sep 11 00:13:16.575177 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.575010    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gljt\" (UniqueName: \"kubernetes.io/projected/38405480-9bc5-41c6-8ddd-e44b415eddd7-kube-api-access-6gljt\") pod \"38405480-9bc5-41c6-8ddd-e44b415eddd7\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") "
Sep 11 00:13:16.575177 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.575034    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-tmp-dir\") pod \"38405480-9bc5-41c6-8ddd-e44b415eddd7\" (UID: \"38405480-9bc5-41c6-8ddd-e44b415eddd7\") "
Sep 11 00:13:16.575177 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.575126    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-home" (OuterVolumeSpecName: "home") pod "38405480-9bc5-41c6-8ddd-e44b415eddd7" (UID: "38405480-9bc5-41c6-8ddd-e44b415eddd7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:13:16.575320 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.575252    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-model-cache" (OuterVolumeSpecName: "model-cache") pod "38405480-9bc5-41c6-8ddd-e44b415eddd7" (UID: "38405480-9bc5-41c6-8ddd-e44b415eddd7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:13:16.575320 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.575312    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-home\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:13:16.575402 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.575329    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-model-cache\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:13:16.575465 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.575432    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "38405480-9bc5-41c6-8ddd-e44b415eddd7" (UID: "38405480-9bc5-41c6-8ddd-e44b415eddd7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:13:16.577401 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.577372    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38405480-9bc5-41c6-8ddd-e44b415eddd7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "38405480-9bc5-41c6-8ddd-e44b415eddd7" (UID: "38405480-9bc5-41c6-8ddd-e44b415eddd7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:13:16.577528 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.577454    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38405480-9bc5-41c6-8ddd-e44b415eddd7-kube-api-access-6gljt" (OuterVolumeSpecName: "kube-api-access-6gljt") pod "38405480-9bc5-41c6-8ddd-e44b415eddd7" (UID: "38405480-9bc5-41c6-8ddd-e44b415eddd7"). InnerVolumeSpecName "kube-api-access-6gljt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:13:16.577599 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.577585    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-dshm" (OuterVolumeSpecName: "dshm") pod "38405480-9bc5-41c6-8ddd-e44b415eddd7" (UID: "38405480-9bc5-41c6-8ddd-e44b415eddd7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:13:16.676002 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.675960    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gljt\" (UniqueName: \"kubernetes.io/projected/38405480-9bc5-41c6-8ddd-e44b415eddd7-kube-api-access-6gljt\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:13:16.676209 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.676018    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-tmp-dir\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:13:16.676209 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.676035    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38405480-9bc5-41c6-8ddd-e44b415eddd7-dshm\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:13:16.676209 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.676047    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38405480-9bc5-41c6-8ddd-e44b415eddd7-tls-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\""
Sep 11 00:13:16.711156 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.711118    2581 generic.go:356] "Generic (PLEG): container finished" podID="38405480-9bc5-41c6-8ddd-e44b415eddd7" containerID="94e2ad5ca7515a7c27af436ee6f0d7a96799ea41b8797fb2e230fabd2ef52364" exitCode=0
Sep 11 00:13:16.711327 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.711166    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"
Sep 11 00:13:16.711327 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.711204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt" event={"ID":"38405480-9bc5-41c6-8ddd-e44b415eddd7","Type":"ContainerDied","Data":"94e2ad5ca7515a7c27af436ee6f0d7a96799ea41b8797fb2e230fabd2ef52364"}
Sep 11 00:13:16.711327 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.711245    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt" event={"ID":"38405480-9bc5-41c6-8ddd-e44b415eddd7","Type":"ContainerDied","Data":"05c4acf59ae12d9af069a235d9b0a19da1c67456fe9808334230b1e6f3c5882b"}
Sep 11 00:13:16.711327 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.711264    2581 scope.go:117] "RemoveContainer" containerID="94e2ad5ca7515a7c27af436ee6f0d7a96799ea41b8797fb2e230fabd2ef52364"
Sep 11 00:13:16.721189 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.721168    2581 scope.go:117] "RemoveContainer" containerID="94e2ad5ca7515a7c27af436ee6f0d7a96799ea41b8797fb2e230fabd2ef52364"
Sep 11 00:13:16.721536 ip-10-0-139-147 kubenswrapper[2581]: E0911 00:13:16.721513    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94e2ad5ca7515a7c27af436ee6f0d7a96799ea41b8797fb2e230fabd2ef52364\": container with ID starting with 94e2ad5ca7515a7c27af436ee6f0d7a96799ea41b8797fb2e230fabd2ef52364 not found: ID does not exist" containerID="94e2ad5ca7515a7c27af436ee6f0d7a96799ea41b8797fb2e230fabd2ef52364"
Sep 11 00:13:16.721621 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.721543    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e2ad5ca7515a7c27af436ee6f0d7a96799ea41b8797fb2e230fabd2ef52364"} err="failed to get container status \"94e2ad5ca7515a7c27af436ee6f0d7a96799ea41b8797fb2e230fabd2ef52364\": rpc error: code = NotFound desc = could not find container \"94e2ad5ca7515a7c27af436ee6f0d7a96799ea41b8797fb2e230fabd2ef52364\": container with ID starting with 94e2ad5ca7515a7c27af436ee6f0d7a96799ea41b8797fb2e230fabd2ef52364 not found: ID does not exist"
Sep 11 00:13:16.733254 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.733217    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"]
Sep 11 00:13:16.736374 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:16.736346    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-f44b3dab-kserve-776c9777f9-mb6pt"]
Sep 11 00:13:18.484507 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:18.484462    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38405480-9bc5-41c6-8ddd-e44b415eddd7" path="/var/lib/kubelet/pods/38405480-9bc5-41c6-8ddd-e44b415eddd7/volumes"
Sep 11 00:13:21.227686 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:21.227635    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:13:29.038653 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:29.038615    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:13:36.516053 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:36.516017    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:13:44.915650 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:44.915613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:13:52.122019 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:52.121986    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x2wnt"]
Sep 11 00:13:55.354615 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:13:55.354565    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d46bc7b5f-plkxb_1560ea5b-6035-49ec-9fdb-9b3fb597a8ad/authorino/0.log"
Sep 11 00:14:01.006937 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:01.006908    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-hsxdz_4c9ab2ad-c6c2-4b31-a438-24a38381908c/manager/0.log"
Sep 11 00:14:01.124069 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:01.124035    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fgvbh_f86489b8-963e-4a1e-aeb9-6819b98d34a5/manager/0.log"
Sep 11 00:14:01.368406 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:01.368324    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6n4t6_0e501694-be14-440c-ba87-331079b592a0/server/0.log"
Sep 11 00:14:01.737380 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:01.737355    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f676b6c5d-ggk5t_3022230f-59e6-437d-8aaa-64b8f8b939e7/copy-manifests/0.log"
Sep 11 00:14:01.743585 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:01.743561    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f676b6c5d-ggk5t_3022230f-59e6-437d-8aaa-64b8f8b939e7/manager/0.log"
Sep 11 00:14:02.411751 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:02.411721    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29818080-lcv4z_4569a83a-4442-46ac-b403-219d89e7c89c/cleanup/0.log"
Sep 11 00:14:03.281433 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:03.281397    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d46bc7b5f-plkxb_1560ea5b-6035-49ec-9fdb-9b3fb597a8ad/authorino/0.log"
Sep 11 00:14:03.391489 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:03.391457    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-zr8lv_00503007-5080-4b58-b417-2e56da51cc4c/manager/0.log"
Sep 11 00:14:03.745917 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:03.745888    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-xtlgw_d80c497b-6957-46e9-98f8-ae6ba9a1abe1/manager/0.log"
Sep 11 00:14:03.873724 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:03.873696    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-x2wnt_e073421f-408c-4203-a20b-b0c65a4beae1/limitador/0.log"
Sep 11 00:14:03.988935 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:03.988909    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-bbn8x_128b9ff1-6e85-4e87-b4b3-24eccd54c85b/manager/0.log"
Sep 11 00:14:04.562406 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:04.562376    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d44b74856-lbqgq_12b76d4b-f7d8-4b8b-aed7-bf055f06aa05/kube-auth-proxy/0.log"
Sep 11 00:14:04.788312 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:04.788284    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2fjbr_74c9942a-1bb3-4968-8e95-3d119c0810a0/istio-proxy/1.log"
Sep 11 00:14:05.800745 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:05.800715    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-k7rfw_4f4a6c32-fd33-4d31-8e8d-0258d69594a0/main/0.log"
Sep 11 00:14:06.022868 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:06.022840    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-49ckq_b935f0f8-a7e8-4a86-9899-0f5a5c51b7af/main/0.log"
Sep 11 00:14:12.045077 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.045039    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-szhzc/must-gather-284mm"]
Sep 11 00:14:12.045553 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.045412    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38405480-9bc5-41c6-8ddd-e44b415eddd7" containerName="main"
Sep 11 00:14:12.045553 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.045426    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="38405480-9bc5-41c6-8ddd-e44b415eddd7" containerName="main"
Sep 11 00:14:12.045553 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.045499    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="38405480-9bc5-41c6-8ddd-e44b415eddd7" containerName="main"
Sep 11 00:14:12.048916 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.048889    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-szhzc/must-gather-284mm"
Sep 11 00:14:12.051878 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.051857    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-szhzc\"/\"kube-root-ca.crt\""
Sep 11 00:14:12.052811 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.052793    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-szhzc\"/\"default-dockercfg-fm6hk\""
Sep 11 00:14:12.052900 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.052833    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-szhzc\"/\"openshift-service-ca.crt\""
Sep 11 00:14:12.061623 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.061587    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:14:12.063117 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.063089    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-szhzc/must-gather-284mm"]
Sep 11 00:14:12.141070 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.141027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnsgs\" (UniqueName: \"kubernetes.io/projected/ac4d8afd-1cfe-44d1-a693-09f94bf88c91-kube-api-access-nnsgs\") pod \"must-gather-284mm\" (UID: \"ac4d8afd-1cfe-44d1-a693-09f94bf88c91\") " pod="openshift-must-gather-szhzc/must-gather-284mm"
Sep 11 00:14:12.141293 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.141192    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ac4d8afd-1cfe-44d1-a693-09f94bf88c91-must-gather-output\") pod \"must-gather-284mm\" (UID: \"ac4d8afd-1cfe-44d1-a693-09f94bf88c91\") " pod="openshift-must-gather-szhzc/must-gather-284mm"
Sep 11 00:14:12.187723 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.187689    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log" limit=1024
Sep 11 00:14:12.241942 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.241903    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ac4d8afd-1cfe-44d1-a693-09f94bf88c91-must-gather-output\") pod \"must-gather-284mm\" (UID: \"ac4d8afd-1cfe-44d1-a693-09f94bf88c91\") " pod="openshift-must-gather-szhzc/must-gather-284mm"
Sep 11 00:14:12.241942 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.241948    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnsgs\" (UniqueName: \"kubernetes.io/projected/ac4d8afd-1cfe-44d1-a693-09f94bf88c91-kube-api-access-nnsgs\") pod \"must-gather-284mm\" (UID: \"ac4d8afd-1cfe-44d1-a693-09f94bf88c91\") " pod="openshift-must-gather-szhzc/must-gather-284mm"
Sep 11 00:14:12.242320 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.242295    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ac4d8afd-1cfe-44d1-a693-09f94bf88c91-must-gather-output\") pod \"must-gather-284mm\" (UID: \"ac4d8afd-1cfe-44d1-a693-09f94bf88c91\") " pod="openshift-must-gather-szhzc/must-gather-284mm"
Sep 11 00:14:12.249779 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.249754    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnsgs\" (UniqueName: \"kubernetes.io/projected/ac4d8afd-1cfe-44d1-a693-09f94bf88c91-kube-api-access-nnsgs\") pod \"must-gather-284mm\" (UID: \"ac4d8afd-1cfe-44d1-a693-09f94bf88c91\") " pod="openshift-must-gather-szhzc/must-gather-284mm"
Sep 11 00:14:12.365636 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.365531    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-szhzc/must-gather-284mm"
Sep 11 00:14:12.637792 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.637702    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-szhzc/must-gather-284mm"]
Sep 11 00:14:12.640794 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:14:12.640765    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac4d8afd_1cfe_44d1_a693_09f94bf88c91.slice/crio-c96dde3ac0972e18c44942dc4d5b1a4707f09bf15bd86c8bdfbf3f68ff7f5694 WatchSource:0}: Error finding container c96dde3ac0972e18c44942dc4d5b1a4707f09bf15bd86c8bdfbf3f68ff7f5694: Status 404 returned error can't find the container with id c96dde3ac0972e18c44942dc4d5b1a4707f09bf15bd86c8bdfbf3f68ff7f5694
Sep 11 00:14:12.642701 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:12.642683    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 00:14:13.025922 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:13.025884    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-szhzc/must-gather-284mm" event={"ID":"ac4d8afd-1cfe-44d1-a693-09f94bf88c91","Type":"ContainerStarted","Data":"c96dde3ac0972e18c44942dc4d5b1a4707f09bf15bd86c8bdfbf3f68ff7f5694"}
Sep 11 00:14:14.037543 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:14.036984    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-szhzc/must-gather-284mm" event={"ID":"ac4d8afd-1cfe-44d1-a693-09f94bf88c91","Type":"ContainerStarted","Data":"679c261637ae9ab19dfa3f0945a2c091e2360bc569246cdb1cf13c39a0ef68cf"}
Sep 11 00:14:14.037543 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:14.037057    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-szhzc/must-gather-284mm" event={"ID":"ac4d8afd-1cfe-44d1-a693-09f94bf88c91","Type":"ContainerStarted","Data":"3ea4a65eb59365ac1c2654b98bfb50e963d007a5d1ce6e4f305d1f674c65eb61"}
Sep 11 00:14:14.054037 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:14.053980    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-szhzc/must-gather-284mm" podStartSLOduration=1.1820437400000001 podStartE2EDuration="2.053961173s" totalImagesPullingTime="871.917433ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:14:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:14:14.051704078 +0000 UTC m=+2254.092573384" watchObservedRunningTime="2026-09-11 00:14:14.053961173 +0000 UTC m=+2254.094830478"
Sep 11 00:14:15.153169 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:15.153141    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wc9vw_380d5f9c-5375-4728-a66b-461ec152a23b/global-pull-secret-syncer/0.log"
Sep 11 00:14:15.239338 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:15.239303    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7gdzf_aef09d11-25b8-405f-8a39-68d1c7e17a46/konnectivity-agent/0.log"
Sep 11 00:14:15.368952 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:15.368922    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-147.ec2.internal_71a0709018cb1fe9919f44a57d998256/haproxy/0.log"
Sep 11 00:14:19.795462 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:19.795427    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d46bc7b5f-plkxb_1560ea5b-6035-49ec-9fdb-9b3fb597a8ad/authorino/0.log"
Sep 11 00:14:19.831279 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:19.831248    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-zr8lv_00503007-5080-4b58-b417-2e56da51cc4c/manager/0.log"
Sep 11 00:14:19.932640 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:19.932611    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-xtlgw_d80c497b-6957-46e9-98f8-ae6ba9a1abe1/manager/0.log"
Sep 11 00:14:19.961607 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:19.961582    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-x2wnt_e073421f-408c-4203-a20b-b0c65a4beae1/limitador/0.log"
Sep 11 00:14:20.026726 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:20.026685    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-bbn8x_128b9ff1-6e85-4e87-b4b3-24eccd54c85b/manager/0.log"
Sep 11 00:14:21.736695 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:21.736645    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-btsrj_b2f3e3dd-e396-401a-bb39-e09ae0cc63ed/cluster-monitoring-operator/0.log"
Sep 11 00:14:22.030935 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:22.030856    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdwkm_1b27f5d5-b5a6-4abf-8c08-d71ead781045/node-exporter/0.log"
Sep 11 00:14:22.050689 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:22.050649    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdwkm_1b27f5d5-b5a6-4abf-8c08-d71ead781045/kube-rbac-proxy/0.log"
Sep 11 00:14:22.071418 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:22.071383    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdwkm_1b27f5d5-b5a6-4abf-8c08-d71ead781045/init-textfile/0.log"
Sep 11 00:14:22.097833 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:22.097806    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-nkflj_5a6e9048-c627-4b8b-8169-8715e8a015b5/kube-rbac-proxy-main/0.log"
Sep 11 00:14:22.136694 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:22.133789    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-nkflj_5a6e9048-c627-4b8b-8169-8715e8a015b5/kube-rbac-proxy-self/0.log"
Sep 11 00:14:22.164775 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:22.164733    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-nkflj_5a6e9048-c627-4b8b-8169-8715e8a015b5/openshift-state-metrics/0.log"
Sep 11 00:14:24.197843 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:24.197814    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-j66qz_a8aa8281-3111-4640-94aa-da77bc7128ae/networking-console-plugin/0.log"
Sep 11 00:14:25.377719 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.377685    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d7b78fc47-kfvrj_2b94b452-7aa9-442b-86f2-816e1e38de53/console/0.log"
Sep 11 00:14:25.659036 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.658944    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"]
Sep 11 00:14:25.664924 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.664889    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:25.674776 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.674744    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"]
Sep 11 00:14:25.684442 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.684405    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aff8b438-b98c-48f8-b8a9-c3525a5c3e73-sys\") pod \"perf-node-gather-daemonset-nq5cd\" (UID: \"aff8b438-b98c-48f8-b8a9-c3525a5c3e73\") " pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:25.684598 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.684497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aff8b438-b98c-48f8-b8a9-c3525a5c3e73-lib-modules\") pod \"perf-node-gather-daemonset-nq5cd\" (UID: \"aff8b438-b98c-48f8-b8a9-c3525a5c3e73\") " pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:25.684598 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.684526    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aff8b438-b98c-48f8-b8a9-c3525a5c3e73-podres\") pod \"perf-node-gather-daemonset-nq5cd\" (UID: \"aff8b438-b98c-48f8-b8a9-c3525a5c3e73\") " pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:25.684598 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.684552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aff8b438-b98c-48f8-b8a9-c3525a5c3e73-proc\") pod \"perf-node-gather-daemonset-nq5cd\" (UID: \"aff8b438-b98c-48f8-b8a9-c3525a5c3e73\") " pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:25.684815 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.684599    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl498\" (UniqueName: \"kubernetes.io/projected/aff8b438-b98c-48f8-b8a9-c3525a5c3e73-kube-api-access-jl498\") pod \"perf-node-gather-daemonset-nq5cd\" (UID: \"aff8b438-b98c-48f8-b8a9-c3525a5c3e73\") " pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:25.785574 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.785525    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aff8b438-b98c-48f8-b8a9-c3525a5c3e73-lib-modules\") pod \"perf-node-gather-daemonset-nq5cd\" (UID: \"aff8b438-b98c-48f8-b8a9-c3525a5c3e73\") " pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:25.785784 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.785586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aff8b438-b98c-48f8-b8a9-c3525a5c3e73-podres\") pod \"perf-node-gather-daemonset-nq5cd\" (UID: \"aff8b438-b98c-48f8-b8a9-c3525a5c3e73\") " pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:25.785784 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.785614    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aff8b438-b98c-48f8-b8a9-c3525a5c3e73-proc\") pod \"perf-node-gather-daemonset-nq5cd\" (UID: \"aff8b438-b98c-48f8-b8a9-c3525a5c3e73\") " pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:25.785784 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.785655    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl498\" (UniqueName: \"kubernetes.io/projected/aff8b438-b98c-48f8-b8a9-c3525a5c3e73-kube-api-access-jl498\") pod \"perf-node-gather-daemonset-nq5cd\" (UID: \"aff8b438-b98c-48f8-b8a9-c3525a5c3e73\") " pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:25.785784 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.785741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aff8b438-b98c-48f8-b8a9-c3525a5c3e73-sys\") pod \"perf-node-gather-daemonset-nq5cd\" (UID: \"aff8b438-b98c-48f8-b8a9-c3525a5c3e73\") " pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:25.786017 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.785869    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aff8b438-b98c-48f8-b8a9-c3525a5c3e73-sys\") pod \"perf-node-gather-daemonset-nq5cd\" (UID: \"aff8b438-b98c-48f8-b8a9-c3525a5c3e73\") " pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:25.786017 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.785998    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aff8b438-b98c-48f8-b8a9-c3525a5c3e73-lib-modules\") pod \"perf-node-gather-daemonset-nq5cd\" (UID: \"aff8b438-b98c-48f8-b8a9-c3525a5c3e73\") " pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:25.786139 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.786072    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aff8b438-b98c-48f8-b8a9-c3525a5c3e73-podres\") pod \"perf-node-gather-daemonset-nq5cd\" (UID: \"aff8b438-b98c-48f8-b8a9-c3525a5c3e73\") " pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:25.786139 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.786120    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aff8b438-b98c-48f8-b8a9-c3525a5c3e73-proc\") pod \"perf-node-gather-daemonset-nq5cd\" (UID: \"aff8b438-b98c-48f8-b8a9-c3525a5c3e73\") " pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:25.795779 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.795744    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl498\" (UniqueName: \"kubernetes.io/projected/aff8b438-b98c-48f8-b8a9-c3525a5c3e73-kube-api-access-jl498\") pod \"perf-node-gather-daemonset-nq5cd\" (UID: \"aff8b438-b98c-48f8-b8a9-c3525a5c3e73\") " pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:25.983357 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:25.983313    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:26.291721 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:26.291683    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"]
Sep 11 00:14:26.299366 ip-10-0-139-147 kubenswrapper[2581]: W0911 00:14:26.299329    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaff8b438_b98c_48f8_b8a9_c3525a5c3e73.slice/crio-326fdd01409c3c8b7949e667d119578e0482de1b055569fd5d6269044ea88c35 WatchSource:0}: Error finding container 326fdd01409c3c8b7949e667d119578e0482de1b055569fd5d6269044ea88c35: Status 404 returned error can't find the container with id 326fdd01409c3c8b7949e667d119578e0482de1b055569fd5d6269044ea88c35
Sep 11 00:14:27.179418 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:27.179381    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd" event={"ID":"aff8b438-b98c-48f8-b8a9-c3525a5c3e73","Type":"ContainerStarted","Data":"3addc7d0f45d94553f5444bd9e1ed4fa0cb98d555d98e581c3afb2a02c5cf2e0"}
Sep 11 00:14:27.179885 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:27.179440    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd" event={"ID":"aff8b438-b98c-48f8-b8a9-c3525a5c3e73","Type":"ContainerStarted","Data":"326fdd01409c3c8b7949e667d119578e0482de1b055569fd5d6269044ea88c35"}
Sep 11 00:14:27.179885 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:27.179590    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:27.195624 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:27.195560    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd" podStartSLOduration=2.195543681 podStartE2EDuration="2.195543681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 00:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:14:27.193727309 +0000 UTC m=+2267.234596616" watchObservedRunningTime="2026-09-11 00:14:27.195543681 +0000 UTC m=+2267.236412985"
Sep 11 00:14:27.504058 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:27.504019    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zgxwp_e6630eff-f33d-407a-b37a-2e81d3ec968c/dns/0.log"
Sep 11 00:14:27.526922 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:27.526895    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zgxwp_e6630eff-f33d-407a-b37a-2e81d3ec968c/kube-rbac-proxy/0.log"
Sep 11 00:14:27.561026 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:27.561002    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cvkl5_197415e0-e604-40a0-af02-b22590f55c2e/dns-node-resolver/0.log"
Sep 11 00:14:28.205329 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:28.205277    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5cc958457f-jp6d6_9a6499b2-8d93-4e40-9d1f-2b5c3185b93c/registry/0.log"
Sep 11 00:14:28.272477 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:28.272426    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h7g65_54ed315c-a8ea-457b-8795-b40ad51e0a01/node-ca/0.log"
Sep 11 00:14:29.615263 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:29.615229    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d44b74856-lbqgq_12b76d4b-f7d8-4b8b-aed7-bf055f06aa05/kube-auth-proxy/0.log"
Sep 11 00:14:29.665488 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:29.665448    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2fjbr_74c9942a-1bb3-4968-8e95-3d119c0810a0/istio-proxy/0.log"
Sep 11 00:14:29.676765 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:29.676735    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2fjbr_74c9942a-1bb3-4968-8e95-3d119c0810a0/istio-proxy/1.log"
Sep 11 00:14:30.647567 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:30.647538    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cjngp_3f873507-a363-4ab5-b68a-8aaa1747b705/serve-healthcheck-canary/0.log"
Sep 11 00:14:31.203704 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:31.203657    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j7j76_432c2920-5ba6-489e-8dcc-7656d6e98c6b/kube-rbac-proxy/0.log"
Sep 11 00:14:31.223153 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:31.223124    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j7j76_432c2920-5ba6-489e-8dcc-7656d6e98c6b/exporter/0.log"
Sep 11 00:14:31.244219 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:31.244189    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j7j76_432c2920-5ba6-489e-8dcc-7656d6e98c6b/extractor/0.log"
Sep 11 00:14:33.198304 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:33.198269    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-szhzc/perf-node-gather-daemonset-nq5cd"
Sep 11 00:14:33.480406 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:33.480375    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-hsxdz_4c9ab2ad-c6c2-4b31-a438-24a38381908c/manager/0.log"
Sep 11 00:14:33.703099 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:33.702528    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fgvbh_f86489b8-963e-4a1e-aeb9-6819b98d34a5/manager/0.log"
Sep 11 00:14:33.762917 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:33.762840    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6n4t6_0e501694-be14-440c-ba87-331079b592a0/server/0.log"
Sep 11 00:14:33.951289 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:33.951217    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f676b6c5d-ggk5t_3022230f-59e6-437d-8aaa-64b8f8b939e7/manager/0.log"
Sep 11 00:14:33.970508 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:33.970479    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f676b6c5d-ggk5t_3022230f-59e6-437d-8aaa-64b8f8b939e7/copy-manifests/0.log"
Sep 11 00:14:35.634475 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:35.634384    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-68kzg_f5b1f2d3-6d23-42e3-908a-00e30cad0e4c/openshift-lws-operator/0.log"
Sep 11 00:14:37.160306 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:37.160268    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d44b74856-lbqgq_12b76d4b-f7d8-4b8b-aed7-bf055f06aa05/kube-auth-proxy/0.log"
Sep 11 00:14:37.202819 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:37.202784    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2fjbr_74c9942a-1bb3-4968-8e95-3d119c0810a0/istio-proxy/0.log"
Sep 11 00:14:37.213582 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:37.213546    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2fjbr_74c9942a-1bb3-4968-8e95-3d119c0810a0/istio-proxy/1.log"
Sep 11 00:14:39.269163 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:39.269130    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d44b74856-lbqgq_12b76d4b-f7d8-4b8b-aed7-bf055f06aa05/kube-auth-proxy/0.log"
Sep 11 00:14:39.307394 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:39.307364    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2fjbr_74c9942a-1bb3-4968-8e95-3d119c0810a0/istio-proxy/0.log"
Sep 11 00:14:39.317910 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:39.317882    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2fjbr_74c9942a-1bb3-4968-8e95-3d119c0810a0/istio-proxy/1.log"
Sep 11 00:14:42.356867 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:42.356839    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-526tg_912d77fa-8dc2-459a-8469-be8706ce081d/kube-multus-additional-cni-plugins/0.log"
Sep 11 00:14:42.377205 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:42.377165    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-526tg_912d77fa-8dc2-459a-8469-be8706ce081d/egress-router-binary-copy/0.log"
Sep 11 00:14:42.396554 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:42.396518    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-526tg_912d77fa-8dc2-459a-8469-be8706ce081d/cni-plugins/0.log"
Sep 11 00:14:42.415330 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:42.415303    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-526tg_912d77fa-8dc2-459a-8469-be8706ce081d/bond-cni-plugin/0.log"
Sep 11 00:14:42.433390 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:42.433365    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-526tg_912d77fa-8dc2-459a-8469-be8706ce081d/routeoverride-cni/0.log"
Sep 11 00:14:42.452624 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:42.452553    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-526tg_912d77fa-8dc2-459a-8469-be8706ce081d/whereabouts-cni-bincopy/0.log"
Sep 11 00:14:42.471443 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:42.471418    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-526tg_912d77fa-8dc2-459a-8469-be8706ce081d/whereabouts-cni/0.log"
Sep 11 00:14:42.890617 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:42.890579    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zb552_e3fccb42-7296-4d10-9efc-e4d2344f71b4/kube-multus/0.log"
Sep 11 00:14:42.916970 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:42.916931    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4gtf5_afe96c24-b384-431f-85db-44d132dde401/network-metrics-daemon/0.log"
Sep 11 00:14:42.932685 ip-10-0-139-147 kubenswrapper[2581]: I0911 00:14:42.932652    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4gtf5_afe96c24-b384-431f-85db-44d132dde401/kube-rbac-proxy/0.log"